Duckietown Challenges Home Challenges Submissions

Submission 13035

Submission13035
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserMárton Tim 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60269
Next
User label3625
Admin priority50
Blessingn/a
User priority50

60269

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

challenge-solution-output

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60269LFVmultibodyv-simsuccessyes1:27:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.55340973712076
survival_time_median36.05000000000009
deviation-center-line_median1.7675205131345142
in-drivable-lane_median4.349999999999917


other stats
agent_compute-ego0_max0.04394223782494458
agent_compute-ego0_mean0.04288503308215611
agent_compute-ego0_median0.04251794164227244
agent_compute-ego0_min0.04227766863610921
agent_compute-ego1_max0.04216131275775386
agent_compute-ego1_mean0.04144024206985581
agent_compute-ego1_median0.04152578198018166
agent_compute-ego1_min0.04078151190181296
agent_compute-ego2_max0.0424544764760477
agent_compute-ego2_mean0.04163704577735638
agent_compute-ego2_median0.04164263746414819
agent_compute-ego2_min0.040814023391873226
agent_compute-ego3_max0.04240964291168382
agent_compute-ego3_mean0.042141954984507214
agent_compute-ego3_median0.042124946035590825
agent_compute-ego3_min0.04189127600624701
complete-iteration_max1.3914086944178532
complete-iteration_mean1.1894878111228988
complete-iteration_median1.3870018410916425
complete-iteration_min0.4216808476714071
deviation-center-line_max3.8435005665014863
deviation-center-line_mean1.909208218996713
deviation-center-line_min0.26186402816972437
deviation-heading_max18.08948391072315
deviation-heading_mean9.789797280930337
deviation-heading_median10.329147346754665
deviation-heading_min1.302834197263802
driven_any_max26.123736036490826
driven_any_mean11.1908600590636
driven_any_median10.168942823476694
driven_any_min1.0725584917799171
driven_lanedir_consec_max23.615077045143018
driven_lanedir_consec_mean8.621815315108543
driven_lanedir_consec_min1.0235093675007698
driven_lanedir_max23.615077045143018
driven_lanedir_mean9.355373508872429
driven_lanedir_median8.55340973712076
driven_lanedir_min1.0235093675007698
get_duckie_state_max3.040129063176174e-06
get_duckie_state_mean1.8886317198177171e-06
get_duckie_state_median1.48631859354035e-06
get_duckie_state_min1.3250990970049374e-06
get_robot_state_max0.014289128483167317
get_robot_state_mean0.01313645843388512
get_robot_state_median0.014056518549374552
get_robot_state_min0.007209212456416528
get_state_dump_max0.009794302264078831
get_state_dump_mean0.009154415827910971
get_state_dump_median0.009567152490854929
get_state_dump_min0.006246623349725753
get_ui_image_max0.05057210506164466
get_ui_image_mean0.045076799909089235
get_ui_image_median0.04813611916467255
get_ui_image_min0.030174593842099053
in-drivable-lane_max26.30000000000008
in-drivable-lane_mean7.328571428571387
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.0725584917799171, "get_ui_image": 0.04397327853444559, "step_physics": 0.8917377699052391, "survival_time": 17.90000000000012, "driven_lanedir": 1.0235093675007698, "get_state_dump": 0.009567152490854929, "get_robot_state": 0.014056518549374552, "sim_render-ego0": 0.0036951678709067344, "sim_render-ego1": 0.003689650373538557, "sim_render-ego2": 0.003690179676066534, "sim_render-ego3": 0.0037015334477331647, "get_duckie_state": 1.4212138141430187e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.074822524071744, "agent_compute-ego0": 0.04251794164227244, "agent_compute-ego1": 0.04078151190181296, "agent_compute-ego2": 0.0424544764760477, "agent_compute-ego3": 0.04189127600624701, "complete-iteration": 1.1739563795849473, "set_robot_commands": 0.0022008412395679187, "deviation-center-line": 1.6262351177797971, "driven_lanedir_consec": 1.0235093675007698, "sim_compute_sim_state": 0.01482657735394236, "sim_compute_performance-ego0": 0.0019142607792506311, "sim_compute_performance-ego1": 0.001985763108829934, "sim_compute_performance-ego2": 0.0019858242077415702, "sim_compute_performance-ego3": 0.0020024384628763436}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.1853905126790374, "get_ui_image": 0.04397327853444559, "step_physics": 0.8917377699052391, "survival_time": 17.90000000000012, "driven_lanedir": 1.590655298251992, "get_state_dump": 0.009567152490854929, "get_robot_state": 0.014056518549374552, "sim_render-ego0": 0.0036951678709067344, "sim_render-ego1": 0.003689650373538557, "sim_render-ego2": 0.003690179676066534, "sim_render-ego3": 0.0037015334477331647, "get_duckie_state": 1.4212138141430187e-06, "in-drivable-lane": 13.700000000000127, "deviation-heading": 1.302834197263802, "agent_compute-ego0": 0.04251794164227244, "agent_compute-ego1": 0.04078151190181296, "agent_compute-ego2": 0.0424544764760477, "agent_compute-ego3": 0.04189127600624701, "complete-iteration": 1.1739563795849473, "set_robot_commands": 0.0022008412395679187, "deviation-center-line": 0.26186402816972437, "driven_lanedir_consec": 1.590655298251992, "sim_compute_sim_state": 0.01482657735394236, "sim_compute_performance-ego0": 0.0019142607792506311, "sim_compute_performance-ego1": 0.001985763108829934, "sim_compute_performance-ego2": 0.0019858242077415702, "sim_compute_performance-ego3": 0.0020024384628763436}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.1194247902930228, "get_ui_image": 0.04397327853444559, "step_physics": 0.8917377699052391, "survival_time": 17.90000000000012, "driven_lanedir": 1.1117452013655604, "get_state_dump": 0.009567152490854929, "get_robot_state": 0.014056518549374552, "sim_render-ego0": 0.0036951678709067344, "sim_render-ego1": 0.003689650373538557, "sim_render-ego2": 0.003690179676066534, "sim_render-ego3": 0.0037015334477331647, "get_duckie_state": 1.4212138141430187e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.2608984973165924, "agent_compute-ego0": 0.04251794164227244, "agent_compute-ego1": 0.04078151190181296, "agent_compute-ego2": 0.0424544764760477, "agent_compute-ego3": 0.04189127600624701, "complete-iteration": 1.1739563795849473, "set_robot_commands": 0.0022008412395679187, "deviation-center-line": 1.5316559642197298, "driven_lanedir_consec": 1.1117452013655604, "sim_compute_sim_state": 0.01482657735394236, "sim_compute_performance-ego0": 0.0019142607792506311, "sim_compute_performance-ego1": 0.001985763108829934, "sim_compute_performance-ego2": 0.0019858242077415702, "sim_compute_performance-ego3": 0.0020024384628763436}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 7.406585529403141, "get_ui_image": 0.04397327853444559, "step_physics": 0.8917377699052391, "survival_time": 17.90000000000012, "driven_lanedir": 6.932229528966827, "get_state_dump": 0.009567152490854929, "get_robot_state": 0.014056518549374552, "sim_render-ego0": 0.0036951678709067344, "sim_render-ego1": 0.003689650373538557, "sim_render-ego2": 0.003690179676066534, "sim_render-ego3": 0.0037015334477331647, "get_duckie_state": 1.4212138141430187e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.593334248232418, "agent_compute-ego0": 0.04251794164227244, "agent_compute-ego1": 0.04078151190181296, "agent_compute-ego2": 0.0424544764760477, "agent_compute-ego3": 0.04189127600624701, "complete-iteration": 1.1739563795849473, "set_robot_commands": 0.0022008412395679187, "deviation-center-line": 1.037717477977098, "driven_lanedir_consec": 6.932229528966827, "sim_compute_sim_state": 0.01482657735394236, "sim_compute_performance-ego0": 0.0019142607792506311, "sim_compute_performance-ego1": 0.001985763108829934, "sim_compute_performance-ego2": 0.0019858242077415702, "sim_compute_performance-ego3": 0.0020024384628763436}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 5.334908888480261, "get_ui_image": 0.05057210506164466, "step_physics": 1.076349639166095, "survival_time": 36.05000000000009, "driven_lanedir": 3.947015513007132, "get_state_dump": 0.009794302264078831, "get_robot_state": 0.014289128483167317, "sim_render-ego0": 0.003943193982512667, "sim_render-ego1": 0.003811555555982933, "sim_render-ego2": 0.003790014668514854, "sim_render-ego3": 0.003788266815967507, "get_duckie_state": 1.48631859354035e-06, "in-drivable-lane": 26.30000000000008, "deviation-heading": 2.946074174343717, "agent_compute-ego0": 0.04394223782494458, "agent_compute-ego1": 0.04152578198018166, "agent_compute-ego2": 0.04164263746414819, "agent_compute-ego3": 0.04240964291168382, "complete-iteration": 1.3914086944178532, "set_robot_commands": 0.0022097294350410103, "deviation-center-line": 0.6845791420709145, "driven_lanedir_consec": 3.947015513007132, "sim_compute_sim_state": 0.038088974860236255, "sim_compute_performance-ego0": 0.002024217655784205, "sim_compute_performance-ego1": 0.0020617798094604155, "sim_compute_performance-ego2": 0.002017837482145949, "sim_compute_performance-ego3": 0.0020167814397415627}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 13.04399537909432, "get_ui_image": 0.05057210506164466, "step_physics": 1.076349639166095, "survival_time": 36.05000000000009, "driven_lanedir": 10.172793887927444, "get_state_dump": 0.009794302264078831, "get_robot_state": 0.014289128483167317, "sim_render-ego0": 0.003943193982512667, "sim_render-ego1": 0.003811555555982933, "sim_render-ego2": 0.003790014668514854, "sim_render-ego3": 0.003788266815967507, "get_duckie_state": 1.48631859354035e-06, "in-drivable-lane": 4.25000000000006, "deviation-heading": 12.438544138291498, "agent_compute-ego0": 0.04394223782494458, "agent_compute-ego1": 0.04152578198018166, "agent_compute-ego2": 0.04164263746414819, "agent_compute-ego3": 0.04240964291168382, "complete-iteration": 1.3914086944178532, "set_robot_commands": 0.0022097294350410103, "deviation-center-line": 2.761015612586023, "driven_lanedir_consec": 9.73155667189607, "sim_compute_sim_state": 0.038088974860236255, "sim_compute_performance-ego0": 0.002024217655784205, "sim_compute_performance-ego1": 0.0020617798094604155, "sim_compute_performance-ego2": 0.002017837482145949, "sim_compute_performance-ego3": 0.0020167814397415627}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 12.856701753552498, "get_ui_image": 0.05057210506164466, "step_physics": 1.076349639166095, "survival_time": 36.05000000000009, "driven_lanedir": 11.803618430851715, "get_state_dump": 0.009794302264078831, "get_robot_state": 0.014289128483167317, "sim_render-ego0": 0.003943193982512667, "sim_render-ego1": 0.003811555555982933, "sim_render-ego2": 0.003790014668514854, "sim_render-ego3": 0.003788266815967507, "get_duckie_state": 1.48631859354035e-06, "in-drivable-lane": 0.4000000000000013, "deviation-heading": 9.583472169437584, "agent_compute-ego0": 0.04394223782494458, "agent_compute-ego1": 0.04152578198018166, "agent_compute-ego2": 0.04164263746414819, "agent_compute-ego3": 0.04240964291168382, "complete-iteration": 1.3914086944178532, "set_robot_commands": 0.0022097294350410103, "deviation-center-line": 2.6371845367706683, "driven_lanedir_consec": 11.803618430851715, "sim_compute_sim_state": 0.038088974860236255, "sim_compute_performance-ego0": 0.002024217655784205, "sim_compute_performance-ego1": 0.0020617798094604155, "sim_compute_performance-ego2": 0.002017837482145949, "sim_compute_performance-ego3": 0.0020167814397415627}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 15.504935554683415, "get_ui_image": 0.05057210506164466, "step_physics": 1.076349639166095, "survival_time": 36.05000000000009, "driven_lanedir": 11.325408253947444, "get_state_dump": 0.009794302264078831, "get_robot_state": 0.014289128483167317, "sim_render-ego0": 0.003943193982512667, "sim_render-ego1": 0.003811555555982933, "sim_render-ego2": 0.003790014668514854, "sim_render-ego3": 0.003788266815967507, "get_duckie_state": 1.48631859354035e-06, "in-drivable-lane": 5.900000000000039, "deviation-heading": 11.89390403760316, "agent_compute-ego0": 0.04394223782494458, "agent_compute-ego1": 0.04152578198018166, "agent_compute-ego2": 0.04164263746414819, "agent_compute-ego3": 0.04240964291168382, "complete-iteration": 1.3914086944178532, "set_robot_commands": 0.0022097294350410103, "deviation-center-line": 2.123839495161295, "driven_lanedir_consec": 9.676351663578142, "sim_compute_sim_state": 0.038088974860236255, "sim_compute_performance-ego0": 0.002024217655784205, "sim_compute_performance-ego1": 0.0020617798094604155, "sim_compute_performance-ego2": 0.002017837482145949, "sim_compute_performance-ego3": 0.0020167814397415627}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 17.252088608481404, "get_ui_image": 0.04813611916467255, "step_physics": 1.0861044999431162, "survival_time": 40.74999999999982, "driven_lanedir": 13.46704492857206, "get_state_dump": 0.009555688967891768, "get_robot_state": 0.014027351257847804, "sim_render-ego0": 0.003647692647634768, "sim_render-ego1": 0.0036679611486547135, "sim_render-ego2": 0.003655909907584097, "sim_render-ego3": 0.0036821771486132754, "get_duckie_state": 3.040129063176174e-06, "in-drivable-lane": 4.7500000000000675, "deviation-heading": 14.20636117201488, "agent_compute-ego0": 0.04249860200227475, "agent_compute-ego1": 0.04216131275775386, "agent_compute-ego2": 0.040814023391873226, "agent_compute-ego3": 0.042124946035590825, "complete-iteration": 1.3870018410916425, "set_robot_commands": 0.002267142136891683, "deviation-center-line": 2.363154201380325, "driven_lanedir_consec": 13.46704492857206, "sim_compute_sim_state": 0.02996029456456502, "sim_compute_performance-ego0": 0.001949208332043068, "sim_compute_performance-ego1": 0.0019526952037624283, "sim_compute_performance-ego2": 0.0019688690994300096, "sim_compute_performance-ego3": 0.0019676664880677766}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 11.066779652314017, "get_ui_image": 0.04813611916467255, "step_physics": 1.0861044999431162, "survival_time": 40.74999999999982, "driven_lanedir": 8.442592266582379, "get_state_dump": 0.009555688967891768, "get_robot_state": 0.014027351257847804, "sim_render-ego0": 0.003647692647634768, "sim_render-ego1": 0.0036679611486547135, "sim_render-ego2": 0.003655909907584097, "sim_render-ego3": 0.0036821771486132754, "get_duckie_state": 3.040129063176174e-06, "in-drivable-lane": 18.2999999999996, "deviation-heading": 8.871612735052961, "agent_compute-ego0": 0.04249860200227475, "agent_compute-ego1": 0.04216131275775386, "agent_compute-ego2": 0.040814023391873226, "agent_compute-ego3": 0.042124946035590825, "complete-iteration": 1.3870018410916425, "set_robot_commands": 0.002267142136891683, "deviation-center-line": 1.4634670158018763, "driven_lanedir_consec": 8.442592266582379, "sim_compute_sim_state": 0.02996029456456502, "sim_compute_performance-ego0": 0.001949208332043068, "sim_compute_performance-ego1": 0.0019526952037624283, "sim_compute_performance-ego2": 0.0019688690994300096, "sim_compute_performance-ego3": 0.0019676664880677766}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 9.161318995377735, "get_ui_image": 0.04813611916467255, "step_physics": 1.0861044999431162, "survival_time": 40.74999999999982, "driven_lanedir": 8.664227207659142, "get_state_dump": 0.009555688967891768, "get_robot_state": 0.014027351257847804, "sim_render-ego0": 0.003647692647634768, "sim_render-ego1": 0.0036679611486547135, "sim_render-ego2": 0.003655909907584097, "sim_render-ego3": 0.0036821771486132754, "get_duckie_state": 3.040129063176174e-06, "in-drivable-lane": 0.04999999999999982, "deviation-heading": 16.566358874365626, "agent_compute-ego0": 0.04249860200227475, "agent_compute-ego1": 0.04216131275775386, "agent_compute-ego2": 0.040814023391873226, "agent_compute-ego3": 0.042124946035590825, "complete-iteration": 1.3870018410916425, "set_robot_commands": 0.002267142136891683, "deviation-center-line": 1.908805908489231, "driven_lanedir_consec": 8.664227207659142, "sim_compute_sim_state": 0.02996029456456502, "sim_compute_performance-ego0": 0.001949208332043068, "sim_compute_performance-ego1": 0.0019526952037624283, "sim_compute_performance-ego2": 0.0019688690994300096, "sim_compute_performance-ego3": 0.0019676664880677766}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 9.271105994639374, "get_ui_image": 0.04813611916467255, "step_physics": 1.0861044999431162, "survival_time": 40.74999999999982, "driven_lanedir": 6.257265976613224, "get_state_dump": 0.009555688967891768, "get_robot_state": 0.014027351257847804, "sim_render-ego0": 0.003647692647634768, "sim_render-ego1": 0.0036679611486547135, "sim_render-ego2": 0.003655909907584097, "sim_render-ego3": 0.0036821771486132754, "get_duckie_state": 3.040129063176174e-06, "in-drivable-lane": 24.499999999999673, "deviation-heading": 6.078095095255141, "agent_compute-ego0": 0.04249860200227475, "agent_compute-ego1": 0.04216131275775386, "agent_compute-ego2": 0.040814023391873226, "agent_compute-ego3": 0.042124946035590825, "complete-iteration": 1.3870018410916425, "set_robot_commands": 0.002267142136891683, "deviation-center-line": 1.147342405127867, "driven_lanedir_consec": 6.257265976613224, "sim_compute_sim_state": 0.02996029456456502, "sim_compute_performance-ego0": 0.001949208332043068, "sim_compute_performance-ego1": 0.0019526952037624283, "sim_compute_performance-ego2": 0.0019688690994300096, "sim_compute_performance-ego3": 0.0019676664880677766}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 26.123736036490826, "get_ui_image": 0.030174593842099053, "step_physics": 0.2678325650693971, "survival_time": 59.99999999999873, "driven_lanedir": 22.62204621782528, "get_state_dump": 0.006246623349725753, "get_robot_state": 0.007209212456416528, "sim_render-ego0": 0.0037755499672234606, "sim_render-ego1": 0.003772632168492707, "get_duckie_state": 1.3250990970049374e-06, "in-drivable-lane": 4.449999999999774, "deviation-heading": 16.151366159052404, "agent_compute-ego0": 0.04227766863610921, "agent_compute-ego1": 0.0411444812094937, "complete-iteration": 0.4216808476714071, "set_robot_commands": 0.00228862976849228, "deviation-center-line": 3.338553593917945, "driven_lanedir_consec": 14.442525311531568, "sim_compute_sim_state": 0.010599457155556404, "sim_compute_performance-ego0": 0.0019516488296801005, "sim_compute_performance-ego1": 0.0019820991106374772}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 25.27251063962143, "get_ui_image": 0.030174593842099053, "step_physics": 0.2678325650693971, "survival_time": 59.99999999999873, "driven_lanedir": 23.615077045143018, "get_state_dump": 0.006246623349725753, "get_robot_state": 0.007209212456416528, "sim_render-ego0": 0.0037755499672234606, "sim_render-ego1": 0.003772632168492707, "get_duckie_state": 1.3250990970049374e-06, "in-drivable-lane": 0.0, "deviation-heading": 18.08948391072315, "agent_compute-ego0": 0.04227766863610921, "agent_compute-ego1": 0.0411444812094937, "complete-iteration": 0.4216808476714071, "set_robot_commands": 0.00228862976849228, "deviation-center-line": 3.8435005665014863, "driven_lanedir_consec": 23.615077045143018, "sim_compute_sim_state": 0.010599457155556404, "sim_compute_performance-ego0": 0.0019516488296801005, "sim_compute_performance-ego1": 0.0019820991106374772}}
set_robot_commands_max0.00228862976849228
set_robot_commands_mean0.002234865055927643
set_robot_commands_median0.0022097294350410103
set_robot_commands_min0.0022008412395679187
sim_compute_performance-ego0_max0.002024217655784205
sim_compute_performance-ego0_mean0.001961003194833701
sim_compute_performance-ego0_median0.001949208332043068
sim_compute_performance-ego0_min0.0019142607792506311
sim_compute_performance-ego1_max0.0020617798094604155
sim_compute_performance-ego1_mean0.0019975107649632903
sim_compute_performance-ego1_median0.001985763108829934
sim_compute_performance-ego1_min0.0019526952037624283
sim_compute_performance-ego2_max0.002017837482145949
sim_compute_performance-ego2_mean0.0019908435964391766
sim_compute_performance-ego2_median0.0019858242077415702
sim_compute_performance-ego2_min0.0019688690994300096
sim_compute_performance-ego3_max0.0020167814397415627
sim_compute_performance-ego3_mean0.001995628796895228
sim_compute_performance-ego3_median0.0020024384628763436
sim_compute_performance-ego3_min0.0019676664880677766
sim_compute_sim_state_max0.038088974860236255
sim_compute_sim_state_mean0.025193021530434807
sim_compute_sim_state_median0.02996029456456502
sim_compute_sim_state_min0.010599457155556404
sim_render-ego0_max0.003943193982512667
sim_render-ego0_mean0.0037639512813331137
sim_render-ego0_median0.0036951678709067344
sim_render-ego0_min0.003647692647634768
sim_render-ego1_max0.003811555555982933
sim_render-ego1_mean0.003730138046406444
sim_render-ego1_median0.003689650373538557
sim_render-ego1_min0.0036679611486547135
sim_render-ego2_max0.003790014668514854
sim_render-ego2_mean0.003712034750721829
sim_render-ego2_median0.003690179676066534
sim_render-ego2_min0.003655909907584097
sim_render-ego3_max0.003788266815967507
sim_render-ego3_mean0.003723992470771316
sim_render-ego3_median0.0037015334477331647
sim_render-ego3_min0.0036821771486132754
simulation-passed1
step_physics_max1.0861044999431162
step_physics_mean0.9108880547283283
step_physics_median1.076349639166095
step_physics_min0.2678325650693971
survival_time_max59.99999999999873
survival_time_mean35.628571428571256
survival_time_min17.90000000000012
No reset possible