Duckietown Challenges Home Challenges Submissions

Submission 12914

Submission12914
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserRobert Moni 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 59856
Next
User labelspeedRL
Admin priority50
Blessingn/a
User priority50

59856

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

challenge-solution-output

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
59856LFVmultibodyv-simsuccessyes1:40:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median18.263527605975028
survival_time_median59.99999999999873
deviation-center-line_median1.77184461764775
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.022159656021219803
agent_compute-ego0_mean0.02165319375933968
agent_compute-ego0_median0.021727829352703617
agent_compute-ego0_min0.021142449208242903
agent_compute-ego1_max0.022016812919280013
agent_compute-ego1_mean0.0216808893939495
agent_compute-ego1_median0.021933209389870013
agent_compute-ego1_min0.02095789178821268
complete-iteration_max0.758613426421306
complete-iteration_mean0.6388360286164513
complete-iteration_median0.728288834934727
complete-iteration_min0.2806777126286846
deviation-center-line_max2.035771055713226
deviation-center-line_mean1.7393974732821602
deviation-center-line_min1.4198035576808063
deviation-heading_max8.661652869870704
deviation-heading_mean7.218156710246457
deviation-heading_median7.172163760689601
deviation-heading_min6.297861139710899
driven_any_max18.918637713701024
driven_any_mean18.245875913687648
driven_any_median18.465354657951497
driven_any_min16.82594429291233
driven_lanedir_consec_max18.76483323537949
driven_lanedir_consec_mean18.046744551632298
driven_lanedir_consec_min16.559904105180692
driven_lanedir_max18.76483323537949
driven_lanedir_mean18.046744551632298
driven_lanedir_median18.263527605975028
driven_lanedir_min16.559904105180692
get_duckie_state_max1.7669973127252355e-06
get_duckie_state_mean1.5527694137680328e-06
get_duckie_state_median1.4779569703673049e-06
get_duckie_state_min1.4446061616336972e-06
get_robot_state_max0.013379171825666211
get_robot_state_mean0.012022634543433289
get_robot_state_median0.01289249518630308
get_robot_state_min0.006312195010030399
get_state_dump_max0.00860755251011781
get_state_dump_mean0.007952487382222912
get_state_dump_median0.008271558993464207
get_state_dump_min0.005435369294648563
get_ui_image_max0.04035660031435392
get_ui_image_mean0.036113418579328434
get_ui_image_median0.03906590753947567
get_ui_image_min0.02491243455332582
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 18.918637713701024, "get_ui_image": 0.034518239897157035, "step_physics": 0.4161388262622462, "survival_time": 59.99999999999873, "driven_lanedir": 18.76483323537949, "get_state_dump": 0.008236909686873893, "get_robot_state": 0.012651456385032026, "sim_render-ego0": 0.0033852067418539155, "sim_render-ego1": 0.003307495585686956, "sim_render-ego2": 0.003279486067785411, "sim_render-ego3": 0.0032853165038122323, "get_duckie_state": 1.4779569703673049e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.3872866305496245, "agent_compute-ego0": 0.021327468179643996, "agent_compute-ego1": 0.02145414467556689, "agent_compute-ego2": 0.020528839589356383, "agent_compute-ego3": 0.021120481943706984, "complete-iteration": 0.6086849824872045, "set_robot_commands": 0.0017615309563604224, "deviation-center-line": 1.9178017684200697, "driven_lanedir_consec": 18.76483323537949, "sim_compute_sim_state": 0.025623170859013663, "sim_compute_performance-ego0": 0.0016980159292610162, "sim_compute_performance-ego1": 0.0016087483208344245, "sim_compute_performance-ego2": 0.0016060250684879504, "sim_compute_performance-ego3": 0.0015942569974062345}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 18.33989120164345, "get_ui_image": 0.034518239897157035, "step_physics": 0.4161388262622462, "survival_time": 59.99999999999873, "driven_lanedir": 18.13725120808394, "get_state_dump": 0.008236909686873893, "get_robot_state": 0.012651456385032026, "sim_render-ego0": 0.0033852067418539155, "sim_render-ego1": 0.003307495585686956, "sim_render-ego2": 0.003279486067785411, "sim_render-ego3": 0.0032853165038122323, "get_duckie_state": 1.4779569703673049e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.494869598444708, "agent_compute-ego0": 0.021327468179643996, "agent_compute-ego1": 0.02145414467556689, "agent_compute-ego2": 0.020528839589356383, "agent_compute-ego3": 0.021120481943706984, "complete-iteration": 0.6086849824872045, "set_robot_commands": 0.0017615309563604224, "deviation-center-line": 2.035771055713226, "driven_lanedir_consec": 18.13725120808394, "sim_compute_sim_state": 0.025623170859013663, "sim_compute_performance-ego0": 0.0016980159292610162, "sim_compute_performance-ego1": 0.0016087483208344245, "sim_compute_performance-ego2": 0.0016060250684879504, "sim_compute_performance-ego3": 0.0015942569974062345}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 17.55512819539646, "get_ui_image": 0.034518239897157035, "step_physics": 0.4161388262622462, "survival_time": 59.99999999999873, "driven_lanedir": 17.32523393554079, "get_state_dump": 0.008236909686873893, "get_robot_state": 0.012651456385032026, "sim_render-ego0": 0.0033852067418539155, "sim_render-ego1": 0.003307495585686956, "sim_render-ego2": 0.003279486067785411, "sim_render-ego3": 0.0032853165038122323, "get_duckie_state": 1.4779569703673049e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.90393421620321, "agent_compute-ego0": 0.021327468179643996, "agent_compute-ego1": 0.02145414467556689, "agent_compute-ego2": 0.020528839589356383, "agent_compute-ego3": 0.021120481943706984, "complete-iteration": 0.6086849824872045, "set_robot_commands": 0.0017615309563604224, "deviation-center-line": 1.8538291969380425, "driven_lanedir_consec": 17.32523393554079, "sim_compute_sim_state": 0.025623170859013663, "sim_compute_performance-ego0": 0.0016980159292610162, "sim_compute_performance-ego1": 0.0016087483208344245, "sim_compute_performance-ego2": 0.0016060250684879504, "sim_compute_performance-ego3": 0.0015942569974062345}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 18.695478625419952, "get_ui_image": 0.034518239897157035, "step_physics": 0.4161388262622462, "survival_time": 59.99999999999873, "driven_lanedir": 18.517719257449667, "get_state_dump": 0.008236909686873893, "get_robot_state": 0.012651456385032026, "sim_render-ego0": 0.0033852067418539155, "sim_render-ego1": 0.003307495585686956, "sim_render-ego2": 0.003279486067785411, "sim_render-ego3": 0.0032853165038122323, "get_duckie_state": 1.4779569703673049e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.906546663442704, "agent_compute-ego0": 0.021327468179643996, "agent_compute-ego1": 0.02145414467556689, "agent_compute-ego2": 0.020528839589356383, "agent_compute-ego3": 0.021120481943706984, "complete-iteration": 0.6086849824872045, "set_robot_commands": 0.0017615309563604224, "deviation-center-line": 2.0059501666148876, "driven_lanedir_consec": 18.517719257449667, "sim_compute_sim_state": 0.025623170859013663, "sim_compute_performance-ego0": 0.0016980159292610162, "sim_compute_performance-ego1": 0.0016087483208344245, "sim_compute_performance-ego2": 0.0016060250684879504, "sim_compute_performance-ego3": 0.0015942569974062345}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 18.61119936538192, "get_ui_image": 0.04035660031435392, "step_physics": 0.5418582393366729, "survival_time": 59.99999999999873, "driven_lanedir": 18.445368963043677, "get_state_dump": 0.008271558993464207, "get_robot_state": 0.01289249518630308, "sim_render-ego0": 0.003456737675535788, "sim_render-ego1": 0.0034222543289222683, "sim_render-ego2": 0.003420629072546661, "sim_render-ego3": 0.0033593316757113212, "get_duckie_state": 1.467435584278726e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.297861139710899, "agent_compute-ego0": 0.021727829352703617, "agent_compute-ego1": 0.021933209389870013, "agent_compute-ego2": 0.021363627205879664, "agent_compute-ego3": 0.021374209536600863, "complete-iteration": 0.758613426421306, "set_robot_commands": 0.001837983318014407, "deviation-center-line": 1.4198035576808063, "driven_lanedir_consec": 18.445368963043677, "sim_compute_sim_state": 0.04085893456286733, "sim_compute_performance-ego0": 0.0017929498003881044, "sim_compute_performance-ego1": 0.001679188206630583, "sim_compute_performance-ego2": 0.0016665145022783747, "sim_compute_performance-ego3": 0.001656109248470208}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 18.22565058823786, "get_ui_image": 0.04035660031435392, "step_physics": 0.5418582393366729, "survival_time": 59.99999999999873, "driven_lanedir": 18.025177687046476, "get_state_dump": 0.008271558993464207, "get_robot_state": 0.01289249518630308, "sim_render-ego0": 0.003456737675535788, "sim_render-ego1": 0.0034222543289222683, "sim_render-ego2": 0.003420629072546661, "sim_render-ego3": 0.0033593316757113212, "get_duckie_state": 1.467435584278726e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.224629881120424, "agent_compute-ego0": 0.021727829352703617, "agent_compute-ego1": 0.021933209389870013, "agent_compute-ego2": 0.021363627205879664, "agent_compute-ego3": 0.021374209536600863, "complete-iteration": 0.758613426421306, "set_robot_commands": 0.001837983318014407, "deviation-center-line": 1.4388217729641404, "driven_lanedir_consec": 18.025177687046476, "sim_compute_sim_state": 0.04085893456286733, "sim_compute_performance-ego0": 0.0017929498003881044, "sim_compute_performance-ego1": 0.001679188206630583, "sim_compute_performance-ego2": 0.0016665145022783747, "sim_compute_performance-ego3": 0.001656109248470208}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 18.54117918382452, "get_ui_image": 0.04035660031435392, "step_physics": 0.5418582393366729, "survival_time": 59.99999999999873, "driven_lanedir": 18.354134794297444, "get_state_dump": 0.008271558993464207, "get_robot_state": 0.01289249518630308, "sim_render-ego0": 0.003456737675535788, "sim_render-ego1": 0.0034222543289222683, "sim_render-ego2": 0.003420629072546661, "sim_render-ego3": 0.0033593316757113212, "get_duckie_state": 1.467435584278726e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.7430818042393765, "agent_compute-ego0": 0.021727829352703617, "agent_compute-ego1": 0.021933209389870013, "agent_compute-ego2": 0.021363627205879664, "agent_compute-ego3": 0.021374209536600863, "complete-iteration": 0.758613426421306, "set_robot_commands": 0.001837983318014407, "deviation-center-line": 1.578470680782826, "driven_lanedir_consec": 18.354134794297444, "sim_compute_sim_state": 0.04085893456286733, "sim_compute_performance-ego0": 0.0017929498003881044, "sim_compute_performance-ego1": 0.001679188206630583, "sim_compute_performance-ego2": 0.0016665145022783747, "sim_compute_performance-ego3": 0.001656109248470208}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 18.10393927966752, "get_ui_image": 0.04035660031435392, "step_physics": 0.5418582393366729, "survival_time": 59.99999999999873, "driven_lanedir": 17.91746565760712, "get_state_dump": 0.008271558993464207, "get_robot_state": 0.01289249518630308, "sim_render-ego0": 0.003456737675535788, "sim_render-ego1": 0.0034222543289222683, "sim_render-ego2": 0.003420629072546661, "sim_render-ego3": 0.0033593316757113212, "get_duckie_state": 1.467435584278726e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.651451700783958, "agent_compute-ego0": 0.021727829352703617, "agent_compute-ego1": 0.021933209389870013, "agent_compute-ego2": 0.021363627205879664, "agent_compute-ego3": 0.021374209536600863, "complete-iteration": 0.758613426421306, "set_robot_commands": 0.001837983318014407, "deviation-center-line": 1.4706160748710213, "driven_lanedir_consec": 17.91746565760712, "sim_compute_sim_state": 0.04085893456286733, "sim_compute_performance-ego0": 0.0017929498003881044, "sim_compute_performance-ego1": 0.001679188206630583, "sim_compute_performance-ego2": 0.0016665145022783747, "sim_compute_performance-ego3": 0.001656109248470208}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 18.483241874148145, "get_ui_image": 0.03906590753947567, "step_physics": 0.5130785067412974, "survival_time": 59.99999999999873, "driven_lanedir": 18.306941075840413, "get_state_dump": 0.00860755251011781, "get_robot_state": 0.013379171825666211, "sim_render-ego0": 0.003502198599657349, "sim_render-ego1": 0.003432169246435364, "sim_render-ego2": 0.003386719439250047, "sim_render-ego3": 0.003406748585061765, "get_duckie_state": 1.7669973127252355e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.922273039188776, "agent_compute-ego0": 0.022159656021219803, "agent_compute-ego1": 0.022016812919280013, "agent_compute-ego2": 0.022209389620676923, "agent_compute-ego3": 0.02230256145740925, "complete-iteration": 0.728288834934727, "set_robot_commands": 0.001981147421488258, "deviation-center-line": 1.8582873698148203, "driven_lanedir_consec": 18.306941075840413, "sim_compute_sim_state": 0.037091192655221907, "sim_compute_performance-ego0": 0.0017935963693407552, "sim_compute_performance-ego1": 0.001671523476123413, "sim_compute_performance-ego2": 0.001666589740114744, "sim_compute_performance-ego3": 0.0016715435263119967}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 18.44746744175485, "get_ui_image": 0.03906590753947567, "step_physics": 0.5130785067412974, "survival_time": 59.99999999999873, "driven_lanedir": 18.240402755497986, "get_state_dump": 0.00860755251011781, "get_robot_state": 0.013379171825666211, "sim_render-ego0": 0.003502198599657349, "sim_render-ego1": 0.003432169246435364, "sim_render-ego2": 0.003386719439250047, "sim_render-ego3": 0.003406748585061765, "get_duckie_state": 1.7669973127252355e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.307349732779555, "agent_compute-ego0": 0.022159656021219803, "agent_compute-ego1": 0.022016812919280013, "agent_compute-ego2": 0.022209389620676923, "agent_compute-ego3": 0.02230256145740925, "complete-iteration": 0.728288834934727, "set_robot_commands": 0.001981147421488258, "deviation-center-line": 1.7093428540591562, "driven_lanedir_consec": 18.240402755497986, "sim_compute_sim_state": 0.037091192655221907, "sim_compute_performance-ego0": 0.0017935963693407552, "sim_compute_performance-ego1": 0.001671523476123413, "sim_compute_performance-ego2": 0.001666589740114744, "sim_compute_performance-ego3": 0.0016715435263119967}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 17.6169607439688, "get_ui_image": 0.03906590753947567, "step_physics": 0.5130785067412974, "survival_time": 59.99999999999873, "driven_lanedir": 17.37165957060174, "get_state_dump": 0.00860755251011781, "get_robot_state": 0.013379171825666211, "sim_render-ego0": 0.003502198599657349, "sim_render-ego1": 0.003432169246435364, "sim_render-ego2": 0.003386719439250047, "sim_render-ego3": 0.003406748585061765, "get_duckie_state": 1.7669973127252355e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.966142094972873, "agent_compute-ego0": 0.022159656021219803, "agent_compute-ego1": 0.022016812919280013, "agent_compute-ego2": 0.022209389620676923, "agent_compute-ego3": 0.02230256145740925, "complete-iteration": 0.728288834934727, "set_robot_commands": 0.001981147421488258, "deviation-center-line": 1.778361168779096, "driven_lanedir_consec": 17.37165957060174, "sim_compute_sim_state": 0.037091192655221907, "sim_compute_performance-ego0": 0.0017935963693407552, "sim_compute_performance-ego1": 0.001671523476123413, "sim_compute_performance-ego2": 0.001666589740114744, "sim_compute_performance-ego3": 0.0016715435263119967}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 18.59226853771845, "get_ui_image": 0.03906590753947567, "step_physics": 0.5130785067412974, "survival_time": 59.99999999999873, "driven_lanedir": 18.40167902083062, "get_state_dump": 0.00860755251011781, "get_robot_state": 0.013379171825666211, "sim_render-ego0": 0.003502198599657349, "sim_render-ego1": 0.003432169246435364, "sim_render-ego2": 0.003386719439250047, "sim_render-ego3": 0.003406748585061765, "get_duckie_state": 1.7669973127252355e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.119697640258778, "agent_compute-ego0": 0.022159656021219803, "agent_compute-ego1": 0.022016812919280013, "agent_compute-ego2": 0.022209389620676923, "agent_compute-ego3": 0.02230256145740925, "complete-iteration": 0.728288834934727, "set_robot_commands": 0.001981147421488258, "deviation-center-line": 1.765328066516404, "driven_lanedir_consec": 18.40167902083062, "sim_compute_sim_state": 0.037091192655221907, "sim_compute_performance-ego0": 0.0017935963693407552, "sim_compute_performance-ego1": 0.001671523476123413, "sim_compute_performance-ego2": 0.001666589740114744, "sim_compute_performance-ego3": 0.0016715435263119967}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 18.48527574785177, "get_ui_image": 0.02491243455332582, "step_physics": 0.17954729419266752, "survival_time": 59.99999999999873, "driven_lanedir": 18.28665245645207, "get_state_dump": 0.005435369294648563, "get_robot_state": 0.006312195010030399, "sim_render-ego0": 0.0033511887184289177, "sim_render-ego1": 0.00326285294747968, "get_duckie_state": 1.4446061616336972e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.467416931884807, "agent_compute-ego0": 0.021142449208242903, "agent_compute-ego1": 0.02095789178821268, "complete-iteration": 0.2806777126286846, "set_robot_commands": 0.0017959795625481776, "deviation-center-line": 1.9471354957707296, "driven_lanedir_consec": 18.28665245645207, "sim_compute_sim_state": 0.008804053291492319, "sim_compute_performance-ego0": 0.001649501023939706, "sim_compute_performance-ego1": 0.001605114273782773}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 16.82594429291233, "get_ui_image": 0.02491243455332582, "step_physics": 0.17954729419266752, "survival_time": 59.99999999999873, "driven_lanedir": 16.559904105180692, "get_state_dump": 0.005435369294648563, "get_robot_state": 0.006312195010030399, "sim_render-ego0": 0.0033511887184289177, "sim_render-ego1": 0.00326285294747968, "get_duckie_state": 1.4446061616336972e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.661652869870704, "agent_compute-ego0": 0.021142449208242903, "agent_compute-ego1": 0.02095789178821268, "complete-iteration": 0.2806777126286846, "set_robot_commands": 0.0017959795625481776, "deviation-center-line": 1.5720453970250152, "driven_lanedir_consec": 16.559904105180692, "sim_compute_sim_state": 0.008804053291492319, "sim_compute_performance-ego0": 0.001649501023939706, "sim_compute_performance-ego1": 0.001605114273782773}}
set_robot_commands_max0.001981147421488258
set_robot_commands_mean0.0018510432791820504
set_robot_commands_median0.001837983318014407
set_robot_commands_min0.0017615309563604224
sim_compute_performance-ego0_max0.0017935963693407552
sim_compute_performance-ego0_mean0.0017455178888456369
sim_compute_performance-ego0_median0.0017929498003881044
sim_compute_performance-ego0_min0.001649501023939706
sim_compute_performance-ego1_max0.001679188206630583
sim_compute_performance-ego1_mean0.0016462906115656591
sim_compute_performance-ego1_median0.001671523476123413
sim_compute_performance-ego1_min0.001605114273782773
sim_compute_sim_state_max0.04085893456286733
sim_compute_sim_state_mean0.03085009277795687
sim_compute_sim_state_median0.037091192655221907
sim_compute_sim_state_min0.008804053291492319
sim_render-ego0_max0.003502198599657349
sim_render-ego0_mean0.00343421067893186
sim_render-ego0_median0.003456737675535788
sim_render-ego0_min0.0033511887184289177
sim_render-ego1_max0.003432169246435364
sim_render-ego1_mean0.003369527324224123
sim_render-ego1_median0.0034222543289222683
sim_render-ego1_min0.00326285294747968
simulation-passed1
step_physics_max0.5418582393366729
step_physics_mean0.4459569198390144
step_physics_median0.5130785067412974
step_physics_min0.17954729419266752
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible