Duckietown Challenges Home Challenges Submissions

Job 34513

Job ID34513
submission6753
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI_multi-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg02-fc66b3f1b8bf-1
date started
date completed
duration0:05:32
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.44045417152359634
survival_time_median1.3750000000000004
deviation-center-line_median0.04026399165065908
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.12441963619656032
agent_compute-ego0_mean0.11919682697644308
agent_compute-ego0_median0.1191968269764431
agent_compute-ego0_min0.11397401775632586
agent_compute-ego1_max0.1236593105174877
agent_compute-ego1_mean0.11915592100254442
agent_compute-ego1_median0.11915592100254442
agent_compute-ego1_min0.11465253148760114
agent_compute-ego2_max0.12350576012222857
agent_compute-ego2_mean0.1178064035675513
agent_compute-ego2_median0.11780640356755132
agent_compute-ego2_min0.11210704701287406
complete-iteration_max1.4264791718235723
complete-iteration_mean1.4260016820102772
complete-iteration_median1.4260016820102774
complete-iteration_min1.4255241921969823
deviation-center-line_max0.10890667756490068
deviation-center-line_mean0.05312722895053121
deviation-center-line_min0.024590560019080956
deviation-heading_max0.3096668174342516
deviation-heading_mean0.17119999610120462
deviation-heading_median0.15053507339589076
deviation-heading_min0.09551200458847002
driven_any_max0.4600961679938569
driven_any_mean0.4356302626647599
driven_any_median0.4439458997860367
driven_any_min0.3891890136670606
driven_lanedir_consec_max0.4573624868396155
driven_lanedir_consec_mean0.4308734074490386
driven_lanedir_consec_min0.3753784656727648
driven_lanedir_max0.4573624868396155
driven_lanedir_mean0.4308734074490386
driven_lanedir_median0.44045417152359634
driven_lanedir_min0.3753784656727648
get_state_dump_max0.04947478682906539
get_state_dump_mean0.04875591949180321
get_state_dump_median0.0487559194918032
get_state_dump_min0.048037052154541016
get_ui_image_max0.1131636415209089
get_ui_image_mean0.1097618883879727
get_ui_image_median0.10976188838797273
get_ui_image_min0.10636013525503651
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego0": {"driven_any": 0.3891890136670606, "get_ui_image": 0.10636013525503651, "step_physics": 0.6961916552649604, "survival_time": 1.3500000000000003, "driven_lanedir": 0.3753784656727648, "get_state_dump": 0.04947478682906539, "sim_render-ego0": 0.007203790876600478, "sim_render-ego1": 0.007137439869068287, "sim_render-ego2": 0.00743085366708261, "in-drivable-lane": 0.0, "deviation-heading": 0.3096668174342516, "agent_compute-ego0": 0.12441963619656032, "agent_compute-ego1": 0.1236593105174877, "agent_compute-ego2": 0.12350576012222857, "complete-iteration": 1.4264791718235723, "set_robot_commands": 0.0063838958740234375, "deviation-center-line": 0.10890667756490068, "driven_lanedir_consec": 0.3753784656727648, "sim_compute_sim_state": 0.0501252810160319, "sim_compute_performance-ego0": 0.00612489382425944, "sim_compute_performance-ego1": 0.005744183505022967, "sim_compute_performance-ego2": 0.006280245604338469, "sim_compute_robot_state-ego0": 0.009589053966380932, "sim_compute_robot_state-ego1": 0.010317263779816803, "sim_compute_robot_state-ego2": 0.01034608593693486, "sim_compute_robot_state-parked0": 0.010402282079060871, "sim_compute_robot_state-parked1": 0.010519177825362594, "sim_compute_robot_state-parked2": 0.010312415935375073, "sim_compute_robot_state-parked3": 0.010599648510968245, "sim_compute_robot_state-parked4": 0.0105575543862802, "sim_compute_robot_state-parked5": 0.010815964804755315}, "udem1-0-0-ego1": {"driven_any": 0.4494585435466496, "get_ui_image": 0.10636013525503651, "step_physics": 0.6961916552649604, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4445933000275337, "get_state_dump": 0.04947478682906539, "sim_render-ego0": 0.007203790876600478, "sim_render-ego1": 0.007137439869068287, "sim_render-ego2": 0.00743085366708261, "in-drivable-lane": 0.0, "deviation-heading": 0.1446809846187341, "agent_compute-ego0": 0.12441963619656032, "agent_compute-ego1": 0.1236593105174877, "agent_compute-ego2": 0.12350576012222857, "complete-iteration": 1.4264791718235723, "set_robot_commands": 0.0063838958740234375, "deviation-center-line": 0.043700429242647824, "driven_lanedir_consec": 0.4445933000275337, "sim_compute_sim_state": 0.0501252810160319, "sim_compute_performance-ego0": 0.00612489382425944, "sim_compute_performance-ego1": 0.005744183505022967, "sim_compute_performance-ego2": 0.006280245604338469, "sim_compute_robot_state-ego0": 0.009589053966380932, "sim_compute_robot_state-ego1": 0.010317263779816803, "sim_compute_robot_state-ego2": 0.01034608593693486, "sim_compute_robot_state-parked0": 0.010402282079060871, "sim_compute_robot_state-parked1": 0.010519177825362594, "sim_compute_robot_state-parked2": 0.010312415935375073, "sim_compute_robot_state-parked3": 0.010599648510968245, "sim_compute_robot_state-parked4": 0.0105575543862802, "sim_compute_robot_state-parked5": 0.010815964804755315}, "udem1-0-0-ego2": {"driven_any": 0.4271460512089191, "get_ui_image": 0.10636013525503651, "step_physics": 0.6961916552649604, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4253090384564016, "get_state_dump": 0.04947478682906539, "sim_render-ego0": 0.007203790876600478, "sim_render-ego1": 0.007137439869068287, "sim_render-ego2": 0.00743085366708261, "in-drivable-lane": 0.0, "deviation-heading": 0.1563891621730474, "agent_compute-ego0": 0.12441963619656032, "agent_compute-ego1": 0.1236593105174877, "agent_compute-ego2": 0.12350576012222857, "complete-iteration": 1.4264791718235723, "set_robot_commands": 0.0063838958740234375, "deviation-center-line": 0.03307355491369409, "driven_lanedir_consec": 0.4253090384564016, "sim_compute_sim_state": 0.0501252810160319, "sim_compute_performance-ego0": 0.00612489382425944, "sim_compute_performance-ego1": 0.005744183505022967, "sim_compute_performance-ego2": 0.006280245604338469, "sim_compute_robot_state-ego0": 0.009589053966380932, "sim_compute_robot_state-ego1": 0.010317263779816803, "sim_compute_robot_state-ego2": 0.01034608593693486, "sim_compute_robot_state-parked0": 0.010402282079060871, "sim_compute_robot_state-parked1": 0.010519177825362594, "sim_compute_robot_state-parked2": 0.010312415935375073, "sim_compute_robot_state-parked3": 0.010599648510968245, "sim_compute_robot_state-parked4": 0.0105575543862802, "sim_compute_robot_state-parked5": 0.010815964804755315}, "udem1-0-1-ego0": {"driven_any": 0.4600961679938569, "get_ui_image": 0.1131636415209089, "step_physics": 0.7186047860554287, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4573624868396155, "get_state_dump": 0.048037052154541016, "sim_render-ego0": 0.00708646433694022, "sim_render-ego1": 0.007526602063860212, "sim_render-ego2": 0.006903810160500663, "in-drivable-lane": 0.0, "deviation-heading": 0.13554557468818512, "agent_compute-ego0": 0.11397401775632586, "agent_compute-ego1": 0.11465253148760114, "agent_compute-ego2": 0.11210704701287406, "complete-iteration": 1.4255241921969823, "set_robot_commands": 0.006316193512507847, "deviation-center-line": 0.07166459790419333, "driven_lanedir_consec": 0.4573624868396155, "sim_compute_sim_state": 0.05587977170944214, "sim_compute_performance-ego0": 0.006031657968248639, "sim_compute_performance-ego1": 0.00538433449608939, "sim_compute_performance-ego2": 0.005537986755371094, "sim_compute_robot_state-ego0": 0.010077246597834997, "sim_compute_robot_state-ego1": 0.009800706590924944, "sim_compute_robot_state-ego2": 0.01025139433997018, "sim_compute_robot_state-parked0": 0.010464114802224296, "sim_compute_robot_state-parked1": 0.010423379284994944, "sim_compute_robot_state-parked2": 0.010454399245125909, "sim_compute_robot_state-parked3": 0.009846551077706472, "sim_compute_robot_state-parked4": 0.01014190912246704, "sim_compute_robot_state-parked5": 0.009852784020560128}, "udem1-0-1-ego1": {"driven_any": 0.44858085721808755, "get_ui_image": 0.1131636415209089, "step_physics": 0.7186047860554287, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4462821106782573, "get_state_dump": 0.048037052154541016, "sim_render-ego0": 0.00708646433694022, "sim_render-ego1": 0.007526602063860212, "sim_render-ego2": 0.006903810160500663, "in-drivable-lane": 0.0, "deviation-heading": 0.09551200458847002, "agent_compute-ego0": 0.11397401775632586, "agent_compute-ego1": 0.11465253148760114, "agent_compute-ego2": 0.11210704701287406, "complete-iteration": 1.4255241921969823, "set_robot_commands": 0.006316193512507847, "deviation-center-line": 0.03682755405867034, "driven_lanedir_consec": 0.4462821106782573, "sim_compute_sim_state": 0.05587977170944214, "sim_compute_performance-ego0": 0.006031657968248639, "sim_compute_performance-ego1": 0.00538433449608939, "sim_compute_performance-ego2": 0.005537986755371094, "sim_compute_robot_state-ego0": 0.010077246597834997, "sim_compute_robot_state-ego1": 0.009800706590924944, "sim_compute_robot_state-ego2": 0.01025139433997018, "sim_compute_robot_state-parked0": 0.010464114802224296, "sim_compute_robot_state-parked1": 0.010423379284994944, "sim_compute_robot_state-parked2": 0.010454399245125909, "sim_compute_robot_state-parked3": 0.009846551077706472, "sim_compute_robot_state-parked4": 0.01014190912246704, "sim_compute_robot_state-parked5": 0.009852784020560128}, "udem1-0-1-ego2": {"driven_any": 0.43931094235398593, "get_ui_image": 0.1131636415209089, "step_physics": 0.7186047860554287, "survival_time": 1.4000000000000006, "driven_lanedir": 0.43631504301965895, "get_state_dump": 0.048037052154541016, "sim_render-ego0": 0.00708646433694022, "sim_render-ego1": 0.007526602063860212, "sim_render-ego2": 0.006903810160500663, "in-drivable-lane": 0.0, "deviation-heading": 0.18540543310453952, "agent_compute-ego0": 0.11397401775632586, "agent_compute-ego1": 0.11465253148760114, "agent_compute-ego2": 0.11210704701287406, "complete-iteration": 1.4255241921969823, "set_robot_commands": 0.006316193512507847, "deviation-center-line": 0.024590560019080956, "driven_lanedir_consec": 0.43631504301965895, "sim_compute_sim_state": 0.05587977170944214, "sim_compute_performance-ego0": 0.006031657968248639, "sim_compute_performance-ego1": 0.00538433449608939, "sim_compute_performance-ego2": 0.005537986755371094, "sim_compute_robot_state-ego0": 0.010077246597834997, "sim_compute_robot_state-ego1": 0.009800706590924944, "sim_compute_robot_state-ego2": 0.01025139433997018, "sim_compute_robot_state-parked0": 0.010464114802224296, "sim_compute_robot_state-parked1": 0.010423379284994944, "sim_compute_robot_state-parked2": 0.010454399245125909, "sim_compute_robot_state-parked3": 0.009846551077706472, "sim_compute_robot_state-parked4": 0.01014190912246704, "sim_compute_robot_state-parked5": 0.009852784020560128}}
set_robot_commands_max0.0063838958740234375
set_robot_commands_mean0.006350044693265642
set_robot_commands_median0.006350044693265642
set_robot_commands_min0.006316193512507847
sim_compute_performance-ego0_max0.00612489382425944
sim_compute_performance-ego0_mean0.00607827589625404
sim_compute_performance-ego0_median0.00607827589625404
sim_compute_performance-ego0_min0.006031657968248639
sim_compute_performance-ego1_max0.005744183505022967
sim_compute_performance-ego1_mean0.005564259000556179
sim_compute_performance-ego1_median0.005564259000556179
sim_compute_performance-ego1_min0.00538433449608939
sim_compute_performance-ego2_max0.006280245604338469
sim_compute_performance-ego2_mean0.005909116179854782
sim_compute_performance-ego2_median0.005909116179854781
sim_compute_performance-ego2_min0.005537986755371094
sim_compute_robot_state-ego0_max0.010077246597834997
sim_compute_robot_state-ego0_mean0.009833150282107964
sim_compute_robot_state-ego0_median0.009833150282107964
sim_compute_robot_state-ego0_min0.009589053966380932
sim_compute_robot_state-ego1_max0.010317263779816803
sim_compute_robot_state-ego1_mean0.010058985185370873
sim_compute_robot_state-ego1_median0.010058985185370874
sim_compute_robot_state-ego1_min0.009800706590924944
sim_compute_robot_state-ego2_max0.01034608593693486
sim_compute_robot_state-ego2_mean0.01029874013845252
sim_compute_robot_state-ego2_median0.01029874013845252
sim_compute_robot_state-ego2_min0.01025139433997018
sim_compute_robot_state-parked0_max0.010464114802224296
sim_compute_robot_state-parked0_mean0.010433198440642584
sim_compute_robot_state-parked0_median0.010433198440642584
sim_compute_robot_state-parked0_min0.010402282079060871
sim_compute_robot_state-parked1_max0.010519177825362594
sim_compute_robot_state-parked1_mean0.010471278555178766
sim_compute_robot_state-parked1_median0.010471278555178768
sim_compute_robot_state-parked1_min0.010423379284994944
sim_compute_robot_state-parked2_max0.010454399245125909
sim_compute_robot_state-parked2_mean0.01038340759025049
sim_compute_robot_state-parked2_median0.01038340759025049
sim_compute_robot_state-parked2_min0.010312415935375073
sim_compute_robot_state-parked3_max0.010599648510968245
sim_compute_robot_state-parked3_mean0.01022309979433736
sim_compute_robot_state-parked3_median0.01022309979433736
sim_compute_robot_state-parked3_min0.009846551077706472
sim_compute_robot_state-parked4_max0.0105575543862802
sim_compute_robot_state-parked4_mean0.010349731754373622
sim_compute_robot_state-parked4_median0.01034973175437362
sim_compute_robot_state-parked4_min0.01014190912246704
sim_compute_robot_state-parked5_max0.010815964804755315
sim_compute_robot_state-parked5_mean0.010334374412657724
sim_compute_robot_state-parked5_median0.010334374412657724
sim_compute_robot_state-parked5_min0.009852784020560128
sim_compute_sim_state_max0.05587977170944214
sim_compute_sim_state_mean0.05300252636273702
sim_compute_sim_state_median0.053002526362737015
sim_compute_sim_state_min0.0501252810160319
sim_render-ego0_max0.007203790876600478
sim_render-ego0_mean0.0071451276067703495
sim_render-ego0_median0.007145127606770349
sim_render-ego0_min0.00708646433694022
sim_render-ego1_max0.007526602063860212
sim_render-ego1_mean0.00733202096646425
sim_render-ego1_median0.007332020966464249
sim_render-ego1_min0.007137439869068287
sim_render-ego2_max0.00743085366708261
sim_render-ego2_mean0.007167331913791638
sim_render-ego2_median0.007167331913791637
sim_render-ego2_min0.006903810160500663
simulation-passed1
step_physics_max0.7186047860554287
step_physics_mean0.7073982206601945
step_physics_median0.7073982206601945
step_physics_min0.6961916552649604
survival_time_max1.4000000000000006
survival_time_mean1.3750000000000009
survival_time_min1.3500000000000003

Highlights

34513

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.