Duckietown Challenges Home Challenges Submissions

Job 33229

Job ID33229
submission6734
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statusaborted
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:11:07
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5199853535369774
survival_time_median3.7499999999999942
deviation-center-line_median0.2459983741413155
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.11400545835494996
agent_compute-ego0_mean0.11300247430801393
agent_compute-ego0_median0.11333741823832194
agent_compute-ego0_min0.11166454633076986
agent_compute-ego1_max0.11273708661397298
agent_compute-ego1_mean0.1125532340341144
agent_compute-ego1_median0.11268363296985626
agent_compute-ego1_min0.112238982518514
agent_compute-ego2_max0.1120794177055359
agent_compute-ego2_mean0.1094360481368171
agent_compute-ego2_median0.1092786947886149
agent_compute-ego2_min0.10695003191630044
complete-iteration_max1.1979965686798095
complete-iteration_mean1.1922116296158896
complete-iteration_median1.197956582903862
complete-iteration_min1.1806817372639975
deviation-center-line_max0.26256359680920854
deviation-center-line_mean0.19959940732081485
deviation-center-line_min0.09874774981680254
deviation-heading_max0.6316027400222535
deviation-heading_mean0.4414542768297582
deviation-heading_median0.41898492889241457
deviation-heading_min0.220158764018187
driven_any_max1.7019931409932727
driven_any_mean1.5753272637756552
driven_any_median1.535608360914374
driven_any_min1.4878558769275383
driven_lanedir_consec_max1.6768313872581142
driven_lanedir_consec_mean1.5607384911358355
driven_lanedir_consec_min1.46259450538951
driven_lanedir_max1.6768313872581142
driven_lanedir_mean1.5607384911358355
driven_lanedir_median1.5199853535369774
driven_lanedir_min1.46259450538951
get_state_dump_max0.05043633460998535
get_state_dump_mean0.050141657392183944
get_state_dump_median0.0502743911743164
get_state_dump_min0.04971424639225006
get_ui_image_max0.12774132192134857
get_ui_image_mean0.12587817649046582
get_ui_image_median0.12585133870442708
get_ui_image_min0.12404186884562174
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego0": {"driven_any": 1.535608360914374, "get_ui_image": 0.12774132192134857, "step_physics": 0.4435828894376755, "survival_time": 3.999999999999994, "driven_lanedir": 1.5199853535369774, "get_state_dump": 0.04971424639225006, "sim_render-ego0": 0.007612732052803039, "sim_render-ego1": 0.007530447840690613, "sim_render-ego2": 0.007270556688308716, "in-drivable-lane": 0.0, "deviation-heading": 0.5437285585279455, "agent_compute-ego0": 0.11400545835494996, "agent_compute-ego1": 0.11268363296985626, "agent_compute-ego2": 0.1120794177055359, "complete-iteration": 1.197956582903862, "set_robot_commands": 0.006696772575378418, "deviation-center-line": 0.2496272588256704, "driven_lanedir_consec": 1.5199853535369774, "sim_compute_sim_state": 0.08233795166015626, "sim_compute_performance-ego0": 0.00613621473312378, "sim_compute_performance-ego1": 0.005950480699539185, "sim_compute_performance-ego2": 0.0060484915971755985, "sim_compute_robot_state-ego0": 0.010497942566871645, "sim_compute_robot_state-ego1": 0.010558104515075684, "sim_compute_robot_state-ego2": 0.01068725883960724, "sim_compute_robot_state-parked0": 0.010789170861244202, "sim_compute_robot_state-parked1": 0.010215505957603456, "sim_compute_robot_state-parked2": 0.010220783948898316, "sim_compute_robot_state-parked3": 0.010463151335716249, "sim_compute_robot_state-parked4": 0.010676765441894533, "sim_compute_robot_state-parked5": 0.010372379422187805}, "ETHZ_autolab_technical_track-0-0-ego1": {"driven_any": 1.6279886987071606, "get_ui_image": 0.12774132192134857, "step_physics": 0.4435828894376755, "survival_time": 3.999999999999994, "driven_lanedir": 1.6231120634199394, "get_state_dump": 0.04971424639225006, "sim_render-ego0": 0.007612732052803039, "sim_render-ego1": 0.007530447840690613, "sim_render-ego2": 0.007270556688308716, "in-drivable-lane": 0.0, "deviation-heading": 0.220158764018187, "agent_compute-ego0": 0.11400545835494996, "agent_compute-ego1": 0.11268363296985626, "agent_compute-ego2": 0.1120794177055359, "complete-iteration": 1.197956582903862, "set_robot_commands": 0.006696772575378418, "deviation-center-line": 0.10393118245141884, "driven_lanedir_consec": 1.6231120634199394, "sim_compute_sim_state": 0.08233795166015626, "sim_compute_performance-ego0": 0.00613621473312378, "sim_compute_performance-ego1": 0.005950480699539185, "sim_compute_performance-ego2": 0.0060484915971755985, "sim_compute_robot_state-ego0": 0.010497942566871645, "sim_compute_robot_state-ego1": 0.010558104515075684, "sim_compute_robot_state-ego2": 0.01068725883960724, "sim_compute_robot_state-parked0": 0.010789170861244202, "sim_compute_robot_state-parked1": 0.010215505957603456, "sim_compute_robot_state-parked2": 0.010220783948898316, "sim_compute_robot_state-parked3": 0.010463151335716249, "sim_compute_robot_state-parked4": 0.010676765441894533, "sim_compute_robot_state-parked5": 0.010372379422187805}, "ETHZ_autolab_technical_track-0-0-ego2": {"driven_any": 1.7019931409932727, "get_ui_image": 0.12774132192134857, "step_physics": 0.4435828894376755, "survival_time": 3.999999999999994, "driven_lanedir": 1.6768313872581142, "get_state_dump": 0.04971424639225006, "sim_render-ego0": 0.007612732052803039, "sim_render-ego1": 0.007530447840690613, "sim_render-ego2": 0.007270556688308716, "in-drivable-lane": 0.0, "deviation-heading": 0.6225319523174054, "agent_compute-ego0": 0.11400545835494996, "agent_compute-ego1": 0.11268363296985626, "agent_compute-ego2": 0.1120794177055359, "complete-iteration": 1.197956582903862, "set_robot_commands": 0.006696772575378418, "deviation-center-line": 0.2282167830755907, "driven_lanedir_consec": 1.6768313872581142, "sim_compute_sim_state": 0.08233795166015626, "sim_compute_performance-ego0": 0.00613621473312378, "sim_compute_performance-ego1": 0.005950480699539185, "sim_compute_performance-ego2": 0.0060484915971755985, "sim_compute_robot_state-ego0": 0.010497942566871645, "sim_compute_robot_state-ego1": 0.010558104515075684, "sim_compute_robot_state-ego2": 0.01068725883960724, "sim_compute_robot_state-parked0": 0.010789170861244202, "sim_compute_robot_state-parked1": 0.010215505957603456, "sim_compute_robot_state-parked2": 0.010220783948898316, "sim_compute_robot_state-parked3": 0.010463151335716249, "sim_compute_robot_state-parked4": 0.010676765441894533, "sim_compute_robot_state-parked5": 0.010372379422187805}, "ETHZ_autolab_technical_track-0-1-ego0": {"driven_any": 1.4878558769275383, "get_ui_image": 0.12585133870442708, "step_physics": 0.4362284406026205, "survival_time": 3.7499999999999942, "driven_lanedir": 1.46259450538951, "get_state_dump": 0.05043633460998535, "sim_render-ego0": 0.007288735707600911, "sim_render-ego1": 0.007661129633585612, "sim_render-ego2": 0.007567885716756185, "in-drivable-lane": 0.0, "deviation-heading": 0.6316027400222535, "agent_compute-ego0": 0.11166454633076986, "agent_compute-ego1": 0.112238982518514, "agent_compute-ego2": 0.10695003191630044, "complete-iteration": 1.1806817372639975, "set_robot_commands": 0.0069236691792805985, "deviation-center-line": 0.2459983741413155, "driven_lanedir_consec": 1.46259450538951, "sim_compute_sim_state": 0.07854524612426758, "sim_compute_performance-ego0": 0.006083208719889323, "sim_compute_performance-ego1": 0.005996952056884766, "sim_compute_performance-ego2": 0.006235275268554687, "sim_compute_robot_state-ego0": 0.010709231694539387, "sim_compute_robot_state-ego1": 0.011335182189941406, "sim_compute_robot_state-ego2": 0.010752293268839518, "sim_compute_robot_state-parked0": 0.011173810958862305, "sim_compute_robot_state-parked1": 0.010245157877604166, "sim_compute_robot_state-parked2": 0.010322786966959636, "sim_compute_robot_state-parked3": 0.01056283950805664, "sim_compute_robot_state-parked4": 0.010401550928751628, "sim_compute_robot_state-parked5": 0.010525099436442056}, "ETHZ_autolab_technical_track-0-1-ego1": {"driven_any": 1.5258454441466296, "get_ui_image": 0.12585133870442708, "step_physics": 0.4362284406026205, "survival_time": 3.7499999999999942, "driven_lanedir": 1.519973299888739, "get_state_dump": 0.05043633460998535, "sim_render-ego0": 0.007288735707600911, "sim_render-ego1": 0.007661129633585612, "sim_render-ego2": 0.007567885716756185, "in-drivable-lane": 0.0, "deviation-heading": 0.24274693938747463, "agent_compute-ego0": 0.11166454633076986, "agent_compute-ego1": 0.112238982518514, "agent_compute-ego2": 0.10695003191630044, "complete-iteration": 1.1806817372639975, "set_robot_commands": 0.0069236691792805985, "deviation-center-line": 0.09874774981680254, "driven_lanedir_consec": 1.519973299888739, "sim_compute_sim_state": 0.07854524612426758, "sim_compute_performance-ego0": 0.006083208719889323, "sim_compute_performance-ego1": 0.005996952056884766, "sim_compute_performance-ego2": 0.006235275268554687, "sim_compute_robot_state-ego0": 0.010709231694539387, "sim_compute_robot_state-ego1": 0.011335182189941406, "sim_compute_robot_state-ego2": 0.010752293268839518, "sim_compute_robot_state-parked0": 0.011173810958862305, "sim_compute_robot_state-parked1": 0.010245157877604166, "sim_compute_robot_state-parked2": 0.010322786966959636, "sim_compute_robot_state-parked3": 0.01056283950805664, "sim_compute_robot_state-parked4": 0.010401550928751628, "sim_compute_robot_state-parked5": 0.010525099436442056}, "ETHZ_autolab_technical_track-0-1-ego2": {"driven_any": 1.6424762656088765, "get_ui_image": 0.12585133870442708, "step_physics": 0.4362284406026205, "survival_time": 3.7499999999999942, "driven_lanedir": 1.6307910027254964, "get_state_dump": 0.05043633460998535, "sim_render-ego0": 0.007288735707600911, "sim_render-ego1": 0.007661129633585612, "sim_render-ego2": 0.007567885716756185, "in-drivable-lane": 0.0, "deviation-heading": 0.41898492889241457, "agent_compute-ego0": 0.11166454633076986, "agent_compute-ego1": 0.112238982518514, "agent_compute-ego2": 0.10695003191630044, "complete-iteration": 1.1806817372639975, "set_robot_commands": 0.0069236691792805985, "deviation-center-line": 0.26256359680920854, "driven_lanedir_consec": 1.6307910027254964, "sim_compute_sim_state": 0.07854524612426758, "sim_compute_performance-ego0": 0.006083208719889323, "sim_compute_performance-ego1": 0.005996952056884766, "sim_compute_performance-ego2": 0.006235275268554687, "sim_compute_robot_state-ego0": 0.010709231694539387, "sim_compute_robot_state-ego1": 0.011335182189941406, "sim_compute_robot_state-ego2": 0.010752293268839518, "sim_compute_robot_state-parked0": 0.011173810958862305, "sim_compute_robot_state-parked1": 0.010245157877604166, "sim_compute_robot_state-parked2": 0.010322786966959636, "sim_compute_robot_state-parked3": 0.01056283950805664, "sim_compute_robot_state-parked4": 0.010401550928751628, "sim_compute_robot_state-parked5": 0.010525099436442056}, "ETHZ_autolab_technical_track-0-2-ego0": {"driven_any": 1.4878558769275383, "get_ui_image": 0.12404186884562174, "step_physics": 0.43618412653605143, "survival_time": 3.7499999999999942, "driven_lanedir": 1.46259450538951, "get_state_dump": 0.0502743911743164, "sim_render-ego0": 0.007762155532836914, "sim_render-ego1": 0.00821814219156901, "sim_render-ego2": 0.00803315798441569, "in-drivable-lane": 0.0, "deviation-heading": 0.6316027400222535, "agent_compute-ego0": 0.11333741823832194, "agent_compute-ego1": 0.11273708661397298, "agent_compute-ego2": 0.1092786947886149, "complete-iteration": 1.1979965686798095, "set_robot_commands": 0.007827014923095703, "deviation-center-line": 0.2459983741413155, "driven_lanedir_consec": 1.46259450538951, "sim_compute_sim_state": 0.07848557154337565, "sim_compute_performance-ego0": 0.006429548263549805, "sim_compute_performance-ego1": 0.006717529296875, "sim_compute_performance-ego2": 0.006694202423095703, "sim_compute_robot_state-ego0": 0.012022473017374675, "sim_compute_robot_state-ego1": 0.011771688461303711, "sim_compute_robot_state-ego2": 0.011826534271240237, "sim_compute_robot_state-parked0": 0.011929556528727214, "sim_compute_robot_state-parked1": 0.0119414488474528, "sim_compute_robot_state-parked2": 0.011567951838175456, "sim_compute_robot_state-parked3": 0.011604210535685222, "sim_compute_robot_state-parked4": 0.011592082977294922, "sim_compute_robot_state-parked5": 0.01139454205830892}, "ETHZ_autolab_technical_track-0-2-ego1": {"driven_any": 1.5258454441466296, "get_ui_image": 0.12404186884562174, "step_physics": 0.43618412653605143, "survival_time": 3.7499999999999942, "driven_lanedir": 1.519973299888739, "get_state_dump": 0.0502743911743164, "sim_render-ego0": 0.007762155532836914, "sim_render-ego1": 0.00821814219156901, "sim_render-ego2": 0.00803315798441569, "in-drivable-lane": 0.0, "deviation-heading": 0.24274693938747463, "agent_compute-ego0": 0.11333741823832194, "agent_compute-ego1": 0.11273708661397298, "agent_compute-ego2": 0.1092786947886149, "complete-iteration": 1.1979965686798095, "set_robot_commands": 0.007827014923095703, "deviation-center-line": 0.09874774981680254, "driven_lanedir_consec": 1.519973299888739, "sim_compute_sim_state": 0.07848557154337565, "sim_compute_performance-ego0": 0.006429548263549805, "sim_compute_performance-ego1": 0.006717529296875, "sim_compute_performance-ego2": 0.006694202423095703, "sim_compute_robot_state-ego0": 0.012022473017374675, "sim_compute_robot_state-ego1": 0.011771688461303711, "sim_compute_robot_state-ego2": 0.011826534271240237, "sim_compute_robot_state-parked0": 0.011929556528727214, "sim_compute_robot_state-parked1": 0.0119414488474528, "sim_compute_robot_state-parked2": 0.011567951838175456, "sim_compute_robot_state-parked3": 0.011604210535685222, "sim_compute_robot_state-parked4": 0.011592082977294922, "sim_compute_robot_state-parked5": 0.01139454205830892}, "ETHZ_autolab_technical_track-0-2-ego2": {"driven_any": 1.6424762656088765, "get_ui_image": 0.12404186884562174, "step_physics": 0.43618412653605143, "survival_time": 3.7499999999999942, "driven_lanedir": 1.6307910027254964, "get_state_dump": 0.0502743911743164, "sim_render-ego0": 0.007762155532836914, "sim_render-ego1": 0.00821814219156901, "sim_render-ego2": 0.00803315798441569, "in-drivable-lane": 0.0, "deviation-heading": 0.41898492889241457, "agent_compute-ego0": 0.11333741823832194, "agent_compute-ego1": 0.11273708661397298, "agent_compute-ego2": 0.1092786947886149, "complete-iteration": 1.1979965686798095, "set_robot_commands": 0.007827014923095703, "deviation-center-line": 0.26256359680920854, "driven_lanedir_consec": 1.6307910027254964, "sim_compute_sim_state": 0.07848557154337565, "sim_compute_performance-ego0": 0.006429548263549805, "sim_compute_performance-ego1": 0.006717529296875, "sim_compute_performance-ego2": 0.006694202423095703, "sim_compute_robot_state-ego0": 0.012022473017374675, "sim_compute_robot_state-ego1": 0.011771688461303711, "sim_compute_robot_state-ego2": 0.011826534271240237, "sim_compute_robot_state-parked0": 0.011929556528727214, "sim_compute_robot_state-parked1": 0.0119414488474528, "sim_compute_robot_state-parked2": 0.011567951838175456, "sim_compute_robot_state-parked3": 0.011604210535685222, "sim_compute_robot_state-parked4": 0.011592082977294922, "sim_compute_robot_state-parked5": 0.01139454205830892}}
set_robot_commands_max0.007827014923095703
set_robot_commands_mean0.007149152225918239
set_robot_commands_median0.0069236691792805985
set_robot_commands_min0.006696772575378418
sim_compute_performance-ego0_max0.006429548263549805
sim_compute_performance-ego0_mean0.00621632390552097
sim_compute_performance-ego0_median0.00613621473312378
sim_compute_performance-ego0_min0.006083208719889323
sim_compute_performance-ego1_max0.006717529296875
sim_compute_performance-ego1_mean0.006221654017766317
sim_compute_performance-ego1_median0.005996952056884766
sim_compute_performance-ego1_min0.005950480699539185
sim_compute_performance-ego2_max0.006694202423095703
sim_compute_performance-ego2_mean0.006325989762941996
sim_compute_performance-ego2_median0.006235275268554687
sim_compute_performance-ego2_min0.0060484915971755985
sim_compute_robot_state-ego0_max0.012022473017374675
sim_compute_robot_state-ego0_mean0.011076549092928567
sim_compute_robot_state-ego0_median0.010709231694539387
sim_compute_robot_state-ego0_min0.010497942566871645
sim_compute_robot_state-ego1_max0.011771688461303711
sim_compute_robot_state-ego1_mean0.0112216583887736
sim_compute_robot_state-ego1_median0.011335182189941406
sim_compute_robot_state-ego1_min0.010558104515075684
sim_compute_robot_state-ego2_max0.011826534271240237
sim_compute_robot_state-ego2_mean0.011088695459895666
sim_compute_robot_state-ego2_median0.010752293268839518
sim_compute_robot_state-ego2_min0.01068725883960724
sim_compute_robot_state-parked0_max0.011929556528727214
sim_compute_robot_state-parked0_mean0.011297512782944571
sim_compute_robot_state-parked0_median0.011173810958862305
sim_compute_robot_state-parked0_min0.010789170861244202
sim_compute_robot_state-parked1_max0.0119414488474528
sim_compute_robot_state-parked1_mean0.010800704227553474
sim_compute_robot_state-parked1_median0.010245157877604166
sim_compute_robot_state-parked1_min0.010215505957603456
sim_compute_robot_state-parked2_max0.011567951838175456
sim_compute_robot_state-parked2_mean0.010703840918011137
sim_compute_robot_state-parked2_median0.010322786966959636
sim_compute_robot_state-parked2_min0.010220783948898316
sim_compute_robot_state-parked3_max0.011604210535685222
sim_compute_robot_state-parked3_mean0.010876733793152705
sim_compute_robot_state-parked3_median0.01056283950805664
sim_compute_robot_state-parked3_min0.010463151335716249
sim_compute_robot_state-parked4_max0.011592082977294922
sim_compute_robot_state-parked4_mean0.01089013311598036
sim_compute_robot_state-parked4_median0.010676765441894533
sim_compute_robot_state-parked4_min0.010401550928751628
sim_compute_robot_state-parked5_max0.01139454205830892
sim_compute_robot_state-parked5_mean0.010764006972312926
sim_compute_robot_state-parked5_median0.010525099436442056
sim_compute_robot_state-parked5_min0.010372379422187805
sim_compute_sim_state_max0.08233795166015626
sim_compute_sim_state_mean0.07978958977593316
sim_compute_sim_state_median0.07854524612426758
sim_compute_sim_state_min0.07848557154337565
sim_render-ego0_max0.007762155532836914
sim_render-ego0_mean0.007554541097746955
sim_render-ego0_median0.007612732052803039
sim_render-ego0_min0.007288735707600911
sim_render-ego1_max0.00821814219156901
sim_render-ego1_mean0.007803239888615078
sim_render-ego1_median0.007661129633585612
sim_render-ego1_min0.007530447840690613
sim_render-ego2_max0.00803315798441569
sim_render-ego2_mean0.007623866796493531
sim_render-ego2_median0.007567885716756185
sim_render-ego2_min0.007270556688308716
simulation-passed1
step_physics_max0.4435828894376755
step_physics_mean0.43866515219211577
step_physics_median0.4362284406026205
step_physics_min0.43618412653605143
survival_time_max3.999999999999994
survival_time_mean3.833333333333328
survival_time_min3.7499999999999942

Highlights

33229

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-0-2

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.