Duckietown Challenges Home Challenges Submissions

Job 33239

Job ID33239
submission6750
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statusaborted
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:12:19
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6307910027254964
survival_time_median3.7499999999999942
deviation-center-line_median0.2459983741413155
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.1095232619689061
agent_compute-ego0_mean0.10714478512095588
agent_compute-ego0_median0.106066042582194
agent_compute-ego0_min0.10584505081176758
agent_compute-ego1_max0.10981594721476236
agent_compute-ego1_mean0.10881378740326972
agent_compute-ego1_median0.10887095561394323
agent_compute-ego1_min0.10775445938110352
agent_compute-ego2_max0.11020182291666666
agent_compute-ego2_mean0.10847354146150442
agent_compute-ego2_median0.10915722526036777
agent_compute-ego2_min0.10606157620747884
complete-iteration_max1.2285823822021484
complete-iteration_mean1.2190812905629478
complete-iteration_median1.2215731271107992
complete-iteration_min1.2070883623758952
deviation-center-line_max0.33351684875371984
deviation-center-line_mean0.22595620397294464
deviation-center-line_min0.09874774981680254
deviation-heading_max0.6316027400222535
deviation-heading_mean0.4522247185834625
deviation-heading_median0.4447720254491559
deviation-heading_min0.24274693938747463
driven_any_max2.190408968789618
driven_any_mean1.733402062893894
driven_any_median1.6424762656088765
driven_any_min1.4878558769275383
driven_lanedir_consec_max2.1771260350877726
driven_lanedir_consec_mean1.7183877913998369
driven_lanedir_consec_min1.46259450538951
driven_lanedir_max2.1771260350877726
driven_lanedir_mean1.7183877913998369
driven_lanedir_median1.6307910027254964
driven_lanedir_min1.46259450538951
get_state_dump_max0.0477790641784668
get_state_dump_mean0.047552947773892656
get_state_dump_median0.04777830441792806
get_state_dump_min0.04710147472528311
get_ui_image_max0.12970592425419733
get_ui_image_mean0.12899906557849328
get_ui_image_median0.12929364840189617
get_ui_image_min0.1279976240793864
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego0": {"driven_any": 1.9770449516338051, "get_ui_image": 0.12970592425419733, "step_physics": 0.4788130842722379, "survival_time": 5.1999999999999895, "driven_lanedir": 1.9558521041332475, "get_state_dump": 0.04710147472528311, "sim_render-ego0": 0.00715601214995751, "sim_render-ego1": 0.00735505956869859, "sim_render-ego2": 0.007251569857964149, "in-drivable-lane": 0.0, "deviation-heading": 0.5320991235874521, "agent_compute-ego0": 0.1095232619689061, "agent_compute-ego1": 0.10887095561394323, "agent_compute-ego2": 0.10915722526036777, "complete-iteration": 1.2285823822021484, "set_robot_commands": 0.006979749752924993, "deviation-center-line": 0.33351684875371984, "driven_lanedir_consec": 1.9558521041332475, "sim_compute_sim_state": 0.08805300868474521, "sim_compute_performance-ego0": 0.00618862876525292, "sim_compute_performance-ego1": 0.006021621135564951, "sim_compute_performance-ego2": 0.006138790112275343, "sim_compute_robot_state-ego0": 0.011088407956636868, "sim_compute_robot_state-ego1": 0.010536207602574276, "sim_compute_robot_state-ego2": 0.010882097941178542, "sim_compute_robot_state-parked0": 0.010895713017537044, "sim_compute_robot_state-parked1": 0.010650545358657835, "sim_compute_robot_state-parked2": 0.010723950771185068, "sim_compute_robot_state-parked3": 0.010690519442925086, "sim_compute_robot_state-parked4": 0.010404827503057629, "sim_compute_robot_state-parked5": 0.010237700664080106}, "ETHZ_autolab_technical_track-0-0-ego1": {"driven_any": 2.1208094722555324, "get_ui_image": 0.12970592425419733, "step_physics": 0.4788130842722379, "survival_time": 5.1999999999999895, "driven_lanedir": 2.105794367370018, "get_state_dump": 0.04710147472528311, "sim_render-ego0": 0.00715601214995751, "sim_render-ego1": 0.00735505956869859, "sim_render-ego2": 0.007251569857964149, "in-drivable-lane": 0.0, "deviation-heading": 0.4447720254491559, "agent_compute-ego0": 0.1095232619689061, "agent_compute-ego1": 0.10887095561394323, "agent_compute-ego2": 0.10915722526036777, "complete-iteration": 1.2285823822021484, "set_robot_commands": 0.006979749752924993, "deviation-center-line": 0.2266380552987714, "driven_lanedir_consec": 2.105794367370018, "sim_compute_sim_state": 0.08805300868474521, "sim_compute_performance-ego0": 0.00618862876525292, "sim_compute_performance-ego1": 0.006021621135564951, "sim_compute_performance-ego2": 0.006138790112275343, "sim_compute_robot_state-ego0": 0.011088407956636868, "sim_compute_robot_state-ego1": 0.010536207602574276, "sim_compute_robot_state-ego2": 0.010882097941178542, "sim_compute_robot_state-parked0": 0.010895713017537044, "sim_compute_robot_state-parked1": 0.010650545358657835, "sim_compute_robot_state-parked2": 0.010723950771185068, "sim_compute_robot_state-parked3": 0.010690519442925086, "sim_compute_robot_state-parked4": 0.010404827503057629, "sim_compute_robot_state-parked5": 0.010237700664080106}, "ETHZ_autolab_technical_track-0-0-ego2": {"driven_any": 2.190408968789618, "get_ui_image": 0.12970592425419733, "step_physics": 0.4788130842722379, "survival_time": 5.1999999999999895, "driven_lanedir": 2.1771260350877726, "get_state_dump": 0.04710147472528311, "sim_render-ego0": 0.00715601214995751, "sim_render-ego1": 0.00735505956869859, "sim_render-ego2": 0.007251569857964149, "in-drivable-lane": 0.0, "deviation-heading": 0.5064821016102693, "agent_compute-ego0": 0.1095232619689061, "agent_compute-ego1": 0.10887095561394323, "agent_compute-ego2": 0.10915722526036777, "complete-iteration": 1.2285823822021484, "set_robot_commands": 0.006979749752924993, "deviation-center-line": 0.2588314901693572, "driven_lanedir_consec": 2.1771260350877726, "sim_compute_sim_state": 0.08805300868474521, "sim_compute_performance-ego0": 0.00618862876525292, "sim_compute_performance-ego1": 0.006021621135564951, "sim_compute_performance-ego2": 0.006138790112275343, "sim_compute_robot_state-ego0": 0.011088407956636868, "sim_compute_robot_state-ego1": 0.010536207602574276, "sim_compute_robot_state-ego2": 0.010882097941178542, "sim_compute_robot_state-parked0": 0.010895713017537044, "sim_compute_robot_state-parked1": 0.010650545358657835, "sim_compute_robot_state-parked2": 0.010723950771185068, "sim_compute_robot_state-parked3": 0.010690519442925086, "sim_compute_robot_state-parked4": 0.010404827503057629, "sim_compute_robot_state-parked5": 0.010237700664080106}, "ETHZ_autolab_technical_track-0-1-ego0": {"driven_any": 1.4878558769275383, "get_ui_image": 0.12929364840189617, "step_physics": 0.47435531934102376, "survival_time": 3.7499999999999942, "driven_lanedir": 1.46259450538951, "get_state_dump": 0.0477790641784668, "sim_render-ego0": 0.007511666615804036, "sim_render-ego1": 0.007599290211995443, "sim_render-ego2": 0.007466004689534505, "in-drivable-lane": 0.0, "deviation-heading": 0.6316027400222535, "agent_compute-ego0": 0.10584505081176758, "agent_compute-ego1": 0.10981594721476236, "agent_compute-ego2": 0.10606157620747884, "complete-iteration": 1.2215731271107992, "set_robot_commands": 0.007119359970092773, "deviation-center-line": 0.2459983741413155, "driven_lanedir_consec": 1.46259450538951, "sim_compute_sim_state": 0.08039576212565104, "sim_compute_performance-ego0": 0.0066611925760904946, "sim_compute_performance-ego1": 0.006482019424438477, "sim_compute_performance-ego2": 0.006480642954508464, "sim_compute_robot_state-ego0": 0.011775840123494466, "sim_compute_robot_state-ego1": 0.011367470423380531, "sim_compute_robot_state-ego2": 0.011536687215169272, "sim_compute_robot_state-parked0": 0.0116074275970459, "sim_compute_robot_state-parked1": 0.011607128779093425, "sim_compute_robot_state-parked2": 0.01127897580464681, "sim_compute_robot_state-parked3": 0.011590852737426756, "sim_compute_robot_state-parked4": 0.011457443237304688, "sim_compute_robot_state-parked5": 0.011606696446736654}, "ETHZ_autolab_technical_track-0-1-ego1": {"driven_any": 1.5258454441466296, "get_ui_image": 0.12929364840189617, "step_physics": 0.47435531934102376, "survival_time": 3.7499999999999942, "driven_lanedir": 1.519973299888739, "get_state_dump": 0.0477790641784668, "sim_render-ego0": 0.007511666615804036, "sim_render-ego1": 0.007599290211995443, "sim_render-ego2": 0.007466004689534505, "in-drivable-lane": 0.0, "deviation-heading": 0.24274693938747463, "agent_compute-ego0": 0.10584505081176758, "agent_compute-ego1": 0.10981594721476236, "agent_compute-ego2": 0.10606157620747884, "complete-iteration": 1.2215731271107992, "set_robot_commands": 0.007119359970092773, "deviation-center-line": 0.09874774981680254, "driven_lanedir_consec": 1.519973299888739, "sim_compute_sim_state": 0.08039576212565104, "sim_compute_performance-ego0": 0.0066611925760904946, "sim_compute_performance-ego1": 0.006482019424438477, "sim_compute_performance-ego2": 0.006480642954508464, "sim_compute_robot_state-ego0": 0.011775840123494466, "sim_compute_robot_state-ego1": 0.011367470423380531, "sim_compute_robot_state-ego2": 0.011536687215169272, "sim_compute_robot_state-parked0": 0.0116074275970459, "sim_compute_robot_state-parked1": 0.011607128779093425, "sim_compute_robot_state-parked2": 0.01127897580464681, "sim_compute_robot_state-parked3": 0.011590852737426756, "sim_compute_robot_state-parked4": 0.011457443237304688, "sim_compute_robot_state-parked5": 0.011606696446736654}, "ETHZ_autolab_technical_track-0-1-ego2": {"driven_any": 1.6424762656088765, "get_ui_image": 0.12929364840189617, "step_physics": 0.47435531934102376, "survival_time": 3.7499999999999942, "driven_lanedir": 1.6307910027254964, "get_state_dump": 0.0477790641784668, "sim_render-ego0": 0.007511666615804036, "sim_render-ego1": 0.007599290211995443, "sim_render-ego2": 0.007466004689534505, "in-drivable-lane": 0.0, "deviation-heading": 0.41898492889241457, "agent_compute-ego0": 0.10584505081176758, "agent_compute-ego1": 0.10981594721476236, "agent_compute-ego2": 0.10606157620747884, "complete-iteration": 1.2215731271107992, "set_robot_commands": 0.007119359970092773, "deviation-center-line": 0.26256359680920854, "driven_lanedir_consec": 1.6307910027254964, "sim_compute_sim_state": 0.08039576212565104, "sim_compute_performance-ego0": 0.0066611925760904946, "sim_compute_performance-ego1": 0.006482019424438477, "sim_compute_performance-ego2": 0.006480642954508464, "sim_compute_robot_state-ego0": 0.011775840123494466, "sim_compute_robot_state-ego1": 0.011367470423380531, "sim_compute_robot_state-ego2": 0.011536687215169272, "sim_compute_robot_state-parked0": 0.0116074275970459, "sim_compute_robot_state-parked1": 0.011607128779093425, "sim_compute_robot_state-parked2": 0.01127897580464681, "sim_compute_robot_state-parked3": 0.011590852737426756, "sim_compute_robot_state-parked4": 0.011457443237304688, "sim_compute_robot_state-parked5": 0.011606696446736654}, "ETHZ_autolab_technical_track-0-2-ego0": {"driven_any": 1.4878558769275383, "get_ui_image": 0.1279976240793864, "step_physics": 0.4654543240865072, "survival_time": 3.7499999999999942, "driven_lanedir": 1.46259450538951, "get_state_dump": 0.04777830441792806, "sim_render-ego0": 0.007383038202921549, "sim_render-ego1": 0.007149550120035807, "sim_render-ego2": 0.0073381296793619795, "in-drivable-lane": 0.0, "deviation-heading": 0.6316027400222535, "agent_compute-ego0": 0.106066042582194, "agent_compute-ego1": 0.10775445938110352, "agent_compute-ego2": 0.11020182291666666, "complete-iteration": 1.2070883623758952, "set_robot_commands": 0.007039880752563477, "deviation-center-line": 0.2459983741413155, "driven_lanedir_consec": 1.46259450538951, "sim_compute_sim_state": 0.0792854658762614, "sim_compute_performance-ego0": 0.006298402150472005, "sim_compute_performance-ego1": 0.006046272913614909, "sim_compute_performance-ego2": 0.006147499084472656, "sim_compute_robot_state-ego0": 0.011569703420003257, "sim_compute_robot_state-ego1": 0.01092486063639323, "sim_compute_robot_state-ego2": 0.011335878372192383, "sim_compute_robot_state-parked0": 0.011548932393391926, "sim_compute_robot_state-parked1": 0.011358006795247396, "sim_compute_robot_state-parked2": 0.011010061899820964, "sim_compute_robot_state-parked3": 0.010960423151652018, "sim_compute_robot_state-parked4": 0.011141557693481446, "sim_compute_robot_state-parked5": 0.011121145884195964}, "ETHZ_autolab_technical_track-0-2-ego1": {"driven_any": 1.5258454441466296, "get_ui_image": 0.1279976240793864, "step_physics": 0.4654543240865072, "survival_time": 3.7499999999999942, "driven_lanedir": 1.519973299888739, "get_state_dump": 0.04777830441792806, "sim_render-ego0": 0.007383038202921549, "sim_render-ego1": 0.007149550120035807, "sim_render-ego2": 0.0073381296793619795, "in-drivable-lane": 0.0, "deviation-heading": 0.24274693938747463, "agent_compute-ego0": 0.106066042582194, "agent_compute-ego1": 0.10775445938110352, "agent_compute-ego2": 0.11020182291666666, "complete-iteration": 1.2070883623758952, "set_robot_commands": 0.007039880752563477, "deviation-center-line": 0.09874774981680254, "driven_lanedir_consec": 1.519973299888739, "sim_compute_sim_state": 0.0792854658762614, "sim_compute_performance-ego0": 0.006298402150472005, "sim_compute_performance-ego1": 0.006046272913614909, "sim_compute_performance-ego2": 0.006147499084472656, "sim_compute_robot_state-ego0": 0.011569703420003257, "sim_compute_robot_state-ego1": 0.01092486063639323, "sim_compute_robot_state-ego2": 0.011335878372192383, "sim_compute_robot_state-parked0": 0.011548932393391926, "sim_compute_robot_state-parked1": 0.011358006795247396, "sim_compute_robot_state-parked2": 0.011010061899820964, "sim_compute_robot_state-parked3": 0.010960423151652018, "sim_compute_robot_state-parked4": 0.011141557693481446, "sim_compute_robot_state-parked5": 0.011121145884195964}, "ETHZ_autolab_technical_track-0-2-ego2": {"driven_any": 1.6424762656088765, "get_ui_image": 0.1279976240793864, "step_physics": 0.4654543240865072, "survival_time": 3.7499999999999942, "driven_lanedir": 1.6307910027254964, "get_state_dump": 0.04777830441792806, "sim_render-ego0": 0.007383038202921549, "sim_render-ego1": 0.007149550120035807, "sim_render-ego2": 0.0073381296793619795, "in-drivable-lane": 0.0, "deviation-heading": 0.41898492889241457, "agent_compute-ego0": 0.106066042582194, "agent_compute-ego1": 0.10775445938110352, "agent_compute-ego2": 0.11020182291666666, "complete-iteration": 1.2070883623758952, "set_robot_commands": 0.007039880752563477, "deviation-center-line": 0.26256359680920854, "driven_lanedir_consec": 1.6307910027254964, "sim_compute_sim_state": 0.0792854658762614, "sim_compute_performance-ego0": 0.006298402150472005, "sim_compute_performance-ego1": 0.006046272913614909, "sim_compute_performance-ego2": 0.006147499084472656, "sim_compute_robot_state-ego0": 0.011569703420003257, "sim_compute_robot_state-ego1": 0.01092486063639323, "sim_compute_robot_state-ego2": 0.011335878372192383, "sim_compute_robot_state-parked0": 0.011548932393391926, "sim_compute_robot_state-parked1": 0.011358006795247396, "sim_compute_robot_state-parked2": 0.011010061899820964, "sim_compute_robot_state-parked3": 0.010960423151652018, "sim_compute_robot_state-parked4": 0.011141557693481446, "sim_compute_robot_state-parked5": 0.011121145884195964}}
set_robot_commands_max0.007119359970092773
set_robot_commands_mean0.00704633015852708
set_robot_commands_median0.007039880752563477
set_robot_commands_min0.006979749752924993
sim_compute_performance-ego0_max0.0066611925760904946
sim_compute_performance-ego0_mean0.006382741163938473
sim_compute_performance-ego0_median0.006298402150472005
sim_compute_performance-ego0_min0.00618862876525292
sim_compute_performance-ego1_max0.006482019424438477
sim_compute_performance-ego1_mean0.006183304491206113
sim_compute_performance-ego1_median0.006046272913614909
sim_compute_performance-ego1_min0.006021621135564951
sim_compute_performance-ego2_max0.006480642954508464
sim_compute_performance-ego2_mean0.006255644050418821
sim_compute_performance-ego2_median0.006147499084472656
sim_compute_performance-ego2_min0.006138790112275343
sim_compute_robot_state-ego0_max0.011775840123494466
sim_compute_robot_state-ego0_mean0.011477983833378195
sim_compute_robot_state-ego0_median0.011569703420003257
sim_compute_robot_state-ego0_min0.011088407956636868
sim_compute_robot_state-ego1_max0.011367470423380531
sim_compute_robot_state-ego1_mean0.01094284622078268
sim_compute_robot_state-ego1_median0.01092486063639323
sim_compute_robot_state-ego1_min0.010536207602574276
sim_compute_robot_state-ego2_max0.011536687215169272
sim_compute_robot_state-ego2_mean0.0112515545095134
sim_compute_robot_state-ego2_median0.011335878372192383
sim_compute_robot_state-ego2_min0.010882097941178542
sim_compute_robot_state-parked0_max0.0116074275970459
sim_compute_robot_state-parked0_mean0.01135069100265829
sim_compute_robot_state-parked0_median0.011548932393391926
sim_compute_robot_state-parked0_min0.010895713017537044
sim_compute_robot_state-parked1_max0.011607128779093425
sim_compute_robot_state-parked1_mean0.01120522697766622
sim_compute_robot_state-parked1_median0.011358006795247396
sim_compute_robot_state-parked1_min0.010650545358657835
sim_compute_robot_state-parked2_max0.01127897580464681
sim_compute_robot_state-parked2_mean0.011004329491884282
sim_compute_robot_state-parked2_median0.011010061899820964
sim_compute_robot_state-parked2_min0.010723950771185068
sim_compute_robot_state-parked3_max0.011590852737426756
sim_compute_robot_state-parked3_mean0.011080598444001286
sim_compute_robot_state-parked3_median0.010960423151652018
sim_compute_robot_state-parked3_min0.010690519442925086
sim_compute_robot_state-parked4_max0.011457443237304688
sim_compute_robot_state-parked4_mean0.011001276144614588
sim_compute_robot_state-parked4_median0.011141557693481446
sim_compute_robot_state-parked4_min0.010404827503057629
sim_compute_robot_state-parked5_max0.011606696446736654
sim_compute_robot_state-parked5_mean0.010988514331670907
sim_compute_robot_state-parked5_median0.011121145884195964
sim_compute_robot_state-parked5_min0.010237700664080106
sim_compute_sim_state_max0.08805300868474521
sim_compute_sim_state_mean0.08257807889555255
sim_compute_sim_state_median0.08039576212565104
sim_compute_sim_state_min0.0792854658762614
sim_render-ego0_max0.007511666615804036
sim_render-ego0_mean0.007350238989561032
sim_render-ego0_median0.007383038202921549
sim_render-ego0_min0.00715601214995751
sim_render-ego1_max0.007599290211995443
sim_render-ego1_mean0.007367966633576613
sim_render-ego1_median0.00735505956869859
sim_render-ego1_min0.007149550120035807
sim_render-ego2_max0.007466004689534505
sim_render-ego2_mean0.007351901408953544
sim_render-ego2_median0.0073381296793619795
sim_render-ego2_min0.007251569857964149
simulation-passed1
step_physics_max0.4788130842722379
step_physics_mean0.47287424256658966
step_physics_median0.47435531934102376
step_physics_min0.4654543240865072
survival_time_max5.1999999999999895
survival_time_mean4.233333333333326
survival_time_min3.7499999999999942

Highlights

33239

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-0-2

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.