Duckietown Challenges Home Challenges Submissions

Job 33232

Job ID33232
submission6734
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statusaborted
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:11:34
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6307910027254964
survival_time_median3.7499999999999942
deviation-center-line_median0.2459983741413155
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.11412366549173993
agent_compute-ego0_mean0.11296781448607748
agent_compute-ego0_median0.11311776840940437
agent_compute-ego0_min0.11166200955708822
agent_compute-ego1_max0.11354272416297426
agent_compute-ego1_mean0.11073487139762717
agent_compute-ego1_median0.11066887219746908
agent_compute-ego1_min0.10799301783243816
agent_compute-ego2_max0.11308486664548834
agent_compute-ego2_mean0.1112146792287804
agent_compute-ego2_median0.11101333300272624
agent_compute-ego2_min0.10954583803812663
complete-iteration_max1.251865693863402
complete-iteration_mean1.2209594011757674
complete-iteration_median1.216007407506307
complete-iteration_min1.1950051021575927
deviation-center-line_max0.3054772661227965
deviation-center-line_mean0.21466488991672383
deviation-center-line_min0.09874774981680254
deviation-heading_max0.6485604209391395
deviation-heading_mean0.4536763014579741
deviation-heading_median0.41898492889241457
deviation-heading_min0.24274693938747463
driven_any_max1.9474270889482397
driven_any_mean1.6704780358681428
driven_any_median1.6424762656088765
driven_any_min1.4878558769275383
driven_lanedir_consec_max1.9336436650125195
driven_lanedir_consec_mean1.6547682124731249
driven_lanedir_consec_min1.46259450538951
driven_lanedir_max1.9336436650125195
driven_lanedir_mean1.6547682124731249
driven_lanedir_median1.6307910027254964
driven_lanedir_min1.46259450538951
get_state_dump_max0.05102386474609375
get_state_dump_mean0.050607362605155776
get_state_dump_median0.050867002061072815
get_state_dump_min0.04993122100830078
get_ui_image_max0.15139400198104533
get_ui_image_mean0.13537548712241168
get_ui_image_median0.12739010492960612
get_ui_image_min0.12734235445658365
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego0": {"driven_any": 1.8281069744704648, "get_ui_image": 0.15139400198104533, "step_physics": 0.4366540147903118, "survival_time": 4.699999999999991, "driven_lanedir": 1.8092889415334517, "get_state_dump": 0.050867002061072815, "sim_render-ego0": 0.00871904860151575, "sim_render-ego1": 0.008256027039061201, "sim_render-ego2": 0.008200229482447847, "in-drivable-lane": 0.0, "deviation-heading": 0.47826153888174383, "agent_compute-ego0": 0.11311776840940437, "agent_compute-ego1": 0.11354272416297426, "agent_compute-ego2": 0.11308486664548834, "complete-iteration": 1.251865693863402, "set_robot_commands": 0.00812590629496473, "deviation-center-line": 0.3054772661227965, "driven_lanedir_consec": 1.8092889415334517, "sim_compute_sim_state": 0.08713381087526362, "sim_compute_performance-ego0": 0.007720470428466797, "sim_compute_performance-ego1": 0.006933988408839449, "sim_compute_performance-ego2": 0.00710478995708709, "sim_compute_robot_state-ego0": 0.013265013694763184, "sim_compute_robot_state-ego1": 0.012528219121567746, "sim_compute_robot_state-ego2": 0.012792777507863146, "sim_compute_robot_state-parked0": 0.012829156632119035, "sim_compute_robot_state-parked1": 0.012305498123168944, "sim_compute_robot_state-parked2": 0.012508973162224952, "sim_compute_robot_state-parked3": 0.012500742648510223, "sim_compute_robot_state-parked4": 0.012342285602650743, "sim_compute_robot_state-parked5": 0.012519666489134443}, "ETHZ_autolab_technical_track-0-0-ego1": {"driven_any": 1.9464130860284912, "get_ui_image": 0.15139400198104533, "step_physics": 0.4366540147903118, "survival_time": 4.699999999999991, "driven_lanedir": 1.9336436650125195, "get_state_dump": 0.050867002061072815, "sim_render-ego0": 0.00871904860151575, "sim_render-ego1": 0.008256027039061201, "sim_render-ego2": 0.008200229482447847, "in-drivable-lane": 0.0, "deviation-heading": 0.36959553669659767, "agent_compute-ego0": 0.11311776840940437, "agent_compute-ego1": 0.11354272416297426, "agent_compute-ego2": 0.11308486664548834, "complete-iteration": 1.251865693863402, "set_robot_commands": 0.00812590629496473, "deviation-center-line": 0.14234015419720453, "driven_lanedir_consec": 1.9336436650125195, "sim_compute_sim_state": 0.08713381087526362, "sim_compute_performance-ego0": 0.007720470428466797, "sim_compute_performance-ego1": 0.006933988408839449, "sim_compute_performance-ego2": 0.00710478995708709, "sim_compute_robot_state-ego0": 0.013265013694763184, "sim_compute_robot_state-ego1": 0.012528219121567746, "sim_compute_robot_state-ego2": 0.012792777507863146, "sim_compute_robot_state-parked0": 0.012829156632119035, "sim_compute_robot_state-parked1": 0.012305498123168944, "sim_compute_robot_state-parked2": 0.012508973162224952, "sim_compute_robot_state-parked3": 0.012500742648510223, "sim_compute_robot_state-parked4": 0.012342285602650743, "sim_compute_robot_state-parked5": 0.012519666489134443}, "ETHZ_autolab_technical_track-0-0-ego2": {"driven_any": 1.9474270889482397, "get_ui_image": 0.15139400198104533, "step_physics": 0.4366540147903118, "survival_time": 4.699999999999991, "driven_lanedir": 1.92326368970466, "get_state_dump": 0.050867002061072815, "sim_render-ego0": 0.00871904860151575, "sim_render-ego1": 0.008256027039061201, "sim_render-ego2": 0.008200229482447847, "in-drivable-lane": 0.0, "deviation-heading": 0.6485604209391395, "agent_compute-ego0": 0.11311776840940437, "agent_compute-ego1": 0.11354272416297426, "agent_compute-ego2": 0.11308486664548834, "complete-iteration": 1.251865693863402, "set_robot_commands": 0.00812590629496473, "deviation-center-line": 0.2695471473958605, "driven_lanedir_consec": 1.92326368970466, "sim_compute_sim_state": 0.08713381087526362, "sim_compute_performance-ego0": 0.007720470428466797, "sim_compute_performance-ego1": 0.006933988408839449, "sim_compute_performance-ego2": 0.00710478995708709, "sim_compute_robot_state-ego0": 0.013265013694763184, "sim_compute_robot_state-ego1": 0.012528219121567746, "sim_compute_robot_state-ego2": 0.012792777507863146, "sim_compute_robot_state-parked0": 0.012829156632119035, "sim_compute_robot_state-parked1": 0.012305498123168944, "sim_compute_robot_state-parked2": 0.012508973162224952, "sim_compute_robot_state-parked3": 0.012500742648510223, "sim_compute_robot_state-parked4": 0.012342285602650743, "sim_compute_robot_state-parked5": 0.012519666489134443}, "ETHZ_autolab_technical_track-0-1-ego0": {"driven_any": 1.4878558769275383, "get_ui_image": 0.12734235445658365, "step_physics": 0.4382950305938721, "survival_time": 3.7499999999999942, "driven_lanedir": 1.46259450538951, "get_state_dump": 0.05102386474609375, "sim_render-ego0": 0.007874581019083659, "sim_render-ego1": 0.007935914993286133, "sim_render-ego2": 0.0075188414255778, "in-drivable-lane": 0.0, "deviation-heading": 0.6316027400222535, "agent_compute-ego0": 0.11166200955708822, "agent_compute-ego1": 0.10799301783243816, "agent_compute-ego2": 0.10954583803812663, "complete-iteration": 1.1950051021575927, "set_robot_commands": 0.007256466547648112, "deviation-center-line": 0.2459983741413155, "driven_lanedir_consec": 1.46259450538951, "sim_compute_sim_state": 0.08097452481587727, "sim_compute_performance-ego0": 0.006835571924845378, "sim_compute_performance-ego1": 0.006372741063435872, "sim_compute_performance-ego2": 0.0061334927876790365, "sim_compute_robot_state-ego0": 0.011873753865559895, "sim_compute_robot_state-ego1": 0.01130082130432129, "sim_compute_robot_state-ego2": 0.011539398829142252, "sim_compute_robot_state-parked0": 0.011524502436319988, "sim_compute_robot_state-parked1": 0.011502113342285156, "sim_compute_robot_state-parked2": 0.01132439931233724, "sim_compute_robot_state-parked3": 0.011499614715576171, "sim_compute_robot_state-parked4": 0.01131084442138672, "sim_compute_robot_state-parked5": 0.011148592631022136}, "ETHZ_autolab_technical_track-0-1-ego1": {"driven_any": 1.5258454441466296, "get_ui_image": 0.12734235445658365, "step_physics": 0.4382950305938721, "survival_time": 3.7499999999999942, "driven_lanedir": 1.519973299888739, "get_state_dump": 0.05102386474609375, "sim_render-ego0": 0.007874581019083659, "sim_render-ego1": 0.007935914993286133, "sim_render-ego2": 0.0075188414255778, "in-drivable-lane": 0.0, "deviation-heading": 0.24274693938747463, "agent_compute-ego0": 0.11166200955708822, "agent_compute-ego1": 0.10799301783243816, "agent_compute-ego2": 0.10954583803812663, "complete-iteration": 1.1950051021575927, "set_robot_commands": 0.007256466547648112, "deviation-center-line": 0.09874774981680254, "driven_lanedir_consec": 1.519973299888739, "sim_compute_sim_state": 0.08097452481587727, "sim_compute_performance-ego0": 0.006835571924845378, "sim_compute_performance-ego1": 0.006372741063435872, "sim_compute_performance-ego2": 0.0061334927876790365, "sim_compute_robot_state-ego0": 0.011873753865559895, "sim_compute_robot_state-ego1": 0.01130082130432129, "sim_compute_robot_state-ego2": 0.011539398829142252, "sim_compute_robot_state-parked0": 0.011524502436319988, "sim_compute_robot_state-parked1": 0.011502113342285156, "sim_compute_robot_state-parked2": 0.01132439931233724, "sim_compute_robot_state-parked3": 0.011499614715576171, "sim_compute_robot_state-parked4": 0.01131084442138672, "sim_compute_robot_state-parked5": 0.011148592631022136}, "ETHZ_autolab_technical_track-0-1-ego2": {"driven_any": 1.6424762656088765, "get_ui_image": 0.12734235445658365, "step_physics": 0.4382950305938721, "survival_time": 3.7499999999999942, "driven_lanedir": 1.6307910027254964, "get_state_dump": 0.05102386474609375, "sim_render-ego0": 0.007874581019083659, "sim_render-ego1": 0.007935914993286133, "sim_render-ego2": 0.0075188414255778, "in-drivable-lane": 0.0, "deviation-heading": 0.41898492889241457, "agent_compute-ego0": 0.11166200955708822, "agent_compute-ego1": 0.10799301783243816, "agent_compute-ego2": 0.10954583803812663, "complete-iteration": 1.1950051021575927, "set_robot_commands": 0.007256466547648112, "deviation-center-line": 0.26256359680920854, "driven_lanedir_consec": 1.6307910027254964, "sim_compute_sim_state": 0.08097452481587727, "sim_compute_performance-ego0": 0.006835571924845378, "sim_compute_performance-ego1": 0.006372741063435872, "sim_compute_performance-ego2": 0.0061334927876790365, "sim_compute_robot_state-ego0": 0.011873753865559895, "sim_compute_robot_state-ego1": 0.01130082130432129, "sim_compute_robot_state-ego2": 0.011539398829142252, "sim_compute_robot_state-parked0": 0.011524502436319988, "sim_compute_robot_state-parked1": 0.011502113342285156, "sim_compute_robot_state-parked2": 0.01132439931233724, "sim_compute_robot_state-parked3": 0.011499614715576171, "sim_compute_robot_state-parked4": 0.01131084442138672, "sim_compute_robot_state-parked5": 0.011148592631022136}, "ETHZ_autolab_technical_track-0-2-ego0": {"driven_any": 1.4878558769275383, "get_ui_image": 0.12739010492960612, "step_physics": 0.435391747156779, "survival_time": 3.7499999999999942, "driven_lanedir": 1.46259450538951, "get_state_dump": 0.04993122100830078, "sim_render-ego0": 0.008427778879801432, "sim_render-ego1": 0.008672583897908528, "sim_render-ego2": 0.008490635553995768, "in-drivable-lane": 0.0, "deviation-heading": 0.6316027400222535, "agent_compute-ego0": 0.11412366549173993, "agent_compute-ego1": 0.11066887219746908, "agent_compute-ego2": 0.11101333300272624, "complete-iteration": 1.216007407506307, "set_robot_commands": 0.008273890813191732, "deviation-center-line": 0.2459983741413155, "driven_lanedir_consec": 1.46259450538951, "sim_compute_sim_state": 0.07985370318094889, "sim_compute_performance-ego0": 0.007329505284627278, "sim_compute_performance-ego1": 0.007472782135009765, "sim_compute_performance-ego2": 0.007482217152913411, "sim_compute_robot_state-ego0": 0.01309613545735677, "sim_compute_robot_state-ego1": 0.012795963287353516, "sim_compute_robot_state-ego2": 0.01280902862548828, "sim_compute_robot_state-parked0": 0.01271211624145508, "sim_compute_robot_state-parked1": 0.01248705228169759, "sim_compute_robot_state-parked2": 0.012434116999308268, "sim_compute_robot_state-parked3": 0.012695331573486329, "sim_compute_robot_state-parked4": 0.012715972264607748, "sim_compute_robot_state-parked5": 0.012601776123046877}, "ETHZ_autolab_technical_track-0-2-ego1": {"driven_any": 1.5258454441466296, "get_ui_image": 0.12739010492960612, "step_physics": 0.435391747156779, "survival_time": 3.7499999999999942, "driven_lanedir": 1.519973299888739, "get_state_dump": 0.04993122100830078, "sim_render-ego0": 0.008427778879801432, "sim_render-ego1": 0.008672583897908528, "sim_render-ego2": 0.008490635553995768, "in-drivable-lane": 0.0, "deviation-heading": 0.24274693938747463, "agent_compute-ego0": 0.11412366549173993, "agent_compute-ego1": 0.11066887219746908, "agent_compute-ego2": 0.11101333300272624, "complete-iteration": 1.216007407506307, "set_robot_commands": 0.008273890813191732, "deviation-center-line": 0.09874774981680254, "driven_lanedir_consec": 1.519973299888739, "sim_compute_sim_state": 0.07985370318094889, "sim_compute_performance-ego0": 0.007329505284627278, "sim_compute_performance-ego1": 0.007472782135009765, "sim_compute_performance-ego2": 0.007482217152913411, "sim_compute_robot_state-ego0": 0.01309613545735677, "sim_compute_robot_state-ego1": 0.012795963287353516, "sim_compute_robot_state-ego2": 0.01280902862548828, "sim_compute_robot_state-parked0": 0.01271211624145508, "sim_compute_robot_state-parked1": 0.01248705228169759, "sim_compute_robot_state-parked2": 0.012434116999308268, "sim_compute_robot_state-parked3": 0.012695331573486329, "sim_compute_robot_state-parked4": 0.012715972264607748, "sim_compute_robot_state-parked5": 0.012601776123046877}, "ETHZ_autolab_technical_track-0-2-ego2": {"driven_any": 1.6424762656088765, "get_ui_image": 0.12739010492960612, "step_physics": 0.435391747156779, "survival_time": 3.7499999999999942, "driven_lanedir": 1.6307910027254964, "get_state_dump": 0.04993122100830078, "sim_render-ego0": 0.008427778879801432, "sim_render-ego1": 0.008672583897908528, "sim_render-ego2": 0.008490635553995768, "in-drivable-lane": 0.0, "deviation-heading": 0.41898492889241457, "agent_compute-ego0": 0.11412366549173993, "agent_compute-ego1": 0.11066887219746908, "agent_compute-ego2": 0.11101333300272624, "complete-iteration": 1.216007407506307, "set_robot_commands": 0.008273890813191732, "deviation-center-line": 0.26256359680920854, "driven_lanedir_consec": 1.6307910027254964, "sim_compute_sim_state": 0.07985370318094889, "sim_compute_performance-ego0": 0.007329505284627278, "sim_compute_performance-ego1": 0.007472782135009765, "sim_compute_performance-ego2": 0.007482217152913411, "sim_compute_robot_state-ego0": 0.01309613545735677, "sim_compute_robot_state-ego1": 0.012795963287353516, "sim_compute_robot_state-ego2": 0.01280902862548828, "sim_compute_robot_state-parked0": 0.01271211624145508, "sim_compute_robot_state-parked1": 0.01248705228169759, "sim_compute_robot_state-parked2": 0.012434116999308268, "sim_compute_robot_state-parked3": 0.012695331573486329, "sim_compute_robot_state-parked4": 0.012715972264607748, "sim_compute_robot_state-parked5": 0.012601776123046877}}
set_robot_commands_max0.008273890813191732
set_robot_commands_mean0.007885421218601524
set_robot_commands_median0.00812590629496473
set_robot_commands_min0.007256466547648112
sim_compute_performance-ego0_max0.007720470428466797
sim_compute_performance-ego0_mean0.007295182545979818
sim_compute_performance-ego0_median0.007329505284627278
sim_compute_performance-ego0_min0.006835571924845378
sim_compute_performance-ego1_max0.007472782135009765
sim_compute_performance-ego1_mean0.006926503869095029
sim_compute_performance-ego1_median0.006933988408839449
sim_compute_performance-ego1_min0.006372741063435872
sim_compute_performance-ego2_max0.007482217152913411
sim_compute_performance-ego2_mean0.006906833299226513
sim_compute_performance-ego2_median0.00710478995708709
sim_compute_performance-ego2_min0.0061334927876790365
sim_compute_robot_state-ego0_max0.013265013694763184
sim_compute_robot_state-ego0_mean0.012744967672559952
sim_compute_robot_state-ego0_median0.01309613545735677
sim_compute_robot_state-ego0_min0.011873753865559895
sim_compute_robot_state-ego1_max0.012795963287353516
sim_compute_robot_state-ego1_mean0.012208334571080852
sim_compute_robot_state-ego1_median0.012528219121567746
sim_compute_robot_state-ego1_min0.01130082130432129
sim_compute_robot_state-ego2_max0.01280902862548828
sim_compute_robot_state-ego2_mean0.012380401654164562
sim_compute_robot_state-ego2_median0.012792777507863146
sim_compute_robot_state-ego2_min0.011539398829142252
sim_compute_robot_state-parked0_max0.012829156632119035
sim_compute_robot_state-parked0_mean0.012355258436631367
sim_compute_robot_state-parked0_median0.01271211624145508
sim_compute_robot_state-parked0_min0.011524502436319988
sim_compute_robot_state-parked1_max0.01248705228169759
sim_compute_robot_state-parked1_mean0.012098221249050564
sim_compute_robot_state-parked1_median0.012305498123168944
sim_compute_robot_state-parked1_min0.011502113342285156
sim_compute_robot_state-parked2_max0.012508973162224952
sim_compute_robot_state-parked2_mean0.01208916315795682
sim_compute_robot_state-parked2_median0.012434116999308268
sim_compute_robot_state-parked2_min0.01132439931233724
sim_compute_robot_state-parked3_max0.012695331573486329
sim_compute_robot_state-parked3_mean0.012231896312524242
sim_compute_robot_state-parked3_median0.012500742648510223
sim_compute_robot_state-parked3_min0.011499614715576171
sim_compute_robot_state-parked4_max0.012715972264607748
sim_compute_robot_state-parked4_mean0.01212303409621507
sim_compute_robot_state-parked4_median0.012342285602650743
sim_compute_robot_state-parked4_min0.01131084442138672
sim_compute_robot_state-parked5_max0.012601776123046877
sim_compute_robot_state-parked5_mean0.012090011747734483
sim_compute_robot_state-parked5_median0.012519666489134443
sim_compute_robot_state-parked5_min0.011148592631022136
sim_compute_sim_state_max0.08713381087526362
sim_compute_sim_state_mean0.08265401295736326
sim_compute_sim_state_median0.08097452481587727
sim_compute_sim_state_min0.07985370318094889
sim_render-ego0_max0.00871904860151575
sim_render-ego0_mean0.008340469500133613
sim_render-ego0_median0.008427778879801432
sim_render-ego0_min0.007874581019083659
sim_render-ego1_max0.008672583897908528
sim_render-ego1_mean0.008288175310085286
sim_render-ego1_median0.008256027039061201
sim_render-ego1_min0.007935914993286133
sim_render-ego2_max0.008490635553995768
sim_render-ego2_mean0.008069902154007137
sim_render-ego2_median0.008200229482447847
sim_render-ego2_min0.0075188414255778
simulation-passed1
step_physics_max0.4382950305938721
step_physics_mean0.436780264180321
step_physics_median0.4366540147903118
step_physics_min0.435391747156779
survival_time_max4.699999999999991
survival_time_mean4.066666666666659
survival_time_min3.7499999999999942

Highlights

33232

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-0-2

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.