Duckietown Challenges Home Challenges Submissions

Job 33238

Job ID33238
submission6742
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statusaborted
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:08:11
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4737678662434752
survival_time_median1.4500000000000006
deviation-center-line_median0.07907388948535099
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.1089764618482746
agent_compute-ego0_mean0.10633004639407932
agent_compute-ego0_median0.10600561109082451
agent_compute-ego0_min0.1040080662431388
agent_compute-ego1_max0.10872864723205566
agent_compute-ego1_mean0.1052565793881471
agent_compute-ego1_median0.10363600171845534
agent_compute-ego1_min0.10340508921393032
agent_compute-ego2_max0.10738599495809588
agent_compute-ego2_mean0.10450095894064004
agent_compute-ego2_median0.10405415502087824
agent_compute-ego2_min0.10206272684294602
complete-iteration_max1.1979378174091209
complete-iteration_mean1.1940484675890268
complete-iteration_median1.1928585479999412
complete-iteration_min1.1913490373580182
deviation-center-line_max0.2374497421795148
deviation-center-line_mean0.0915913516490563
deviation-center-line_min0.043417853796394214
deviation-heading_max0.31751010502754223
deviation-heading_mean0.19869205070099252
deviation-heading_median0.20900628716941683
deviation-heading_min0.06030033220904063
driven_any_max1.1568497839213312
driven_any_mean0.6981351753140197
driven_any_median0.47447651877753183
driven_any_min0.4698221645458976
driven_lanedir_consec_max1.1507789184828263
driven_lanedir_consec_mean0.6922753526584171
driven_lanedir_consec_min0.45606394535054506
driven_lanedir_max1.1507789184828263
driven_lanedir_mean0.6922753526584171
driven_lanedir_median0.4737678662434752
driven_lanedir_min0.45606394535054506
get_state_dump_max0.04654956645652896
get_state_dump_mean0.0463142092222994
get_state_dump_median0.04632371869580499
get_state_dump_min0.04606934251456425
get_ui_image_max0.1294010672075995
get_ui_image_mean0.1270153762392569
get_ui_image_median0.12721722701500202
get_ui_image_min0.1244278344951692
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego0": {"driven_any": 1.1520413342560083, "get_ui_image": 0.1244278344951692, "step_physics": 0.4664810329187112, "survival_time": 3.049999999999997, "driven_lanedir": 1.1442277014314934, "get_state_dump": 0.04654956645652896, "sim_render-ego0": 0.0066097212619468815, "sim_render-ego1": 0.0071473160728079375, "sim_render-ego2": 0.0069966824328313105, "in-drivable-lane": 0.0, "deviation-heading": 0.2729459397350084, "agent_compute-ego0": 0.1089764618482746, "agent_compute-ego1": 0.10872864723205566, "agent_compute-ego2": 0.10738599495809588, "complete-iteration": 1.1913490373580182, "set_robot_commands": 0.00651144199684018, "deviation-center-line": 0.2374497421795148, "driven_lanedir_consec": 1.1442277014314934, "sim_compute_sim_state": 0.07636468136896853, "sim_compute_performance-ego0": 0.005757961116853307, "sim_compute_performance-ego1": 0.005831780980844967, "sim_compute_performance-ego2": 0.006010071175997374, "sim_compute_robot_state-ego0": 0.010417559107796091, "sim_compute_robot_state-ego1": 0.010289219559216108, "sim_compute_robot_state-ego2": 0.010220351766367429, "sim_compute_robot_state-parked0": 0.010582200816420258, "sim_compute_robot_state-parked1": 0.010376281425601146, "sim_compute_robot_state-parked2": 0.010301980815949989, "sim_compute_robot_state-parked3": 0.010569638893252511, "sim_compute_robot_state-parked4": 0.010592319926277537, "sim_compute_robot_state-parked5": 0.01046853769020956}, "ETHZ_autolab_technical_track-0-0-ego1": {"driven_any": 1.1453950378389337, "get_ui_image": 0.1244278344951692, "step_physics": 0.4664810329187112, "survival_time": 3.049999999999997, "driven_lanedir": 1.1436405514435668, "get_state_dump": 0.04654956645652896, "sim_render-ego0": 0.0066097212619468815, "sim_render-ego1": 0.0071473160728079375, "sim_render-ego2": 0.0069966824328313105, "in-drivable-lane": 0.0, "deviation-heading": 0.10165407762783273, "agent_compute-ego0": 0.1089764618482746, "agent_compute-ego1": 0.10872864723205566, "agent_compute-ego2": 0.10738599495809588, "complete-iteration": 1.1913490373580182, "set_robot_commands": 0.00651144199684018, "deviation-center-line": 0.07907388948535099, "driven_lanedir_consec": 1.1436405514435668, "sim_compute_sim_state": 0.07636468136896853, "sim_compute_performance-ego0": 0.005757961116853307, "sim_compute_performance-ego1": 0.005831780980844967, "sim_compute_performance-ego2": 0.006010071175997374, "sim_compute_robot_state-ego0": 0.010417559107796091, "sim_compute_robot_state-ego1": 0.010289219559216108, "sim_compute_robot_state-ego2": 0.010220351766367429, "sim_compute_robot_state-parked0": 0.010582200816420258, "sim_compute_robot_state-parked1": 0.010376281425601146, "sim_compute_robot_state-parked2": 0.010301980815949989, "sim_compute_robot_state-parked3": 0.010569638893252511, "sim_compute_robot_state-parked4": 0.010592319926277537, "sim_compute_robot_state-parked5": 0.01046853769020956}, "ETHZ_autolab_technical_track-0-0-ego2": {"driven_any": 1.1568497839213312, "get_ui_image": 0.1244278344951692, "step_physics": 0.4664810329187112, "survival_time": 3.049999999999997, "driven_lanedir": 1.1507789184828263, "get_state_dump": 0.04654956645652896, "sim_render-ego0": 0.0066097212619468815, "sim_render-ego1": 0.0071473160728079375, "sim_render-ego2": 0.0069966824328313105, "in-drivable-lane": 0.0, "deviation-heading": 0.31751010502754223, "agent_compute-ego0": 0.1089764618482746, "agent_compute-ego1": 0.10872864723205566, "agent_compute-ego2": 0.10738599495809588, "complete-iteration": 1.1913490373580182, "set_robot_commands": 0.00651144199684018, "deviation-center-line": 0.08751498599190424, "driven_lanedir_consec": 1.1507789184828263, "sim_compute_sim_state": 0.07636468136896853, "sim_compute_performance-ego0": 0.005757961116853307, "sim_compute_performance-ego1": 0.005831780980844967, "sim_compute_performance-ego2": 0.006010071175997374, "sim_compute_robot_state-ego0": 0.010417559107796091, "sim_compute_robot_state-ego1": 0.010289219559216108, "sim_compute_robot_state-ego2": 0.010220351766367429, "sim_compute_robot_state-parked0": 0.010582200816420258, "sim_compute_robot_state-parked1": 0.010376281425601146, "sim_compute_robot_state-parked2": 0.010301980815949989, "sim_compute_robot_state-parked3": 0.010569638893252511, "sim_compute_robot_state-parked4": 0.010592319926277537, "sim_compute_robot_state-parked5": 0.01046853769020956}, "ETHZ_autolab_technical_track-0-1-ego0": {"driven_any": 0.47016652758152266, "get_ui_image": 0.1294010672075995, "step_physics": 0.49591127757368414, "survival_time": 1.4500000000000006, "driven_lanedir": 0.45606394535054506, "get_state_dump": 0.04632371869580499, "sim_render-ego0": 0.00670185582391147, "sim_render-ego1": 0.006876526207759462, "sim_render-ego2": 0.006768432156793003, "in-drivable-lane": 0.0, "deviation-heading": 0.27875254758081713, "agent_compute-ego0": 0.1040080662431388, "agent_compute-ego1": 0.10340508921393032, "agent_compute-ego2": 0.10405415502087824, "complete-iteration": 1.1979378174091209, "set_robot_commands": 0.006281737623543575, "deviation-center-line": 0.09248426469898884, "driven_lanedir_consec": 0.45606394535054506, "sim_compute_sim_state": 0.06416639788397427, "sim_compute_performance-ego0": 0.005903498879794417, "sim_compute_performance-ego1": 0.005553812816225249, "sim_compute_performance-ego2": 0.005824228812908304, "sim_compute_robot_state-ego0": 0.010847765823890423, "sim_compute_robot_state-ego1": 0.00999501655841696, "sim_compute_robot_state-ego2": 0.010362460695464036, "sim_compute_robot_state-parked0": 0.010303020477294922, "sim_compute_robot_state-parked1": 0.010367886773471174, "sim_compute_robot_state-parked2": 0.010682623961876178, "sim_compute_robot_state-parked3": 0.010189179716439085, "sim_compute_robot_state-parked4": 0.009819704910804486, "sim_compute_robot_state-parked5": 0.010456167418381264}, "ETHZ_autolab_technical_track-0-1-ego1": {"driven_any": 0.47447651877753183, "get_ui_image": 0.1294010672075995, "step_physics": 0.49591127757368414, "survival_time": 1.4500000000000006, "driven_lanedir": 0.4737678662434752, "get_state_dump": 0.04632371869580499, "sim_render-ego0": 0.00670185582391147, "sim_render-ego1": 0.006876526207759462, "sim_render-ego2": 0.006768432156793003, "in-drivable-lane": 0.0, "deviation-heading": 0.06030033220904063, "agent_compute-ego0": 0.1040080662431388, "agent_compute-ego1": 0.10340508921393032, "agent_compute-ego2": 0.10405415502087824, "complete-iteration": 1.1979378174091209, "set_robot_commands": 0.006281737623543575, "deviation-center-line": 0.043417853796394214, "driven_lanedir_consec": 0.4737678662434752, "sim_compute_sim_state": 0.06416639788397427, "sim_compute_performance-ego0": 0.005903498879794417, "sim_compute_performance-ego1": 0.005553812816225249, "sim_compute_performance-ego2": 0.005824228812908304, "sim_compute_robot_state-ego0": 0.010847765823890423, "sim_compute_robot_state-ego1": 0.00999501655841696, "sim_compute_robot_state-ego2": 0.010362460695464036, "sim_compute_robot_state-parked0": 0.010303020477294922, "sim_compute_robot_state-parked1": 0.010367886773471174, "sim_compute_robot_state-parked2": 0.010682623961876178, "sim_compute_robot_state-parked3": 0.010189179716439085, "sim_compute_robot_state-parked4": 0.009819704910804486, "sim_compute_robot_state-parked5": 0.010456167418381264}, "ETHZ_autolab_technical_track-0-1-ego2": {"driven_any": 0.4698221645458976, "get_ui_image": 0.1294010672075995, "step_physics": 0.49591127757368414, "survival_time": 1.4500000000000006, "driven_lanedir": 0.466083689689913, "get_state_dump": 0.04632371869580499, "sim_render-ego0": 0.00670185582391147, "sim_render-ego1": 0.006876526207759462, "sim_render-ego2": 0.006768432156793003, "in-drivable-lane": 0.0, "deviation-heading": 0.20900628716941683, "agent_compute-ego0": 0.1040080662431388, "agent_compute-ego1": 0.10340508921393032, "agent_compute-ego2": 0.10405415502087824, "complete-iteration": 1.1979378174091209, "set_robot_commands": 0.006281737623543575, "deviation-center-line": 0.07423965509698524, "driven_lanedir_consec": 0.466083689689913, "sim_compute_sim_state": 0.06416639788397427, "sim_compute_performance-ego0": 0.005903498879794417, "sim_compute_performance-ego1": 0.005553812816225249, "sim_compute_performance-ego2": 0.005824228812908304, "sim_compute_robot_state-ego0": 0.010847765823890423, "sim_compute_robot_state-ego1": 0.00999501655841696, "sim_compute_robot_state-ego2": 0.010362460695464036, "sim_compute_robot_state-parked0": 0.010303020477294922, "sim_compute_robot_state-parked1": 0.010367886773471174, "sim_compute_robot_state-parked2": 0.010682623961876178, "sim_compute_robot_state-parked3": 0.010189179716439085, "sim_compute_robot_state-parked4": 0.009819704910804486, "sim_compute_robot_state-parked5": 0.010456167418381264}, "ETHZ_autolab_technical_track-0-2-ego0": {"driven_any": 0.47016652758152266, "get_ui_image": 0.12721722701500202, "step_physics": 0.4884848183599011, "survival_time": 1.4500000000000006, "driven_lanedir": 0.45606394535054506, "get_state_dump": 0.04606934251456425, "sim_render-ego0": 0.007087995266092235, "sim_render-ego1": 0.007197108762017612, "sim_render-ego2": 0.006947879133553341, "in-drivable-lane": 0.0, "deviation-heading": 0.27875254758081713, "agent_compute-ego0": 0.10600561109082451, "agent_compute-ego1": 0.10363600171845534, "agent_compute-ego2": 0.10206272684294602, "complete-iteration": 1.1928585479999412, "set_robot_commands": 0.006842366580305429, "deviation-center-line": 0.09248426469898884, "driven_lanedir_consec": 0.45606394535054506, "sim_compute_sim_state": 0.06524085998535156, "sim_compute_performance-ego0": 0.00606248296540359, "sim_compute_performance-ego1": 0.0057135368215626686, "sim_compute_performance-ego2": 0.005694586655189251, "sim_compute_robot_state-ego0": 0.010907222484720164, "sim_compute_robot_state-ego1": 0.010337796704522494, "sim_compute_robot_state-ego2": 0.010229891744153253, "sim_compute_robot_state-parked0": 0.010475150470075936, "sim_compute_robot_state-parked1": 0.010494462374983162, "sim_compute_robot_state-parked2": 0.010731286016003838, "sim_compute_robot_state-parked3": 0.010184995059309334, "sim_compute_robot_state-parked4": 0.010822592110469424, "sim_compute_robot_state-parked5": 0.011002219956496664}, "ETHZ_autolab_technical_track-0-2-ego1": {"driven_any": 0.47447651877753183, "get_ui_image": 0.12721722701500202, "step_physics": 0.4884848183599011, "survival_time": 1.4500000000000006, "driven_lanedir": 0.4737678662434752, "get_state_dump": 0.04606934251456425, "sim_render-ego0": 0.007087995266092235, "sim_render-ego1": 0.007197108762017612, "sim_render-ego2": 0.006947879133553341, "in-drivable-lane": 0.0, "deviation-heading": 0.06030033220904063, "agent_compute-ego0": 0.10600561109082451, "agent_compute-ego1": 0.10363600171845534, "agent_compute-ego2": 0.10206272684294602, "complete-iteration": 1.1928585479999412, "set_robot_commands": 0.006842366580305429, "deviation-center-line": 0.043417853796394214, "driven_lanedir_consec": 0.4737678662434752, "sim_compute_sim_state": 0.06524085998535156, "sim_compute_performance-ego0": 0.00606248296540359, "sim_compute_performance-ego1": 0.0057135368215626686, "sim_compute_performance-ego2": 0.005694586655189251, "sim_compute_robot_state-ego0": 0.010907222484720164, "sim_compute_robot_state-ego1": 0.010337796704522494, "sim_compute_robot_state-ego2": 0.010229891744153253, "sim_compute_robot_state-parked0": 0.010475150470075936, "sim_compute_robot_state-parked1": 0.010494462374983162, "sim_compute_robot_state-parked2": 0.010731286016003838, "sim_compute_robot_state-parked3": 0.010184995059309334, "sim_compute_robot_state-parked4": 0.010822592110469424, "sim_compute_robot_state-parked5": 0.011002219956496664}, "ETHZ_autolab_technical_track-0-2-ego2": {"driven_any": 0.4698221645458976, "get_ui_image": 0.12721722701500202, "step_physics": 0.4884848183599011, "survival_time": 1.4500000000000006, "driven_lanedir": 0.466083689689913, "get_state_dump": 0.04606934251456425, "sim_render-ego0": 0.007087995266092235, "sim_render-ego1": 0.007197108762017612, "sim_render-ego2": 0.006947879133553341, "in-drivable-lane": 0.0, "deviation-heading": 0.20900628716941683, "agent_compute-ego0": 0.10600561109082451, "agent_compute-ego1": 0.10363600171845534, "agent_compute-ego2": 0.10206272684294602, "complete-iteration": 1.1928585479999412, "set_robot_commands": 0.006842366580305429, "deviation-center-line": 0.07423965509698524, "driven_lanedir_consec": 0.466083689689913, "sim_compute_sim_state": 0.06524085998535156, "sim_compute_performance-ego0": 0.00606248296540359, "sim_compute_performance-ego1": 0.0057135368215626686, "sim_compute_performance-ego2": 0.005694586655189251, "sim_compute_robot_state-ego0": 0.010907222484720164, "sim_compute_robot_state-ego1": 0.010337796704522494, "sim_compute_robot_state-ego2": 0.010229891744153253, "sim_compute_robot_state-parked0": 0.010475150470075936, "sim_compute_robot_state-parked1": 0.010494462374983162, "sim_compute_robot_state-parked2": 0.010731286016003838, "sim_compute_robot_state-parked3": 0.010184995059309334, "sim_compute_robot_state-parked4": 0.010822592110469424, "sim_compute_robot_state-parked5": 0.011002219956496664}}
set_robot_commands_max0.006842366580305429
set_robot_commands_mean0.006545182066896395
set_robot_commands_median0.00651144199684018
set_robot_commands_min0.006281737623543575
sim_compute_performance-ego0_max0.00606248296540359
sim_compute_performance-ego0_mean0.005907980987350438
sim_compute_performance-ego0_median0.005903498879794417
sim_compute_performance-ego0_min0.005757961116853307
sim_compute_performance-ego1_max0.005831780980844967
sim_compute_performance-ego1_mean0.005699710206210962
sim_compute_performance-ego1_median0.0057135368215626686
sim_compute_performance-ego1_min0.005553812816225249
sim_compute_performance-ego2_max0.006010071175997374
sim_compute_performance-ego2_mean0.0058429622146983105
sim_compute_performance-ego2_median0.005824228812908304
sim_compute_performance-ego2_min0.005694586655189251
sim_compute_robot_state-ego0_max0.010907222484720164
sim_compute_robot_state-ego0_mean0.01072418247213556
sim_compute_robot_state-ego0_median0.010847765823890423
sim_compute_robot_state-ego0_min0.010417559107796091
sim_compute_robot_state-ego1_max0.010337796704522494
sim_compute_robot_state-ego1_mean0.010207344274051853
sim_compute_robot_state-ego1_median0.010289219559216108
sim_compute_robot_state-ego1_min0.00999501655841696
sim_compute_robot_state-ego2_max0.010362460695464036
sim_compute_robot_state-ego2_mean0.010270901401994903
sim_compute_robot_state-ego2_median0.010229891744153253
sim_compute_robot_state-ego2_min0.010220351766367429
sim_compute_robot_state-parked0_max0.010582200816420258
sim_compute_robot_state-parked0_mean0.01045345725459704
sim_compute_robot_state-parked0_median0.010475150470075936
sim_compute_robot_state-parked0_min0.010303020477294922
sim_compute_robot_state-parked1_max0.010494462374983162
sim_compute_robot_state-parked1_mean0.010412876858018496
sim_compute_robot_state-parked1_median0.010376281425601146
sim_compute_robot_state-parked1_min0.010367886773471174
sim_compute_robot_state-parked2_max0.010731286016003838
sim_compute_robot_state-parked2_mean0.010571963597943334
sim_compute_robot_state-parked2_median0.010682623961876178
sim_compute_robot_state-parked2_min0.010301980815949989
sim_compute_robot_state-parked3_max0.010569638893252511
sim_compute_robot_state-parked3_mean0.010314604556333644
sim_compute_robot_state-parked3_median0.010189179716439085
sim_compute_robot_state-parked3_min0.010184995059309334
sim_compute_robot_state-parked4_max0.010822592110469424
sim_compute_robot_state-parked4_mean0.010411538982517147
sim_compute_robot_state-parked4_median0.010592319926277537
sim_compute_robot_state-parked4_min0.009819704910804486
sim_compute_robot_state-parked5_max0.011002219956496664
sim_compute_robot_state-parked5_mean0.010642308355029164
sim_compute_robot_state-parked5_median0.01046853769020956
sim_compute_robot_state-parked5_min0.010456167418381264
sim_compute_sim_state_max0.07636468136896853
sim_compute_sim_state_mean0.06859064641276479
sim_compute_sim_state_median0.06524085998535156
sim_compute_sim_state_min0.06416639788397427
sim_render-ego0_max0.007087995266092235
sim_render-ego0_mean0.0067998574506501945
sim_render-ego0_median0.00670185582391147
sim_render-ego0_min0.0066097212619468815
sim_render-ego1_max0.007197108762017612
sim_render-ego1_mean0.007073650347528337
sim_render-ego1_median0.0071473160728079375
sim_render-ego1_min0.006876526207759462
sim_render-ego2_max0.0069966824328313105
sim_render-ego2_mean0.006904331241059217
sim_render-ego2_median0.006947879133553341
sim_render-ego2_min0.006768432156793003
simulation-passed1
step_physics_max0.49591127757368414
step_physics_mean0.4836257096174321
step_physics_median0.4884848183599011
step_physics_min0.4664810329187112
survival_time_max3.049999999999997
survival_time_mean1.9833333333333327
survival_time_min1.4500000000000006

Highlights

33238

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-0-2

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.