Duckietown Challenges Home Challenges Submissions

Job 33245

Job ID33245
submission6737
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI_multi-sim-validation
stepLFVIv-sim
statusaborted
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorp-1
date started
date completed
duration0:05:19
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5312781393072172
survival_time_median1.9000000000000004
deviation-center-line_median0.07028138074316916
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.11845956310149162
agent_compute-ego0_mean0.11286318797791732
agent_compute-ego0_median0.1128631879779173
agent_compute-ego0_min0.107266812854343
agent_compute-ego1_max0.12060410745682255
agent_compute-ego1_mean0.11360270464292135
agent_compute-ego1_median0.11360270464292135
agent_compute-ego1_min0.10660130182902018
agent_compute-ego2_max0.11730621707054877
agent_compute-ego2_mean0.11280063283913452
agent_compute-ego2_median0.11280063283913452
agent_compute-ego2_min0.10829504860772028
complete-iteration_max1.3641458788225729
complete-iteration_mean1.3482714923906498
complete-iteration_median1.3482714923906498
complete-iteration_min1.3323971059587267
deviation-center-line_max0.1422086847062757
deviation-center-line_mean0.08177838646431576
deviation-center-line_min0.028820257885917265
deviation-heading_max0.4824961018568489
deviation-heading_mean0.26062920378111515
deviation-heading_median0.2068574859184334
deviation-heading_min0.17534142528065275
driven_any_max0.790313747596692
driven_any_mean0.5962468967456476
driven_any_median0.5340597024347415
driven_any_min0.4622704198863816
driven_lanedir_consec_max0.7437120996444373
driven_lanedir_consec_mean0.5833845233730622
driven_lanedir_consec_min0.44945449265633375
driven_lanedir_max0.7600010640095247
driven_lanedir_mean0.5860993507672435
driven_lanedir_median0.5312781393072172
driven_lanedir_min0.44945449265633375
get_state_dump_max0.0481378714243571
get_state_dump_mean0.04741275259243544
get_state_dump_median0.04741275259243545
get_state_dump_min0.0466876337605138
get_ui_image_max0.10193254152933756
get_ui_image_mean0.101852051929761
get_ui_image_median0.101852051929761
get_ui_image_min0.10177156233018445
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego0": {"driven_any": 0.4622704198863816, "get_ui_image": 0.10177156233018445, "step_physics": 0.6166200714726602, "survival_time": 1.5500000000000007, "driven_lanedir": 0.44945449265633375, "get_state_dump": 0.0466876337605138, "sim_render-ego0": 0.007407596034388389, "sim_render-ego1": 0.007418355634135585, "sim_render-ego2": 0.007171915423485541, "in-drivable-lane": 0.0, "deviation-heading": 0.3154777821472333, "agent_compute-ego0": 0.11845956310149162, "agent_compute-ego1": 0.12060410745682255, "agent_compute-ego2": 0.11730621707054877, "complete-iteration": 1.3641458788225729, "set_robot_commands": 0.006740216285951676, "deviation-center-line": 0.1422086847062757, "driven_lanedir_consec": 0.44945449265633375, "sim_compute_sim_state": 0.08241658826028148, "sim_compute_performance-ego0": 0.006241121599751134, "sim_compute_performance-ego1": 0.00611582879097231, "sim_compute_performance-ego2": 0.00636759881050356, "sim_compute_robot_state-ego0": 0.011011223639211348, "sim_compute_robot_state-ego1": 0.010827018368628717, "sim_compute_robot_state-ego2": 0.011047770900111043, "sim_compute_robot_state-parked0": 0.010927992482339182, "sim_compute_robot_state-parked1": 0.010845991872972058, "sim_compute_robot_state-parked2": 0.01089255271419402, "sim_compute_robot_state-parked3": 0.010627431254233084, "sim_compute_robot_state-parked4": 0.011141869329637098, "sim_compute_robot_state-parked5": 0.011104906758954447}, "udem1-0-0-ego1": {"driven_any": 0.5242352528720003, "get_ui_image": 0.10177156233018445, "step_physics": 0.6166200714726602, "survival_time": 1.5500000000000007, "driven_lanedir": 0.5167561435595562, "get_state_dump": 0.0466876337605138, "sim_render-ego0": 0.007407596034388389, "sim_render-ego1": 0.007418355634135585, "sim_render-ego2": 0.007171915423485541, "in-drivable-lane": 0.0, "deviation-heading": 0.19534682121694333, "agent_compute-ego0": 0.11845956310149162, "agent_compute-ego1": 0.12060410745682255, "agent_compute-ego2": 0.11730621707054877, "complete-iteration": 1.3641458788225729, "set_robot_commands": 0.006740216285951676, "deviation-center-line": 0.05824384368964062, "driven_lanedir_consec": 0.5167561435595562, "sim_compute_sim_state": 0.08241658826028148, "sim_compute_performance-ego0": 0.006241121599751134, "sim_compute_performance-ego1": 0.00611582879097231, "sim_compute_performance-ego2": 0.00636759881050356, "sim_compute_robot_state-ego0": 0.011011223639211348, "sim_compute_robot_state-ego1": 0.010827018368628717, "sim_compute_robot_state-ego2": 0.011047770900111043, "sim_compute_robot_state-parked0": 0.010927992482339182, "sim_compute_robot_state-parked1": 0.010845991872972058, "sim_compute_robot_state-parked2": 0.01089255271419402, "sim_compute_robot_state-parked3": 0.010627431254233084, "sim_compute_robot_state-parked4": 0.011141869329637098, "sim_compute_robot_state-parked5": 0.011104906758954447}, "udem1-0-0-ego2": {"driven_any": 0.5292407683432049, "get_ui_image": 0.10177156233018445, "step_physics": 0.6166200714726602, "survival_time": 1.5500000000000007, "driven_lanedir": 0.5268426551820218, "get_state_dump": 0.0466876337605138, "sim_render-ego0": 0.007407596034388389, "sim_render-ego1": 0.007418355634135585, "sim_render-ego2": 0.007171915423485541, "in-drivable-lane": 0.0, "deviation-heading": 0.17674494156508927, "agent_compute-ego0": 0.11845956310149162, "agent_compute-ego1": 0.12060410745682255, "agent_compute-ego2": 0.11730621707054877, "complete-iteration": 1.3641458788225729, "set_robot_commands": 0.006740216285951676, "deviation-center-line": 0.028820257885917265, "driven_lanedir_consec": 0.5268426551820218, "sim_compute_sim_state": 0.08241658826028148, "sim_compute_performance-ego0": 0.006241121599751134, "sim_compute_performance-ego1": 0.00611582879097231, "sim_compute_performance-ego2": 0.00636759881050356, "sim_compute_robot_state-ego0": 0.011011223639211348, "sim_compute_robot_state-ego1": 0.010827018368628717, "sim_compute_robot_state-ego2": 0.011047770900111043, "sim_compute_robot_state-parked0": 0.010927992482339182, "sim_compute_robot_state-parked1": 0.010845991872972058, "sim_compute_robot_state-parked2": 0.01089255271419402, "sim_compute_robot_state-parked3": 0.010627431254233084, "sim_compute_robot_state-parked4": 0.011141869329637098, "sim_compute_robot_state-parked5": 0.011104906758954447}, "udem1-0-1-ego0": {"driven_any": 0.5388786365262782, "get_ui_image": 0.10193254152933756, "step_physics": 0.5865682495964898, "survival_time": 2.25, "driven_lanedir": 0.5357136234324127, "get_state_dump": 0.0481378714243571, "sim_render-ego0": 0.007651170094807942, "sim_render-ego1": 0.00770621829562717, "sim_render-ego2": 0.007395177417331271, "in-drivable-lane": 0.0, "deviation-heading": 0.21836815061992348, "agent_compute-ego0": 0.107266812854343, "agent_compute-ego1": 0.10660130182902018, "agent_compute-ego2": 0.10829504860772028, "complete-iteration": 1.3323971059587267, "set_robot_commands": 0.007091061274210612, "deviation-center-line": 0.1364929929892348, "driven_lanedir_consec": 0.5357136234324127, "sim_compute_sim_state": 0.10885764757792156, "sim_compute_performance-ego0": 0.006557067235310872, "sim_compute_performance-ego1": 0.006494405534532335, "sim_compute_performance-ego2": 0.006178961859809028, "sim_compute_robot_state-ego0": 0.012042771445380317, "sim_compute_robot_state-ego1": 0.011171595255533854, "sim_compute_robot_state-ego2": 0.011021047168307834, "sim_compute_robot_state-parked0": 0.011026679144965275, "sim_compute_robot_state-parked1": 0.010898362265692817, "sim_compute_robot_state-parked2": 0.010719415876600476, "sim_compute_robot_state-parked3": 0.01150428983900282, "sim_compute_robot_state-parked4": 0.011470248964097764, "sim_compute_robot_state-parked5": 0.0111347410413954}, "udem1-0-1-ego1": {"driven_any": 0.7325425552493282, "get_ui_image": 0.10193254152933756, "step_physics": 0.5865682495964898, "survival_time": 2.25, "driven_lanedir": 0.7278281257636117, "get_state_dump": 0.0481378714243571, "sim_render-ego0": 0.007651170094807942, "sim_render-ego1": 0.00770621829562717, "sim_render-ego2": 0.007395177417331271, "in-drivable-lane": 0.0, "deviation-heading": 0.17534142528065275, "agent_compute-ego0": 0.107266812854343, "agent_compute-ego1": 0.10660130182902018, "agent_compute-ego2": 0.10829504860772028, "complete-iteration": 1.3323971059587267, "set_robot_commands": 0.007091061274210612, "deviation-center-line": 0.042585621718128394, "driven_lanedir_consec": 0.7278281257636117, "sim_compute_sim_state": 0.10885764757792156, "sim_compute_performance-ego0": 0.006557067235310872, "sim_compute_performance-ego1": 0.006494405534532335, "sim_compute_performance-ego2": 0.006178961859809028, "sim_compute_robot_state-ego0": 0.012042771445380317, "sim_compute_robot_state-ego1": 0.011171595255533854, "sim_compute_robot_state-ego2": 0.011021047168307834, "sim_compute_robot_state-parked0": 0.011026679144965275, "sim_compute_robot_state-parked1": 0.010898362265692817, "sim_compute_robot_state-parked2": 0.010719415876600476, "sim_compute_robot_state-parked3": 0.01150428983900282, "sim_compute_robot_state-parked4": 0.011470248964097764, "sim_compute_robot_state-parked5": 0.0111347410413954}, "udem1-0-1-ego2": {"driven_any": 0.790313747596692, "get_ui_image": 0.10193254152933756, "step_physics": 0.5865682495964898, "survival_time": 2.25, "driven_lanedir": 0.7600010640095247, "get_state_dump": 0.0481378714243571, "sim_render-ego0": 0.007651170094807942, "sim_render-ego1": 0.00770621829562717, "sim_render-ego2": 0.007395177417331271, "in-drivable-lane": 0.0, "deviation-heading": 0.4824961018568489, "agent_compute-ego0": 0.107266812854343, "agent_compute-ego1": 0.10660130182902018, "agent_compute-ego2": 0.10829504860772028, "complete-iteration": 1.3323971059587267, "set_robot_commands": 0.007091061274210612, "deviation-center-line": 0.0823189177966977, "driven_lanedir_consec": 0.7437120996444373, "sim_compute_sim_state": 0.10885764757792156, "sim_compute_performance-ego0": 0.006557067235310872, "sim_compute_performance-ego1": 0.006494405534532335, "sim_compute_performance-ego2": 0.006178961859809028, "sim_compute_robot_state-ego0": 0.012042771445380317, "sim_compute_robot_state-ego1": 0.011171595255533854, "sim_compute_robot_state-ego2": 0.011021047168307834, "sim_compute_robot_state-parked0": 0.011026679144965275, "sim_compute_robot_state-parked1": 0.010898362265692817, "sim_compute_robot_state-parked2": 0.010719415876600476, "sim_compute_robot_state-parked3": 0.01150428983900282, "sim_compute_robot_state-parked4": 0.011470248964097764, "sim_compute_robot_state-parked5": 0.0111347410413954}}
set_robot_commands_max0.007091061274210612
set_robot_commands_mean0.006915638780081143
set_robot_commands_median0.006915638780081144
set_robot_commands_min0.006740216285951676
sim_compute_performance-ego0_max0.006557067235310872
sim_compute_performance-ego0_mean0.006399094417531004
sim_compute_performance-ego0_median0.006399094417531003
sim_compute_performance-ego0_min0.006241121599751134
sim_compute_performance-ego1_max0.006494405534532335
sim_compute_performance-ego1_mean0.006305117162752324
sim_compute_performance-ego1_median0.006305117162752323
sim_compute_performance-ego1_min0.00611582879097231
sim_compute_performance-ego2_max0.00636759881050356
sim_compute_performance-ego2_mean0.006273280335156293
sim_compute_performance-ego2_median0.006273280335156294
sim_compute_performance-ego2_min0.006178961859809028
sim_compute_robot_state-ego0_max0.012042771445380317
sim_compute_robot_state-ego0_mean0.01152699754229583
sim_compute_robot_state-ego0_median0.011526997542295832
sim_compute_robot_state-ego0_min0.011011223639211348
sim_compute_robot_state-ego1_max0.011171595255533854
sim_compute_robot_state-ego1_mean0.010999306812081285
sim_compute_robot_state-ego1_median0.010999306812081285
sim_compute_robot_state-ego1_min0.010827018368628717
sim_compute_robot_state-ego2_max0.011047770900111043
sim_compute_robot_state-ego2_mean0.011034409034209438
sim_compute_robot_state-ego2_median0.01103440903420944
sim_compute_robot_state-ego2_min0.011021047168307834
sim_compute_robot_state-parked0_max0.011026679144965275
sim_compute_robot_state-parked0_mean0.010977335813652228
sim_compute_robot_state-parked0_median0.01097733581365223
sim_compute_robot_state-parked0_min0.010927992482339182
sim_compute_robot_state-parked1_max0.010898362265692817
sim_compute_robot_state-parked1_mean0.01087217706933244
sim_compute_robot_state-parked1_median0.010872177069332438
sim_compute_robot_state-parked1_min0.010845991872972058
sim_compute_robot_state-parked2_max0.01089255271419402
sim_compute_robot_state-parked2_mean0.010805984295397248
sim_compute_robot_state-parked2_median0.01080598429539725
sim_compute_robot_state-parked2_min0.010719415876600476
sim_compute_robot_state-parked3_max0.01150428983900282
sim_compute_robot_state-parked3_mean0.01106586054661795
sim_compute_robot_state-parked3_median0.011065860546617953
sim_compute_robot_state-parked3_min0.010627431254233084
sim_compute_robot_state-parked4_max0.011470248964097764
sim_compute_robot_state-parked4_mean0.01130605914686743
sim_compute_robot_state-parked4_median0.011306059146867432
sim_compute_robot_state-parked4_min0.011141869329637098
sim_compute_robot_state-parked5_max0.0111347410413954
sim_compute_robot_state-parked5_mean0.011119823900174923
sim_compute_robot_state-parked5_median0.011119823900174923
sim_compute_robot_state-parked5_min0.011104906758954447
sim_compute_sim_state_max0.10885764757792156
sim_compute_sim_state_mean0.09563711791910152
sim_compute_sim_state_median0.09563711791910152
sim_compute_sim_state_min0.08241658826028148
sim_render-ego0_max0.007651170094807942
sim_render-ego0_mean0.007529383064598165
sim_render-ego0_median0.007529383064598166
sim_render-ego0_min0.007407596034388389
sim_render-ego1_max0.00770621829562717
sim_render-ego1_mean0.007562286964881378
sim_render-ego1_median0.007562286964881378
sim_render-ego1_min0.007418355634135585
sim_render-ego2_max0.007395177417331271
sim_render-ego2_mean0.007283546420408405
sim_render-ego2_median0.007283546420408406
sim_render-ego2_min0.007171915423485541
simulation-passed1
step_physics_max0.6166200714726602
step_physics_mean0.601594160534575
step_physics_median0.6015941605345749
step_physics_min0.5865682495964898
survival_time_max2.25
survival_time_mean1.9000000000000004
survival_time_min1.5500000000000007

Highlights

33245

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.