Duckietown Challenges Home Challenges Submissions

Job 35204

Job ID35204
submission6737
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI_multi-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg04-cdd7667d8062-1
date started
date completed
duration0:04:26
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4397878868260878
survival_time_median1.3750000000000004
deviation-center-line_median0.040802525714134806
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.1223645563478823
agent_compute-ego0_mean0.12058573172836708
agent_compute-ego0_median0.12058573172836708
agent_compute-ego0_min0.11880690710885183
agent_compute-ego1_max0.1237683649416323
agent_compute-ego1_mean0.11860568671630171
agent_compute-ego1_median0.11860568671630171
agent_compute-ego1_min0.11344300849097116
agent_compute-ego2_max0.11931999524434408
agent_compute-ego2_mean0.11485512483687628
agent_compute-ego2_median0.11485512483687628
agent_compute-ego2_min0.11039025442940847
complete-iteration_max1.3001560105217829
complete-iteration_mean1.2894581239374858
complete-iteration_median1.2894581239374858
complete-iteration_min1.2787602373531886
deviation-center-line_max0.10847779639482932
deviation-center-line_mean0.052399687436842625
deviation-center-line_min0.024879178415574753
deviation-heading_max0.3074862628788623
deviation-heading_mean0.17049843656217023
deviation-heading_median0.15296770689989037
deviation-heading_min0.0977625559646183
driven_any_max0.4649076710764489
driven_any_mean0.4356275031276507
driven_any_median0.4425348988139801
driven_any_min0.38716225909464774
driven_lanedir_consec_max0.4627380495960094
driven_lanedir_consec_mean0.4309171626739024
driven_lanedir_consec_min0.3735935002003674
driven_lanedir_max0.4627380495960094
driven_lanedir_mean0.4309171626739024
driven_lanedir_median0.4397878868260878
driven_lanedir_min0.3735935002003674
get_state_dump_max0.049866579197071215
get_state_dump_mean0.049864464966708384
get_state_dump_median0.04986446496670839
get_state_dump_min0.04986235073634556
get_ui_image_max0.0994577237537929
get_ui_image_mean0.09861222934470604
get_ui_image_median0.09861222934470606
get_ui_image_min0.09776673493561922
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego0": {"driven_any": 0.38716225909464774, "get_ui_image": 0.09776673493561922, "step_physics": 0.5738348431057401, "survival_time": 1.3500000000000003, "driven_lanedir": 0.3735935002003674, "get_state_dump": 0.049866579197071215, "sim_render-ego0": 0.009253051545884874, "sim_render-ego1": 0.008969995710584853, "sim_render-ego2": 0.008823491908885815, "in-drivable-lane": 0.0, "deviation-heading": 0.3074862628788623, "agent_compute-ego0": 0.1223645563478823, "agent_compute-ego1": 0.1237683649416323, "agent_compute-ego2": 0.11931999524434408, "complete-iteration": 1.3001560105217829, "set_robot_commands": 0.007057322396172417, "deviation-center-line": 0.10847779639482932, "driven_lanedir_consec": 0.3735935002003674, "sim_compute_sim_state": 0.049632522794935435, "sim_compute_performance-ego0": 0.006456357461434824, "sim_compute_performance-ego1": 0.005963484446207683, "sim_compute_performance-ego2": 0.005755027135213216, "sim_compute_robot_state-ego0": 0.011472993426852755, "sim_compute_robot_state-ego1": 0.011058904506542065, "sim_compute_robot_state-ego2": 0.011335699646561236, "sim_compute_robot_state-parked0": 0.010484969174420392, "sim_compute_robot_state-parked1": 0.00999221095332393, "sim_compute_robot_state-parked2": 0.010050764790287724, "sim_compute_robot_state-parked3": 0.01095687018500434, "sim_compute_robot_state-parked4": 0.010821669190018266, "sim_compute_robot_state-parked5": 0.0101030049500642}, "udem1-0-0-ego1": {"driven_any": 0.4491443848844155, "get_ui_image": 0.09776673493561922, "step_physics": 0.5738348431057401, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4439881577343803, "get_state_dump": 0.049866579197071215, "sim_render-ego0": 0.009253051545884874, "sim_render-ego1": 0.008969995710584853, "sim_render-ego2": 0.008823491908885815, "in-drivable-lane": 0.0, "deviation-heading": 0.1485957701009755, "agent_compute-ego0": 0.1223645563478823, "agent_compute-ego1": 0.1237683649416323, "agent_compute-ego2": 0.11931999524434408, "complete-iteration": 1.3001560105217829, "set_robot_commands": 0.007057322396172417, "deviation-center-line": 0.04429211580094121, "driven_lanedir_consec": 0.4439881577343803, "sim_compute_sim_state": 0.049632522794935435, "sim_compute_performance-ego0": 0.006456357461434824, "sim_compute_performance-ego1": 0.005963484446207683, "sim_compute_performance-ego2": 0.005755027135213216, "sim_compute_robot_state-ego0": 0.011472993426852755, "sim_compute_robot_state-ego1": 0.011058904506542065, "sim_compute_robot_state-ego2": 0.011335699646561236, "sim_compute_robot_state-parked0": 0.010484969174420392, "sim_compute_robot_state-parked1": 0.00999221095332393, "sim_compute_robot_state-parked2": 0.010050764790287724, "sim_compute_robot_state-parked3": 0.01095687018500434, "sim_compute_robot_state-parked4": 0.010821669190018266, "sim_compute_robot_state-parked5": 0.0101030049500642}, "udem1-0-0-ego2": {"driven_any": 0.42748090608243194, "get_ui_image": 0.09776673493561922, "step_physics": 0.5738348431057401, "survival_time": 1.3500000000000003, "driven_lanedir": 0.42560749486048177, "get_state_dump": 0.049866579197071215, "sim_render-ego0": 0.009253051545884874, "sim_render-ego1": 0.008969995710584853, "sim_render-ego2": 0.008823491908885815, "in-drivable-lane": 0.0, "deviation-heading": 0.1573396436988053, "agent_compute-ego0": 0.1223645563478823, "agent_compute-ego1": 0.1237683649416323, "agent_compute-ego2": 0.11931999524434408, "complete-iteration": 1.3001560105217829, "set_robot_commands": 0.007057322396172417, "deviation-center-line": 0.03334070794094077, "driven_lanedir_consec": 0.42560749486048177, "sim_compute_sim_state": 0.049632522794935435, "sim_compute_performance-ego0": 0.006456357461434824, "sim_compute_performance-ego1": 0.005963484446207683, "sim_compute_performance-ego2": 0.005755027135213216, "sim_compute_robot_state-ego0": 0.011472993426852755, "sim_compute_robot_state-ego1": 0.011058904506542065, "sim_compute_robot_state-ego2": 0.011335699646561236, "sim_compute_robot_state-parked0": 0.010484969174420392, "sim_compute_robot_state-parked1": 0.00999221095332393, "sim_compute_robot_state-parked2": 0.010050764790287724, "sim_compute_robot_state-parked3": 0.01095687018500434, "sim_compute_robot_state-parked4": 0.010821669190018266, "sim_compute_robot_state-parked5": 0.0101030049500642}, "udem1-0-1-ego0": {"driven_any": 0.4649076710764489, "get_ui_image": 0.0994577237537929, "step_physics": 0.5766362547874451, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4627380495960094, "get_state_dump": 0.04986235073634556, "sim_render-ego0": 0.008633758340563093, "sim_render-ego1": 0.008779057434626989, "sim_render-ego2": 0.008895627089909144, "in-drivable-lane": 0.0, "deviation-heading": 0.12532173478605615, "agent_compute-ego0": 0.11880690710885183, "agent_compute-ego1": 0.11344300849097116, "agent_compute-ego2": 0.11039025442940847, "complete-iteration": 1.2787602373531886, "set_robot_commands": 0.006796777248382568, "deviation-center-line": 0.0660953904414413, "driven_lanedir_consec": 0.4627380495960094, "sim_compute_sim_state": 0.049809864589146206, "sim_compute_performance-ego0": 0.006259901182992118, "sim_compute_performance-ego1": 0.006131725651877267, "sim_compute_performance-ego2": 0.006315623010907855, "sim_compute_robot_state-ego0": 0.010433622768947055, "sim_compute_robot_state-ego1": 0.010529739516122, "sim_compute_robot_state-ego2": 0.010788704667772566, "sim_compute_robot_state-parked0": 0.00982128722327096, "sim_compute_robot_state-parked1": 0.010368491922106062, "sim_compute_robot_state-parked2": 0.010195706571851456, "sim_compute_robot_state-parked3": 0.010542750358581545, "sim_compute_robot_state-parked4": 0.010832658835819789, "sim_compute_robot_state-parked5": 0.010647646018436976}, "udem1-0-1-ego1": {"driven_any": 0.4451251223362976, "get_ui_image": 0.0994577237537929, "step_physics": 0.5766362547874451, "survival_time": 1.4000000000000006, "driven_lanedir": 0.44269651956848977, "get_state_dump": 0.04986235073634556, "sim_render-ego0": 0.008633758340563093, "sim_render-ego1": 0.008779057434626989, "sim_render-ego2": 0.008895627089909144, "in-drivable-lane": 0.0, "deviation-heading": 0.0977625559646183, "agent_compute-ego0": 0.11880690710885183, "agent_compute-ego1": 0.11344300849097116, "agent_compute-ego2": 0.11039025442940847, "complete-iteration": 1.2787602373531886, "set_robot_commands": 0.006796777248382568, "deviation-center-line": 0.0373129356273284, "driven_lanedir_consec": 0.44269651956848977, "sim_compute_sim_state": 0.049809864589146206, "sim_compute_performance-ego0": 0.006259901182992118, "sim_compute_performance-ego1": 0.006131725651877267, "sim_compute_performance-ego2": 0.006315623010907855, "sim_compute_robot_state-ego0": 0.010433622768947055, "sim_compute_robot_state-ego1": 0.010529739516122, "sim_compute_robot_state-ego2": 0.010788704667772566, "sim_compute_robot_state-parked0": 0.00982128722327096, "sim_compute_robot_state-parked1": 0.010368491922106062, "sim_compute_robot_state-parked2": 0.010195706571851456, "sim_compute_robot_state-parked3": 0.010542750358581545, "sim_compute_robot_state-parked4": 0.010832658835819789, "sim_compute_robot_state-parked5": 0.010647646018436976}, "udem1-0-1-ego2": {"driven_any": 0.4399446752916626, "get_ui_image": 0.0994577237537929, "step_physics": 0.5766362547874451, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4368792540836859, "get_state_dump": 0.04986235073634556, "sim_render-ego0": 0.008633758340563093, "sim_render-ego1": 0.008779057434626989, "sim_render-ego2": 0.008895627089909144, "in-drivable-lane": 0.0, "deviation-heading": 0.18648465194370367, "agent_compute-ego0": 0.11880690710885183, "agent_compute-ego1": 0.11344300849097116, "agent_compute-ego2": 0.11039025442940847, "complete-iteration": 1.2787602373531886, "set_robot_commands": 0.006796777248382568, "deviation-center-line": 0.024879178415574753, "driven_lanedir_consec": 0.4368792540836859, "sim_compute_sim_state": 0.049809864589146206, "sim_compute_performance-ego0": 0.006259901182992118, "sim_compute_performance-ego1": 0.006131725651877267, "sim_compute_performance-ego2": 0.006315623010907855, "sim_compute_robot_state-ego0": 0.010433622768947055, "sim_compute_robot_state-ego1": 0.010529739516122, "sim_compute_robot_state-ego2": 0.010788704667772566, "sim_compute_robot_state-parked0": 0.00982128722327096, "sim_compute_robot_state-parked1": 0.010368491922106062, "sim_compute_robot_state-parked2": 0.010195706571851456, "sim_compute_robot_state-parked3": 0.010542750358581545, "sim_compute_robot_state-parked4": 0.010832658835819789, "sim_compute_robot_state-parked5": 0.010647646018436976}}
set_robot_commands_max0.007057322396172417
set_robot_commands_mean0.006927049822277493
set_robot_commands_median0.006927049822277493
set_robot_commands_min0.006796777248382568
sim_compute_performance-ego0_max0.006456357461434824
sim_compute_performance-ego0_mean0.006358129322213472
sim_compute_performance-ego0_median0.006358129322213471
sim_compute_performance-ego0_min0.006259901182992118
sim_compute_performance-ego1_max0.006131725651877267
sim_compute_performance-ego1_mean0.006047605049042473
sim_compute_performance-ego1_median0.006047605049042474
sim_compute_performance-ego1_min0.005963484446207683
sim_compute_performance-ego2_max0.006315623010907855
sim_compute_performance-ego2_mean0.006035325073060535
sim_compute_performance-ego2_median0.006035325073060535
sim_compute_performance-ego2_min0.005755027135213216
sim_compute_robot_state-ego0_max0.011472993426852755
sim_compute_robot_state-ego0_mean0.010953308097899904
sim_compute_robot_state-ego0_median0.010953308097899904
sim_compute_robot_state-ego0_min0.010433622768947055
sim_compute_robot_state-ego1_max0.011058904506542065
sim_compute_robot_state-ego1_mean0.010794322011332033
sim_compute_robot_state-ego1_median0.010794322011332033
sim_compute_robot_state-ego1_min0.010529739516122
sim_compute_robot_state-ego2_max0.011335699646561236
sim_compute_robot_state-ego2_mean0.011062202157166905
sim_compute_robot_state-ego2_median0.0110622021571669
sim_compute_robot_state-ego2_min0.010788704667772566
sim_compute_robot_state-parked0_max0.010484969174420392
sim_compute_robot_state-parked0_mean0.010153128198845675
sim_compute_robot_state-parked0_median0.010153128198845675
sim_compute_robot_state-parked0_min0.00982128722327096
sim_compute_robot_state-parked1_max0.010368491922106062
sim_compute_robot_state-parked1_mean0.010180351437715
sim_compute_robot_state-parked1_median0.010180351437714995
sim_compute_robot_state-parked1_min0.00999221095332393
sim_compute_robot_state-parked2_max0.010195706571851456
sim_compute_robot_state-parked2_mean0.010123235681069593
sim_compute_robot_state-parked2_median0.010123235681069593
sim_compute_robot_state-parked2_min0.010050764790287724
sim_compute_robot_state-parked3_max0.01095687018500434
sim_compute_robot_state-parked3_mean0.010749810271792944
sim_compute_robot_state-parked3_median0.01074981027179294
sim_compute_robot_state-parked3_min0.010542750358581545
sim_compute_robot_state-parked4_max0.010832658835819789
sim_compute_robot_state-parked4_mean0.010827164012919027
sim_compute_robot_state-parked4_median0.010827164012919027
sim_compute_robot_state-parked4_min0.010821669190018266
sim_compute_robot_state-parked5_max0.010647646018436976
sim_compute_robot_state-parked5_mean0.010375325484250589
sim_compute_robot_state-parked5_median0.010375325484250589
sim_compute_robot_state-parked5_min0.0101030049500642
sim_compute_sim_state_max0.049809864589146206
sim_compute_sim_state_mean0.04972119369204082
sim_compute_sim_state_median0.049721193692040824
sim_compute_sim_state_min0.049632522794935435
sim_render-ego0_max0.009253051545884874
sim_render-ego0_mean0.008943404943223985
sim_render-ego0_median0.008943404943223984
sim_render-ego0_min0.008633758340563093
sim_render-ego1_max0.008969995710584853
sim_render-ego1_mean0.00887452657260592
sim_render-ego1_median0.008874526572605922
sim_render-ego1_min0.008779057434626989
sim_render-ego2_max0.008895627089909144
sim_render-ego2_mean0.00885955949939748
sim_render-ego2_median0.00885955949939748
sim_render-ego2_min0.008823491908885815
simulation-passed1
step_physics_max0.5766362547874451
step_physics_mean0.5752355489465926
step_physics_median0.5752355489465926
step_physics_min0.5738348431057401
survival_time_max1.4000000000000006
survival_time_mean1.3750000000000009
survival_time_min1.3500000000000003

Highlights

35204

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.