Duckietown Challenges Home Challenges Submissions

Job 34508

Job ID34508
submission6735
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFVI-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg11-3ec1fe9e9468-1
date started
date completed
duration0:25:51
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7497803127875574
survival_time_median6.249999999999986
deviation-center-line_median0.12711321302406356
in-drivable-lane_median3.5249999999999875


other stats
agent_compute-ego_max0.10547043402989706
agent_compute-ego_mean0.10225090271755732
agent_compute-ego_median0.10184635248437392
agent_compute-ego_min0.10038028399149578
complete-iteration_max0.5633019735646803
complete-iteration_mean0.531411483117816
complete-iteration_median0.5223479756000823
complete-iteration_min0.5126462214815933
deviation-center-line_max0.7263690666740334
deviation-center-line_mean0.2830196994660688
deviation-center-line_min0.07887283493597519
deviation-heading_max2.319842707139657
deviation-heading_mean1.1006605553724036
deviation-heading_median0.7465079781545213
deviation-heading_min0.434167871037006
driven_any_max5.199571201657802
driven_any_mean2.5859383089344554
driven_any_median1.8494327559709656
driven_any_min0.7639116041175411
driven_lanedir_consec_max2.7893084428726445
driven_lanedir_consec_mean1.2575658068050803
driven_lanedir_consec_min0.6549083175824881
driven_lanedir_max2.7893084428726445
driven_lanedir_mean1.2618802248024583
driven_lanedir_median0.7497803127875574
driven_lanedir_min0.6549083175824881
get_state_dump_max0.03550513400587925
get_state_dump_mean0.03496882820086828
get_state_dump_median0.035070200204849244
get_state_dump_min0.03414655774831772
get_ui_image_max0.09181977430979411
get_ui_image_mean0.08683291835349194
get_ui_image_median0.08644042148146519
get_ui_image_min0.0841450572013855
in-drivable-lane_max8.60000000000005
in-drivable-lane_mean3.935000000000013
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 4.722687502337616, "get_ui_image": 0.09181977430979411, "step_physics": 0.21977835814158125, "survival_time": 14.950000000000076, "driven_lanedir": 1.815654644348924, "get_state_dump": 0.03469664335250854, "sim_render-ego": 0.007522857983907064, "in-drivable-lane": 8.60000000000005, "agent_compute-ego": 0.10547043402989706, "deviation-heading": 1.6685500594227458, "complete-iteration": 0.5579401246706645, "set_robot_commands": 0.006730185349782308, "deviation-center-line": 0.7263690666740334, "driven_lanedir_consec": 1.7834448624807682, "sim_compute_sim_state": 0.022908847332000732, "sim_compute_performance-ego": 0.00606805165608724, "sim_compute_robot_state-ego": 0.010520168940226235, "sim_compute_robot_state-npc0": 0.010413459142049154, "sim_compute_robot_state-npc1": 0.01039652427037557, "sim_compute_robot_state-npc2": 0.010425417423248292, "sim_compute_robot_state-npc3": 0.010468314488728842, "sim_compute_robot_state-parked0": 0.010422019958496094}, "udem1-0-1-ego": {"driven_any": 1.8650456423157291, "get_ui_image": 0.08719358444213868, "step_physics": 0.1937723010778427, "survival_time": 7.99999999999998, "driven_lanedir": 0.9785095486897132, "get_state_dump": 0.03414655774831772, "sim_render-ego": 0.007361102104187012, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.10260908156633378, "deviation-heading": 1.2685514345897493, "complete-iteration": 0.5178954735398292, "set_robot_commands": 0.006417164206504821, "deviation-center-line": 0.40487004697496487, "driven_lanedir_consec": 0.9676407418521166, "sim_compute_sim_state": 0.018732118606567386, "sim_compute_performance-ego": 0.005698181688785553, "sim_compute_robot_state-ego": 0.010401251912117004, "sim_compute_robot_state-npc0": 0.010295578837394714, "sim_compute_robot_state-npc1": 0.010122233629226684, "sim_compute_robot_state-npc2": 0.010357433557510376, "sim_compute_robot_state-npc3": 0.010173219442367551, "sim_compute_robot_state-parked0": 0.010336241126060486}, "udem1-1-0-ego": {"driven_any": 1.8229094105992936, "get_ui_image": 0.08547173881530762, "step_physics": 0.1914649600982666, "survival_time": 6.249999999999986, "driven_lanedir": 0.7497803127875574, "get_state_dump": 0.03509592819213867, "sim_render-ego": 0.007473663330078125, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.10202158737182618, "deviation-heading": 0.7465079781545213, "complete-iteration": 0.5164306945800782, "set_robot_commands": 0.0063647422790527345, "deviation-center-line": 0.12711321302406356, "driven_lanedir_consec": 0.7497803127875574, "sim_compute_sim_state": 0.020072961807250975, "sim_compute_performance-ego": 0.00587098503112793, "sim_compute_robot_state-ego": 0.010509630203247073, "sim_compute_robot_state-npc0": 0.010544033050537109, "sim_compute_robot_state-npc1": 0.01010178565979004, "sim_compute_robot_state-npc2": 0.010228347778320311, "sim_compute_robot_state-npc3": 0.010578433990478517, "sim_compute_robot_state-parked0": 0.010347230911254885}, "udem1-1-1-ego": {"driven_any": 1.8229094105992936, "get_ui_image": 0.08646921157836913, "step_physics": 0.18563392639160156, "survival_time": 6.249999999999986, "driven_lanedir": 0.7497803127875574, "get_state_dump": 0.03517688179016113, "sim_render-ego": 0.007326633453369141, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.10233112144470216, "deviation-heading": 0.7465079781545213, "complete-iteration": 0.5134219398498535, "set_robot_commands": 0.006448331832885742, "deviation-center-line": 0.12711321302406356, "driven_lanedir_consec": 0.7497803127875574, "sim_compute_sim_state": 0.020593362808227537, "sim_compute_performance-ego": 0.006114431381225586, "sim_compute_robot_state-ego": 0.010751422882080076, "sim_compute_robot_state-npc0": 0.010605255126953124, "sim_compute_robot_state-npc1": 0.010273551940917967, "sim_compute_robot_state-npc2": 0.01058974266052246, "sim_compute_robot_state-npc3": 0.010485597610473633, "sim_compute_robot_state-parked0": 0.010335010528564451}, "udem1-2-0-ego": {"driven_any": 1.8494327559709656, "get_ui_image": 0.086680456600358, "step_physics": 0.188419633207068, "survival_time": 5.649999999999988, "driven_lanedir": 0.6549083175824881, "get_state_dump": 0.034738791727386746, "sim_render-ego": 0.007434017890322525, "in-drivable-lane": 3.7499999999999862, "agent_compute-ego": 0.103731300978534, "deviation-heading": 0.434167871037006, "complete-iteration": 0.5126462214815933, "set_robot_commands": 0.006514110396393632, "deviation-center-line": 0.11797971229647096, "driven_lanedir_consec": 0.6549083175824881, "sim_compute_sim_state": 0.017515878761764123, "sim_compute_performance-ego": 0.006030300022226519, "sim_compute_robot_state-ego": 0.010640230854000666, "sim_compute_robot_state-npc0": 0.010402611926593612, "sim_compute_robot_state-npc1": 0.010127019038242577, "sim_compute_robot_state-npc2": 0.010097244144540971, "sim_compute_robot_state-npc3": 0.01003655290181658, "sim_compute_robot_state-parked0": 0.0099887383722626}, "udem1-2-1-ego": {"driven_any": 1.8494327559709656, "get_ui_image": 0.08627254562040346, "step_physics": 0.19010493607647652, "survival_time": 5.649999999999988, "driven_lanedir": 0.6549083175824881, "get_state_dump": 0.03512513954027564, "sim_render-ego": 0.007379829356100707, "in-drivable-lane": 3.7499999999999862, "agent_compute-ego": 0.10167111759692168, "deviation-heading": 0.434167871037006, "complete-iteration": 0.5180821292168272, "set_robot_commands": 0.007022155069671901, "deviation-center-line": 0.11797971229647096, "driven_lanedir_consec": 0.6549083175824881, "sim_compute_sim_state": 0.017998300822435226, "sim_compute_performance-ego": 0.006381840832465518, "sim_compute_robot_state-ego": 0.011273540226759108, "sim_compute_robot_state-npc0": 0.011011222822476276, "sim_compute_robot_state-npc1": 0.010982507098037584, "sim_compute_robot_state-npc2": 0.010997248961862207, "sim_compute_robot_state-npc3": 0.010776656918821082, "sim_compute_robot_state-parked0": 0.010781271267781216}, "udem1-3-0-ego": {"driven_any": 0.7639116041175411, "get_ui_image": 0.08789480009744334, "step_physics": 0.2285597047140432, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7183219542502832, "get_state_dump": 0.03550513400587925, "sim_render-ego": 0.00741385304650595, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10164970575376998, "deviation-heading": 0.5342334735245862, "complete-iteration": 0.5633019735646803, "set_robot_commands": 0.0062074605808701624, "deviation-center-line": 0.07887283493597519, "driven_lanedir_consec": 0.7182891586162694, "sim_compute_sim_state": 0.0276654931001885, "sim_compute_performance-ego": 0.0061888971994089525, "sim_compute_robot_state-ego": 0.01070468924766363, "sim_compute_robot_state-npc0": 0.010291820348695267, "sim_compute_robot_state-npc1": 0.010174052659855331, "sim_compute_robot_state-npc2": 0.01014668996943984, "sim_compute_robot_state-npc3": 0.010063265645226766, "sim_compute_robot_state-parked0": 0.010545830393946447}, "udem1-3-1-ego": {"driven_any": 0.7639116041175411, "get_ui_image": 0.08641163138456123, "step_physics": 0.22617789201958236, "survival_time": 2.1500000000000004, "driven_lanedir": 0.7183219542502832, "get_state_dump": 0.0351419726083445, "sim_render-ego": 0.007344678390857785, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10147923092509424, "deviation-heading": 0.5342334735245862, "complete-iteration": 0.5561661165814067, "set_robot_commands": 0.006535441376442133, "deviation-center-line": 0.07887283493597519, "driven_lanedir_consec": 0.7182891586162694, "sim_compute_sim_state": 0.025024469508681188, "sim_compute_performance-ego": 0.006006202032399732, "sim_compute_robot_state-ego": 0.010149717330932615, "sim_compute_robot_state-npc0": 0.01047691633534986, "sim_compute_robot_state-npc1": 0.01004134776980378, "sim_compute_robot_state-npc2": 0.009981953820516896, "sim_compute_robot_state-npc3": 0.010899942974711571, "sim_compute_robot_state-parked0": 0.010211545367573583}, "udem1-4-0-ego": {"driven_any": 5.199571201657802, "get_ui_image": 0.0841450572013855, "step_physics": 0.1993115409215291, "survival_time": 14.950000000000076, "driven_lanedir": 2.7893084428726445, "get_state_dump": 0.03501676082611084, "sim_render-ego": 0.007456888357798258, "in-drivable-lane": 6.750000000000074, "agent_compute-ego": 0.10038028399149578, "deviation-heading": 2.319842707139657, "complete-iteration": 0.5266138219833374, "set_robot_commands": 0.0066189408302307125, "deviation-center-line": 0.5255131802493351, "driven_lanedir_consec": 2.7893084428726445, "sim_compute_sim_state": 0.02318549394607544, "sim_compute_performance-ego": 0.006007162729899088, "sim_compute_robot_state-ego": 0.010746090412139891, "sim_compute_robot_state-npc0": 0.010764351685841878, "sim_compute_robot_state-npc1": 0.010624240239461263, "sim_compute_robot_state-npc2": 0.010581787427266438, "sim_compute_robot_state-npc3": 0.010827966531117755, "sim_compute_robot_state-parked0": 0.010655866463979086}, "udem1-4-1-ego": {"driven_any": 5.199571201657802, "get_ui_image": 0.08597038348515829, "step_physics": 0.19890047470728556, "survival_time": 14.950000000000076, "driven_lanedir": 2.7893084428726445, "get_state_dump": 0.03504447221755982, "sim_render-ego": 0.007823490301767985, "in-drivable-lane": 6.750000000000074, "agent_compute-ego": 0.1011651635169983, "deviation-heading": 2.319842707139657, "complete-iteration": 0.5316163357098898, "set_robot_commands": 0.006791412035624186, "deviation-center-line": 0.5255131802493351, "driven_lanedir_consec": 2.7893084428726445, "sim_compute_sim_state": 0.02309021313985189, "sim_compute_performance-ego": 0.006204395294189453, "sim_compute_robot_state-ego": 0.011180496215820313, "sim_compute_robot_state-npc0": 0.010799051920572915, "sim_compute_robot_state-npc1": 0.010800036589304606, "sim_compute_robot_state-npc2": 0.010724692344665528, "sim_compute_robot_state-npc3": 0.010740341345469155, "sim_compute_robot_state-parked0": 0.012084917227427164}}
set_robot_commands_max0.007022155069671901
set_robot_commands_mean0.006564994395745834
set_robot_commands_median0.006524775886417883
set_robot_commands_min0.0062074605808701624
sim_compute_performance-ego_max0.006381840832465518
sim_compute_performance-ego_mean0.006057044786781558
sim_compute_performance-ego_median0.00604917583915688
sim_compute_performance-ego_min0.005698181688785553
sim_compute_robot_state-ego_max0.011273540226759108
sim_compute_robot_state-ego_mean0.010687723822498664
sim_compute_robot_state-ego_median0.01067246005083215
sim_compute_robot_state-ego_min0.010149717330932615
sim_compute_robot_state-npc0_max0.011011222822476276
sim_compute_robot_state-npc0_mean0.010560430119646393
sim_compute_robot_state-npc0_median0.010510474692943484
sim_compute_robot_state-npc0_min0.010291820348695267
sim_compute_robot_state-npc1_max0.010982507098037584
sim_compute_robot_state-npc1_mean0.01036432988950154
sim_compute_robot_state-npc1_median0.01022380230038665
sim_compute_robot_state-npc1_min0.01004134776980378
sim_compute_robot_state-npc2_max0.010997248961862207
sim_compute_robot_state-npc2_mean0.010413055808789332
sim_compute_robot_state-npc2_median0.010391425490379334
sim_compute_robot_state-npc2_min0.009981953820516896
sim_compute_robot_state-npc3_max0.010899942974711571
sim_compute_robot_state-npc3_mean0.010505029184921143
sim_compute_robot_state-npc3_median0.010532015800476071
sim_compute_robot_state-npc3_min0.01003655290181658
sim_compute_robot_state-parked0_max0.012084917227427164
sim_compute_robot_state-parked0_mean0.0105708671617346
sim_compute_robot_state-parked0_median0.010384625434875488
sim_compute_robot_state-parked0_min0.0099887383722626
sim_compute_sim_state_max0.0276654931001885
sim_compute_sim_state_mean0.021678713983304294
sim_compute_sim_state_median0.021751105070114136
sim_compute_sim_state_min0.017515878761764123
sim_render-ego_max0.007823490301767985
sim_render-ego_mean0.007453701421489456
sim_render-ego_median0.007423935468414237
sim_render-ego_min0.007326633453369141
simulation-passed1
step_physics_max0.2285597047140432
step_physics_mean0.2022123727355277
step_physics_median0.1963363878925641
step_physics_min0.18563392639160156
survival_time_max14.950000000000076
survival_time_mean8.095000000000017
survival_time_min2.1500000000000004

Highlights

34508

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

udem1-1-0

udem1-1-1

udem1-2-0

udem1-2-1

udem1-3-0

udem1-3-1

udem1-4-0

udem1-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.