Duckietown Challenges Home Challenges Submissions

Job 35093

Job ID35093
submission9196
userBea Baselines 🐤
user labeltemplate-random
challengeaido5-LFVI-sim-validation
stepLFVIv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg01-6849899a1b0a-1
date started
date completed
duration0:31:39
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4413619115174019
survival_time_median14.950000000000076
deviation-center-line_median0.3113578382892488
in-drivable-lane_median6.35000000000005


other stats
agent_compute-ego_max0.07301977204113472
agent_compute-ego_mean0.06317648922866122
agent_compute-ego_median0.06977266132831574
agent_compute-ego_min0.039393053849538166
complete-iteration_max0.4960373044013977
complete-iteration_mean0.4589464045559348
complete-iteration_median0.45376417295551
complete-iteration_min0.430967864063051
deviation-center-line_max1.0406170504628511
deviation-center-line_mean0.45602537504868845
deviation-center-line_min0.04116745495156054
deviation-heading_max5.289189521673852
deviation-heading_mean2.125206474740833
deviation-heading_median1.588580011349604
deviation-heading_min0.5053191912955899
driven_any_max1.9398200295237964
driven_any_mean1.598370448937494
driven_any_median1.939295309079188
driven_any_min0.432964456315115
driven_lanedir_consec_max1.3905425817380743
driven_lanedir_consec_mean0.5582084597027174
driven_lanedir_consec_min0.0591846142046184
driven_lanedir_max1.3950029271716855
driven_lanedir_mean0.6019557421338291
driven_lanedir_median0.4413619115174019
driven_lanedir_min0.0591846142046184
get_state_dump_max0.03842029094696045
get_state_dump_mean0.03786175088561072
get_state_dump_median0.03783634440685675
get_state_dump_min0.03739553451538086
get_ui_image_max0.07884002208709717
get_ui_image_mean0.07763825009510236
get_ui_image_median0.07766361316045126
get_ui_image_min0.07528764340612623
in-drivable-lane_max13.650000000000077
in-drivable-lane_mean6.710000000000036
in-drivable-lane_min0.0
per-episodes
details{"udem1-0-0-ego": {"driven_any": 1.9328965183094584, "get_ui_image": 0.07834119081497193, "step_physics": 0.17079623301823935, "survival_time": 14.950000000000076, "driven_lanedir": 0.5848711431755342, "get_state_dump": 0.038152294953664144, "sim_render-ego": 0.009711893399556476, "in-drivable-lane": 8.850000000000076, "agent_compute-ego": 0.039393053849538166, "deviation-heading": 2.863211393836876, "complete-iteration": 0.4470344551404317, "set_robot_commands": 0.008075200716654459, "deviation-center-line": 0.2962064844335021, "driven_lanedir_consec": 0.5848711431755342, "sim_compute_sim_state": 0.022240684032440183, "sim_compute_performance-ego": 0.006610326766967774, "sim_compute_robot_state-ego": 0.012463330427805584, "sim_compute_robot_state-npc0": 0.01221779982248942, "sim_compute_robot_state-npc1": 0.011951303482055664, "sim_compute_robot_state-npc2": 0.012053857644399008, "sim_compute_robot_state-npc3": 0.012458184560139971, "sim_compute_robot_state-parked0": 0.01223417599995931}, "udem1-0-1-ego": {"driven_any": 1.939442626012797, "get_ui_image": 0.07884002208709717, "step_physics": 0.15424353281656902, "survival_time": 14.950000000000076, "driven_lanedir": 0.34836244270555294, "get_state_dump": 0.03842029094696045, "sim_render-ego": 0.01026331106821696, "in-drivable-lane": 10.950000000000037, "agent_compute-ego": 0.03951750278472901, "deviation-heading": 2.3008667969727106, "complete-iteration": 0.4360818632443746, "set_robot_commands": 0.008528087933858236, "deviation-center-line": 0.3265091921449954, "driven_lanedir_consec": 0.34836244270555294, "sim_compute_sim_state": 0.021851247946421307, "sim_compute_performance-ego": 0.008103450139363607, "sim_compute_robot_state-ego": 0.01326343059539795, "sim_compute_robot_state-npc0": 0.012399342854817709, "sim_compute_robot_state-npc1": 0.01229398250579834, "sim_compute_robot_state-npc2": 0.012524337768554689, "sim_compute_robot_state-npc3": 0.012741662661234538, "sim_compute_robot_state-parked0": 0.012752854824066162}, "udem1-1-0-ego": {"driven_any": 1.9398200295237964, "get_ui_image": 0.07761482318242391, "step_physics": 0.15921695470809938, "survival_time": 14.950000000000076, "driven_lanedir": 0.12714809328283527, "get_state_dump": 0.03746373017628988, "sim_render-ego": 0.009696547190348308, "in-drivable-lane": 13.400000000000077, "agent_compute-ego": 0.05798271656036377, "deviation-heading": 0.7209217088726775, "complete-iteration": 0.450968329111735, "set_robot_commands": 0.007642565568288167, "deviation-center-line": 0.1330528184211477, "driven_lanedir_consec": 0.12714809328283527, "sim_compute_sim_state": 0.02379132588704427, "sim_compute_performance-ego": 0.006491957505544026, "sim_compute_robot_state-ego": 0.011978373527526856, "sim_compute_robot_state-npc0": 0.011777639389038086, "sim_compute_robot_state-npc1": 0.011642677783966065, "sim_compute_robot_state-npc2": 0.011736002763112386, "sim_compute_robot_state-npc3": 0.011776423454284668, "sim_compute_robot_state-parked0": 0.011825378735860188}, "udem1-1-1-ego": {"driven_any": 1.9391479921455783, "get_ui_image": 0.07826496283213298, "step_physics": 0.1598568614323934, "survival_time": 14.950000000000076, "driven_lanedir": 0.0802343455855219, "get_state_dump": 0.03772041400273641, "sim_render-ego": 0.009856893221537271, "in-drivable-lane": 13.650000000000077, "agent_compute-ego": 0.06934753179550171, "deviation-heading": 0.7669455976424663, "complete-iteration": 0.466919367313385, "set_robot_commands": 0.008107852935791016, "deviation-center-line": 0.10770953078038328, "driven_lanedir_consec": 0.0802343455855219, "sim_compute_sim_state": 0.023998021284739175, "sim_compute_performance-ego": 0.0066852736473083495, "sim_compute_robot_state-ego": 0.012574382623036702, "sim_compute_robot_state-npc0": 0.012260348796844482, "sim_compute_robot_state-npc1": 0.0118333101272583, "sim_compute_robot_state-npc2": 0.011905869642893474, "sim_compute_robot_state-npc3": 0.012173553307851156, "sim_compute_robot_state-parked0": 0.011996572017669675}, "udem1-2-0-ego": {"driven_any": 1.4813135641614772, "get_ui_image": 0.07810198431429656, "step_physics": 0.15632737719494363, "survival_time": 11.500000000000028, "driven_lanedir": 0.0591846142046184, "get_state_dump": 0.03797723728677501, "sim_render-ego": 0.009653009539065154, "in-drivable-lane": 10.500000000000028, "agent_compute-ego": 0.06915360637333082, "deviation-heading": 0.5053191912955899, "complete-iteration": 0.45342570180478303, "set_robot_commands": 0.00794119523919147, "deviation-center-line": 0.04116745495156054, "driven_lanedir_consec": 0.0591846142046184, "sim_compute_sim_state": 0.018468242106230364, "sim_compute_performance-ego": 0.006415432432423467, "sim_compute_robot_state-ego": 0.01162410715351934, "sim_compute_robot_state-npc0": 0.01157870914625085, "sim_compute_robot_state-npc1": 0.011486245238262674, "sim_compute_robot_state-npc2": 0.01160509379013725, "sim_compute_robot_state-npc3": 0.011478978654612663, "sim_compute_robot_state-parked0": 0.011274013311966606}, "udem1-2-1-ego": {"driven_any": 1.939502633380323, "get_ui_image": 0.0774490753809611, "step_physics": 0.19176923910776775, "survival_time": 14.950000000000076, "driven_lanedir": 1.1513694855441263, "get_state_dump": 0.03739553451538086, "sim_render-ego": 0.00977642297744751, "in-drivable-lane": 3.850000000000025, "agent_compute-ego": 0.07121199289957682, "deviation-heading": 5.289189521673852, "complete-iteration": 0.4960373044013977, "set_robot_commands": 0.008031524022420248, "deviation-center-line": 1.0128323321395225, "driven_lanedir_consec": 0.8407197392014332, "sim_compute_sim_state": 0.02102557341257731, "sim_compute_performance-ego": 0.00667473316192627, "sim_compute_robot_state-ego": 0.012214818000793458, "sim_compute_robot_state-npc0": 0.012145908673604327, "sim_compute_robot_state-npc1": 0.011859310468037924, "sim_compute_robot_state-npc2": 0.012047568162282307, "sim_compute_robot_state-npc3": 0.012071311473846436, "sim_compute_robot_state-parked0": 0.012026893297831217}, "udem1-3-0-ego": {"driven_any": 1.9396922728544197, "get_ui_image": 0.07763015588124593, "step_physics": 0.1700372807184855, "survival_time": 14.950000000000076, "driven_lanedir": 1.390660546633612, "get_state_dump": 0.03756911277770996, "sim_render-ego": 0.00962248166402181, "in-drivable-lane": 3.4000000000000288, "agent_compute-ego": 0.07160185972849528, "deviation-heading": 2.8104266160613944, "complete-iteration": 0.4774470559755961, "set_robot_commands": 0.007984693845113118, "deviation-center-line": 1.0406170504628511, "driven_lanedir_consec": 1.3905425817380743, "sim_compute_sim_state": 0.025351154804229736, "sim_compute_performance-ego": 0.006469400723775228, "sim_compute_robot_state-ego": 0.012002298831939696, "sim_compute_robot_state-npc0": 0.011734565099080404, "sim_compute_robot_state-npc1": 0.011599647204081217, "sim_compute_robot_state-npc2": 0.011668654282887776, "sim_compute_robot_state-npc3": 0.011854728062947592, "sim_compute_robot_state-parked0": 0.011985385417938232}, "udem1-3-1-ego": {"driven_any": 1.9395312311057304, "get_ui_image": 0.07769707043965658, "step_physics": 0.16575145483016968, "survival_time": 14.950000000000076, "driven_lanedir": 1.3950029271716855, "get_state_dump": 0.037554770310719805, "sim_render-ego": 0.009815626939137775, "in-drivable-lane": 2.5000000000000115, "agent_compute-ego": 0.0703390653928121, "deviation-heading": 4.360100733940977, "complete-iteration": 0.47647946039835615, "set_robot_commands": 0.00821041504542033, "deviation-center-line": 0.8405001242965391, "driven_lanedir_consec": 1.2682978140987993, "sim_compute_sim_state": 0.02585425059000651, "sim_compute_performance-ego": 0.006794962882995605, "sim_compute_robot_state-ego": 0.012874975204467771, "sim_compute_robot_state-npc0": 0.012298658688863118, "sim_compute_robot_state-npc1": 0.012059767246246338, "sim_compute_robot_state-npc2": 0.01233071486155192, "sim_compute_robot_state-npc3": 0.012316201527913411, "sim_compute_robot_state-parked0": 0.012243399620056153}, "udem1-4-0-ego": {"driven_any": 0.49939316556624386, "get_ui_image": 0.07715557261211116, "step_physics": 0.14518644751572027, "survival_time": 4.099999999999993, "driven_lanedir": 0.4900408534370349, "get_state_dump": 0.0379522748109771, "sim_render-ego": 0.009963134439980112, "in-drivable-lane": 0.0, "agent_compute-ego": 0.07301977204113472, "deviation-heading": 0.7587899613852828, "complete-iteration": 0.4541026441062369, "set_robot_commands": 0.008583987631448886, "deviation-center-line": 0.5193503054987478, "driven_lanedir_consec": 0.4900408534370349, "sim_compute_sim_state": 0.020554071519432997, "sim_compute_performance-ego": 0.006729887752998166, "sim_compute_robot_state-ego": 0.012841416568290897, "sim_compute_robot_state-npc0": 0.012636466724116628, "sim_compute_robot_state-npc1": 0.012165342889180995, "sim_compute_robot_state-npc2": 0.01240505823274938, "sim_compute_robot_state-npc3": 0.01232323704696283, "sim_compute_robot_state-parked0": 0.012245820789802363}, "udem1-4-1-ego": {"driven_any": 0.432964456315115, "get_ui_image": 0.07528764340612623, "step_physics": 0.1443102094862196, "survival_time": 3.599999999999995, "driven_lanedir": 0.39268296959776894, "get_state_dump": 0.03841184907489353, "sim_render-ego": 0.008945378992292616, "in-drivable-lane": 0.0, "agent_compute-ego": 0.07019779086112976, "deviation-heading": 0.8762932257264976, "complete-iteration": 0.430967864063051, "set_robot_commands": 0.007277962234285142, "deviation-center-line": 0.24230845735763448, "driven_lanedir_consec": 0.39268296959776894, "sim_compute_sim_state": 0.019306951098971896, "sim_compute_performance-ego": 0.005993862946828206, "sim_compute_robot_state-ego": 0.00973461733924018, "sim_compute_robot_state-npc0": 0.01048433780670166, "sim_compute_robot_state-npc1": 0.010117544068230525, "sim_compute_robot_state-npc2": 0.010104116466310289, "sim_compute_robot_state-npc3": 0.010248512029647827, "sim_compute_robot_state-parked0": 0.01020701395140754}}
set_robot_commands_max0.008583987631448886
set_robot_commands_mean0.008038348517247107
set_robot_commands_median0.008053362369537354
set_robot_commands_min0.007277962234285142
sim_compute_performance-ego_max0.008103450139363607
sim_compute_performance-ego_mean0.00669692879601307
sim_compute_performance-ego_median0.006642529964447022
sim_compute_performance-ego_min0.005993862946828206
sim_compute_robot_state-ego_max0.01326343059539795
sim_compute_robot_state-ego_mean0.012157175027201842
sim_compute_robot_state-ego_median0.01233907421429952
sim_compute_robot_state-ego_min0.00973461733924018
sim_compute_robot_state-npc0_max0.012636466724116628
sim_compute_robot_state-npc0_mean0.011953377700180668
sim_compute_robot_state-npc0_median0.012181854248046874
sim_compute_robot_state-npc0_min0.01048433780670166
sim_compute_robot_state-npc1_max0.01229398250579834
sim_compute_robot_state-npc1_mean0.011700913101311805
sim_compute_robot_state-npc1_median0.011846310297648112
sim_compute_robot_state-npc1_min0.010117544068230525
sim_compute_robot_state-npc2_max0.012524337768554689
sim_compute_robot_state-npc2_mean0.011838127361487849
sim_compute_robot_state-npc2_median0.01197671890258789
sim_compute_robot_state-npc2_min0.010104116466310289
sim_compute_robot_state-npc3_max0.012741662661234538
sim_compute_robot_state-npc3_mean0.011944279277944107
sim_compute_robot_state-npc3_median0.012122432390848797
sim_compute_robot_state-npc3_min0.010248512029647827
sim_compute_robot_state-parked0_max0.012752854824066162
sim_compute_robot_state-parked0_mean0.011879150796655745
sim_compute_robot_state-parked0_median0.012011732657750449
sim_compute_robot_state-parked0_min0.01020701395140754
sim_compute_sim_state_max0.02585425059000651
sim_compute_sim_state_mean0.022244152268209375
sim_compute_sim_state_median0.022045965989430743
sim_compute_sim_state_min0.018468242106230364
sim_render-ego_max0.01026331106821696
sim_render-ego_mean0.0097304699431604
sim_render-ego_median0.009744158188501996
sim_render-ego_min0.008945378992292616
simulation-passed1
step_physics_max0.19176923910776775
step_physics_mean0.16174955908286076
step_physics_median0.1595369080702464
step_physics_min0.1443102094862196
survival_time_max14.950000000000076
survival_time_mean12.385000000000057
survival_time_min3.599999999999995

Highlights

35093

Click the images to see detailed statistics about the episode.

udem1-0-0

udem1-0-1

udem1-1-0

udem1-1-1

udem1-2-0

udem1-2-1

udem1-3-0

udem1-3-1

udem1-4-0

udem1-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.