Duckietown Challenges Home Challenges Submissions

Job 34502

Job ID34502
submission6732
userFrank (Chude) Qian 🇨🇦
user labelchallenge-aido_LF-baseline-behavior-cloning
challengeaido5-LFV-sim-validation
stepLFVv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg11-3ec1fe9e9468-1
date started
date completed
duration0:23:30
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1275476042677484
survival_time_median2.9499999999999975
deviation-center-line_median0.19757780826843305
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.11036539077758788
agent_compute-ego_mean0.10334606098730845
agent_compute-ego_median0.10257189165121355
agent_compute-ego_min0.10072056013962316
complete-iteration_max0.554997372177412
complete-iteration_mean0.5274587956028196
complete-iteration_median0.5201012221972148
complete-iteration_min0.5073617425458185
deviation-center-line_max0.5860208214598706
deviation-center-line_mean0.3375985212950946
deviation-center-line_min0.16859963343495515
deviation-heading_max2.8700619383742763
deviation-heading_mean1.2933641735071233
deviation-heading_median0.5742329650449093
deviation-heading_min0.2776474209455566
driven_any_max4.96086728513496
driven_any_mean2.581881692552674
driven_any_median1.1579123675972456
driven_any_min1.037817746800228
driven_lanedir_consec_max2.9064423268667565
driven_lanedir_consec_mean1.7092781776900114
driven_lanedir_consec_min1.0291688560099934
driven_lanedir_max2.9064423268667565
driven_lanedir_mean1.7092781776900114
driven_lanedir_median1.1275476042677484
driven_lanedir_min1.0291688560099934
get_state_dump_max0.03608472674500709
get_state_dump_mean0.03532704560945393
get_state_dump_median0.035319267693212475
get_state_dump_min0.034672885570886
get_ui_image_max0.07942143360773722
get_ui_image_mean0.07855603885740582
get_ui_image_median0.07865230831606634
get_ui_image_min0.07665886069243809
in-drivable-lane_max7.000000000000031
in-drivable-lane_mean2.4000000000000186
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.037817746800228, "get_ui_image": 0.07880145428227443, "step_physics": 0.2090442788367178, "survival_time": 2.549999999999999, "driven_lanedir": 1.0291688560099934, "get_state_dump": 0.03608472674500709, "sim_render-ego": 0.007537626752666398, "in-drivable-lane": 0.0, "agent_compute-ego": 0.11036539077758788, "deviation-heading": 0.2849340960095867, "complete-iteration": 0.5437351254855886, "set_robot_commands": 0.00692591480180329, "deviation-center-line": 0.16859963343495515, "driven_lanedir_consec": 1.0291688560099934, "sim_compute_sim_state": 0.021085598889519188, "sim_compute_performance-ego": 0.006254747802135991, "sim_compute_robot_state-ego": 0.010897028679941214, "sim_compute_robot_state-npc0": 0.01151275167278215, "sim_compute_robot_state-npc1": 0.011143964879653034, "sim_compute_robot_state-npc2": 0.011406987321143055, "sim_compute_robot_state-npc3": 0.011292929742850509, "sim_compute_robot_state-parked0": 0.011081307542090324}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.0602493658587908, "get_ui_image": 0.07936288725655034, "step_physics": 0.20938726191250784, "survival_time": 2.6499999999999986, "driven_lanedir": 1.052264939141876, "get_state_dump": 0.034874637171907245, "sim_render-ego": 0.007287866664382647, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10188389274309266, "deviation-heading": 0.2776474209455566, "complete-iteration": 0.5307325237202194, "set_robot_commands": 0.006561027382904629, "deviation-center-line": 0.17303393878162707, "driven_lanedir_consec": 1.052264939141876, "sim_compute_sim_state": 0.02016367102569004, "sim_compute_performance-ego": 0.0058223841325292045, "sim_compute_robot_state-ego": 0.011012833073454084, "sim_compute_robot_state-npc0": 0.010976696914097047, "sim_compute_robot_state-npc1": 0.010697445779476525, "sim_compute_robot_state-npc2": 0.010640558206810142, "sim_compute_robot_state-npc3": 0.01091343951675127, "sim_compute_robot_state-parked0": 0.010817901143487896}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.0771229327798515, "get_ui_image": 0.07665886069243809, "step_physics": 0.24010760379287432, "survival_time": 2.6499999999999986, "driven_lanedir": 1.0607588970270072, "get_state_dump": 0.034672885570886, "sim_render-ego": 0.007340291761002451, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10142991677770076, "deviation-heading": 0.3693657209864312, "complete-iteration": 0.554997372177412, "set_robot_commands": 0.006677285680231059, "deviation-center-line": 0.19757780826843305, "driven_lanedir_consec": 1.0607588970270072, "sim_compute_sim_state": 0.018594094042508107, "sim_compute_performance-ego": 0.005929344105270674, "sim_compute_robot_state-ego": 0.010937677239472011, "sim_compute_robot_state-npc0": 0.010925549381184127, "sim_compute_robot_state-npc1": 0.01008083685389105, "sim_compute_robot_state-npc2": 0.010582325593480523, "sim_compute_robot_state-npc3": 0.010430673383316904, "sim_compute_robot_state-parked0": 0.010333839452491616}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.0771229327798515, "get_ui_image": 0.07828100222461629, "step_physics": 0.23683062589393472, "survival_time": 2.6499999999999986, "driven_lanedir": 1.0607588970270072, "get_state_dump": 0.035182633489932655, "sim_render-ego": 0.007469397670817825, "in-drivable-lane": 0.0, "agent_compute-ego": 0.1022758978717732, "deviation-heading": 0.3693657209864312, "complete-iteration": 0.5541522637853082, "set_robot_commands": 0.006518426931129312, "deviation-center-line": 0.19757780826843305, "driven_lanedir_consec": 1.0607588970270072, "sim_compute_sim_state": 0.016739597860372293, "sim_compute_performance-ego": 0.0061475960713512495, "sim_compute_robot_state-ego": 0.010800060236229089, "sim_compute_robot_state-npc0": 0.010607256079619784, "sim_compute_robot_state-npc1": 0.010716928626006504, "sim_compute_robot_state-npc2": 0.011018186245324475, "sim_compute_robot_state-npc3": 0.010768103149701964, "sim_compute_robot_state-parked0": 0.010494583057907392}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.1579123675972456, "get_ui_image": 0.07832985005136263, "step_physics": 0.18957239490444375, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1275476042677484, "get_state_dump": 0.035324840222374865, "sim_render-ego": 0.007685564332089181, "in-drivable-lane": 0.0, "agent_compute-ego": 0.10342999232017389, "deviation-heading": 0.5742329650449093, "complete-iteration": 0.5154949810545323, "set_robot_commands": 0.006980289847163831, "deviation-center-line": 0.187443384334548, "driven_lanedir_consec": 1.1275476042677484, "sim_compute_sim_state": 0.020648422887769795, "sim_compute_performance-ego": 0.006011279962830625, "sim_compute_robot_state-ego": 0.010992098662812831, "sim_compute_robot_state-npc0": 0.011708590943934552, "sim_compute_robot_state-npc1": 0.010972099789118363, "sim_compute_robot_state-npc2": 0.011155843734741213, "sim_compute_robot_state-npc3": 0.010992425983234988, "sim_compute_robot_state-parked0": 0.011379658165624586}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.1579123675972456, "get_ui_image": 0.07817440113778841, "step_physics": 0.19405738782074491, "survival_time": 2.9499999999999975, "driven_lanedir": 1.1275476042677484, "get_state_dump": 0.035313695164050085, "sim_render-ego": 0.007202754586429919, "in-drivable-lane": 0.0, "agent_compute-ego": 0.1052919323161497, "deviation-heading": 0.5742329650449093, "complete-iteration": 0.5158527301529706, "set_robot_commands": 0.006664716591269283, "deviation-center-line": 0.187443384334548, "driven_lanedir_consec": 1.1275476042677484, "sim_compute_sim_state": 0.01996505058417886, "sim_compute_performance-ego": 0.006041110572168383, "sim_compute_robot_state-ego": 0.010334119958392644, "sim_compute_robot_state-npc0": 0.010389526011580129, "sim_compute_robot_state-npc1": 0.010451830039590092, "sim_compute_robot_state-npc2": 0.010552495212878212, "sim_compute_robot_state-npc3": 0.010476350784301758, "sim_compute_robot_state-parked0": 0.010641768827276715}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 4.96086728513496, "get_ui_image": 0.07922588268915812, "step_physics": 0.19637051741282144, "survival_time": 14.950000000000076, "driven_lanedir": 2.410925162712611, "get_state_dump": 0.035404574076334634, "sim_render-ego": 0.007549250920613607, "in-drivable-lane": 7.000000000000031, "agent_compute-ego": 0.1028678854306539, "deviation-heading": 2.8700619383742763, "complete-iteration": 0.5187394515673319, "set_robot_commands": 0.006734374364217122, "deviation-center-line": 0.5461338063043304, "driven_lanedir_consec": 2.410925162712611, "sim_compute_sim_state": 0.019450694719950357, "sim_compute_performance-ego": 0.006076761881510417, "sim_compute_robot_state-ego": 0.01123764197031657, "sim_compute_robot_state-npc0": 0.010897459983825684, "sim_compute_robot_state-npc1": 0.010705763498942058, "sim_compute_robot_state-npc2": 0.010726245244344077, "sim_compute_robot_state-npc3": 0.010653196175893147, "sim_compute_robot_state-parked0": 0.010536619822184245}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 4.96086728513496, "get_ui_image": 0.07942143360773722, "step_physics": 0.19628530422846477, "survival_time": 14.950000000000076, "driven_lanedir": 2.410925162712611, "get_state_dump": 0.03558940013249715, "sim_render-ego": 0.007761896451314291, "in-drivable-lane": 7.000000000000031, "agent_compute-ego": 0.10443463802337646, "deviation-heading": 2.8700619383742763, "complete-iteration": 0.5214629928270976, "set_robot_commands": 0.00690678358078003, "deviation-center-line": 0.5461338063043304, "driven_lanedir_consec": 2.410925162712611, "sim_compute_sim_state": 0.019569408098856607, "sim_compute_performance-ego": 0.006183276176452637, "sim_compute_robot_state-ego": 0.011114509105682372, "sim_compute_robot_state-npc0": 0.010829214255015056, "sim_compute_robot_state-npc1": 0.010819223721822103, "sim_compute_robot_state-npc2": 0.010854042371114096, "sim_compute_robot_state-npc3": 0.010655721028645834, "sim_compute_robot_state-parked0": 0.010729132493336997}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 4.664472320921804, "get_ui_image": 0.0786087570519283, "step_physics": 0.19222162838639884, "survival_time": 14.500000000000073, "driven_lanedir": 2.9064423268667565, "get_state_dump": 0.03522844643428408, "sim_render-ego": 0.007367101208917026, "in-drivable-lane": 5.000000000000062, "agent_compute-ego": 0.10072056013962316, "deviation-heading": 2.371869484652428, "complete-iteration": 0.5073617425458185, "set_robot_commands": 0.006598852420675343, "deviation-center-line": 0.5860208214598706, "driven_lanedir_consec": 2.9064423268667565, "sim_compute_sim_state": 0.017453336715698244, "sim_compute_performance-ego": 0.0058970525346953295, "sim_compute_robot_state-ego": 0.010771945427204, "sim_compute_robot_state-npc0": 0.010518582113857929, "sim_compute_robot_state-npc1": 0.010417384936891752, "sim_compute_robot_state-npc2": 0.010436113949479728, "sim_compute_robot_state-npc3": 0.010395560593440614, "sim_compute_robot_state-parked0": 0.0104271255690476}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 4.664472320921804, "get_ui_image": 0.0786958595802044, "step_physics": 0.19440022254812303, "survival_time": 14.500000000000073, "driven_lanedir": 2.9064423268667565, "get_state_dump": 0.035594617087265544, "sim_render-ego": 0.007472599785903405, "in-drivable-lane": 5.000000000000062, "agent_compute-ego": 0.100760503472953, "deviation-heading": 2.371869484652428, "complete-iteration": 0.5120587727119182, "set_robot_commands": 0.00671969775495858, "deviation-center-line": 0.5860208214598706, "driven_lanedir_consec": 2.9064423268667565, "sim_compute_sim_state": 0.01755309515985949, "sim_compute_performance-ego": 0.006005962963761955, "sim_compute_robot_state-ego": 0.010948260077114762, "sim_compute_robot_state-npc0": 0.01067894327229467, "sim_compute_robot_state-npc1": 0.010602882812763082, "sim_compute_robot_state-npc2": 0.010841021044500942, "sim_compute_robot_state-npc3": 0.01073752107291386, "sim_compute_robot_state-parked0": 0.010739098746201088}}
set_robot_commands_max0.006980289847163831
set_robot_commands_mean0.0067287369355132475
set_robot_commands_median0.0066984917175948195
set_robot_commands_min0.006518426931129312
sim_compute_performance-ego_max0.006254747802135991
sim_compute_performance-ego_mean0.006036951620270646
sim_compute_performance-ego_median0.006026195267499503
sim_compute_performance-ego_min0.0058223841325292045
sim_compute_robot_state-ego_max0.01123764197031657
sim_compute_robot_state-ego_mean0.010904617443061955
sim_compute_robot_state-ego_median0.010942968658293386
sim_compute_robot_state-ego_min0.010334119958392644
sim_compute_robot_state-npc0_max0.011708590943934552
sim_compute_robot_state-npc0_mean0.010904457062819112
sim_compute_robot_state-npc0_median0.01086333711942037
sim_compute_robot_state-npc0_min0.010389526011580129
sim_compute_robot_state-npc1_max0.011143964879653034
sim_compute_robot_state-npc1_mean0.010660836093815455
sim_compute_robot_state-npc1_median0.010701604639209291
sim_compute_robot_state-npc1_min0.01008083685389105
sim_compute_robot_state-npc2_max0.011406987321143055
sim_compute_robot_state-npc2_mean0.010821381892381646
sim_compute_robot_state-npc2_median0.01078363314442251
sim_compute_robot_state-npc2_min0.010436113949479728
sim_compute_robot_state-npc3_max0.011292929742850509
sim_compute_robot_state-npc3_mean0.010731592143105083
sim_compute_robot_state-npc3_median0.010696621050779847
sim_compute_robot_state-npc3_min0.010395560593440614
sim_compute_robot_state-parked0_max0.011379658165624586
sim_compute_robot_state-parked0_mean0.010718103481964846
sim_compute_robot_state-parked0_median0.010685450660306855
sim_compute_robot_state-parked0_min0.010333839452491616
sim_compute_sim_state_max0.021085598889519188
sim_compute_sim_state_mean0.019122296998440296
sim_compute_sim_state_median0.019510051409403484
sim_compute_sim_state_min0.016739597860372293
sim_render-ego_max0.007761896451314291
sim_render-ego_mean0.007467435013413674
sim_render-ego_median0.007470998728360614
sim_render-ego_min0.007202754586429919
simulation-passed1
step_physics_max0.24010760379287432
step_physics_mean0.20582772257370313
step_physics_median0.1963279108206431
step_physics_min0.18957239490444375
survival_time_max14.950000000000076
survival_time_mean7.53000000000003
survival_time_min2.549999999999999

Highlights

34502

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-1-1

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-2-1

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-3-1

ETHZ_autolab_technical_track-4-0

ETHZ_autolab_technical_track-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.