Duckietown Challenges Home Challenges Submissions

Job 34386

Job ID34386
submission9201
userBea Baselines 🐤
user labelstraight
challengeaido5-LFV-sim-validation
stepLFVv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg12-2cf036d29640-1
date started
date completed
duration0:27:11
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5800739706811837
survival_time_median8.024999999999984
deviation-center-line_median0.2217870877362053
in-drivable-lane_median1.4749999999999956


other stats
agent_compute-ego_max0.06261702789657417
agent_compute-ego_mean0.05868074812370742
agent_compute-ego_median0.0576976661121144
agent_compute-ego_min0.05442074547826716
complete-iteration_max0.5393954104390638
complete-iteration_mean0.5250240130203384
complete-iteration_median0.5242272464434306
complete-iteration_min0.5139843784602343
deviation-center-line_max1.2130274971386938
deviation-center-line_mean0.43294197509234456
deviation-center-line_min0.04121105377316432
deviation-heading_max4.222450667168554
deviation-heading_mean2.046079584984147
deviation-heading_median1.824173186844941
deviation-heading_min0.6154621731103003
driven_any_max1.939644760374179
driven_any_mean1.1902444703328183
driven_any_median1.0203380439534897
driven_any_min0.28716178548379895
driven_lanedir_consec_max1.6310828004420173
driven_lanedir_consec_mean0.6696838276352434
driven_lanedir_consec_min0.18280065879572496
driven_lanedir_max1.6310828004420173
driven_lanedir_mean0.68426509014593
driven_lanedir_median0.5800739706811837
driven_lanedir_min0.18280065879572496
get_state_dump_max0.03450056646956878
get_state_dump_mean0.03383665983168715
get_state_dump_median0.03390828487919826
get_state_dump_min0.03324595542803203
get_ui_image_max0.0974880854288737
get_ui_image_mean0.09111808678511454
get_ui_image_median0.09057030955950418
get_ui_image_min0.08785965928324947
in-drivable-lane_max9.150000000000087
in-drivable-lane_mean3.065000000000018
in-drivable-lane_min0.04999999999999982
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 0.28716178548379895, "get_ui_image": 0.09461752573649088, "step_physics": 0.24286854500864063, "survival_time": 2.549999999999999, "driven_lanedir": 0.18280065879572496, "get_state_dump": 0.03394639725778617, "sim_render-ego": 0.007021978789684819, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.05754840140249215, "deviation-heading": 0.6154621731103003, "complete-iteration": 0.5314173651676551, "set_robot_commands": 0.006186424517164044, "deviation-center-line": 0.04121105377316432, "driven_lanedir_consec": 0.18280065879572496, "sim_compute_sim_state": 0.022303286720724663, "sim_compute_performance-ego": 0.005839848050884172, "sim_compute_robot_state-ego": 0.010118367625217811, "sim_compute_robot_state-npc0": 0.01037260597827388, "sim_compute_robot_state-npc1": 0.010255028219784008, "sim_compute_robot_state-npc2": 0.009681584788303749, "sim_compute_robot_state-npc3": 0.010315619262994504, "sim_compute_robot_state-parked0": 0.010065793991088867}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 0.4395862384673986, "get_ui_image": 0.09154275345475708, "step_physics": 0.25197712689229884, "survival_time": 3.649999999999995, "driven_lanedir": 0.4007454718523342, "get_state_dump": 0.03324595542803203, "sim_render-ego": 0.006674952702979519, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.056960210408249945, "deviation-heading": 0.6764300282668408, "complete-iteration": 0.5328548019879484, "set_robot_commands": 0.006436880320718844, "deviation-center-line": 0.07935556951533584, "driven_lanedir_consec": 0.4007454718523342, "sim_compute_sim_state": 0.020421906693340985, "sim_compute_performance-ego": 0.005612154529519277, "sim_compute_robot_state-ego": 0.009857406354930305, "sim_compute_robot_state-npc0": 0.009834795782010849, "sim_compute_robot_state-npc1": 0.010354705052833035, "sim_compute_robot_state-npc2": 0.0102771765565219, "sim_compute_robot_state-npc3": 0.009652372908918823, "sim_compute_robot_state-parked0": 0.009726811761725438}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.6716996504593461, "get_ui_image": 0.08785965928324947, "step_physics": 0.24686142029585664, "survival_time": 5.399999999999989, "driven_lanedir": 0.3341321969197453, "get_state_dump": 0.03401871301509716, "sim_render-ego": 0.007068307311446579, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.056960748301612005, "deviation-heading": 1.995198638112016, "complete-iteration": 0.5239295959472656, "set_robot_commands": 0.006342201321213333, "deviation-center-line": 0.30213943311409774, "driven_lanedir_consec": 0.3341321969197453, "sim_compute_sim_state": 0.01770361926820543, "sim_compute_performance-ego": 0.0060510966512891985, "sim_compute_robot_state-ego": 0.010442894917947277, "sim_compute_robot_state-npc0": 0.01012274733296147, "sim_compute_robot_state-npc1": 0.01001704180682147, "sim_compute_robot_state-npc2": 0.009947586942602086, "sim_compute_robot_state-npc3": 0.010021732913123235, "sim_compute_robot_state-parked0": 0.01023137127911603}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.9305918203693184, "get_ui_image": 0.08809798104422432, "step_physics": 0.2402568431127639, "survival_time": 7.349999999999982, "driven_lanedir": 0.5227381833127587, "get_state_dump": 0.03450056646956878, "sim_render-ego": 0.007559140523274739, "in-drivable-lane": 1.2499999999999976, "agent_compute-ego": 0.05601765833744386, "deviation-heading": 4.222450667168554, "complete-iteration": 0.5179761153500096, "set_robot_commands": 0.006394910163619891, "deviation-center-line": 0.4389498741322273, "driven_lanedir_consec": 0.5227381833127587, "sim_compute_sim_state": 0.018292015101633915, "sim_compute_performance-ego": 0.005943024239572538, "sim_compute_robot_state-ego": 0.010137974810438093, "sim_compute_robot_state-npc0": 0.01004735466574325, "sim_compute_robot_state-npc1": 0.010196062983298788, "sim_compute_robot_state-npc2": 0.010237229924623658, "sim_compute_robot_state-npc3": 0.010059586998556748, "sim_compute_robot_state-parked0": 0.009949032141237844}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 0.7050848326774788, "get_ui_image": 0.08929613839208553, "step_physics": 0.23532305354565647, "survival_time": 5.649999999999988, "driven_lanedir": 0.23091001172824943, "get_state_dump": 0.03395423635972285, "sim_render-ego": 0.0071314710431394325, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.05442074547826716, "deviation-heading": 0.7877246825731674, "complete-iteration": 0.5139843784602343, "set_robot_commands": 0.006430581607649812, "deviation-center-line": 0.11939432772287226, "driven_lanedir_consec": 0.23091001172824943, "sim_compute_sim_state": 0.022302216133185192, "sim_compute_performance-ego": 0.0057413578033447266, "sim_compute_robot_state-ego": 0.010009231820570685, "sim_compute_robot_state-npc0": 0.009667615974898888, "sim_compute_robot_state-npc1": 0.00997098568266472, "sim_compute_robot_state-npc2": 0.00983652604364716, "sim_compute_robot_state-npc3": 0.009677106300286488, "sim_compute_robot_state-parked0": 0.009939889992232873}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.9396178557114332, "get_ui_image": 0.08949257691701253, "step_physics": 0.24527678648630777, "survival_time": 14.950000000000076, "driven_lanedir": 1.3727177458613775, "get_state_dump": 0.03357538382212321, "sim_render-ego": 0.007126923402150472, "in-drivable-lane": 3.300000000000026, "agent_compute-ego": 0.057846930821736656, "deviation-heading": 3.0294704235626497, "complete-iteration": 0.5235664788881937, "set_robot_commands": 0.006387232144673665, "deviation-center-line": 1.1308970291363425, "driven_lanedir_consec": 1.226905120754513, "sim_compute_sim_state": 0.01860838492711385, "sim_compute_performance-ego": 0.005734806060791016, "sim_compute_robot_state-ego": 0.010125543276468913, "sim_compute_robot_state-npc0": 0.009826484521230062, "sim_compute_robot_state-npc1": 0.010023279190063477, "sim_compute_robot_state-npc2": 0.009806886514027911, "sim_compute_robot_state-npc3": 0.00966098705927531, "sim_compute_robot_state-parked0": 0.009777955214182536}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.9394769230401157, "get_ui_image": 0.09164552847544352, "step_physics": 0.2416318615277608, "survival_time": 14.950000000000076, "driven_lanedir": 0.6374097580496088, "get_state_dump": 0.0339525310198466, "sim_render-ego": 0.00728721539179484, "in-drivable-lane": 9.10000000000008, "agent_compute-ego": 0.061382416089375814, "deviation-heading": 1.653147735577866, "complete-iteration": 0.5245248969395956, "set_robot_commands": 0.0062573607762654625, "deviation-center-line": 0.11218471159336744, "driven_lanedir_consec": 0.6374097580496088, "sim_compute_sim_state": 0.017706031799316405, "sim_compute_performance-ego": 0.005815045833587646, "sim_compute_robot_state-ego": 0.009900612036387126, "sim_compute_robot_state-npc0": 0.009734801451365151, "sim_compute_robot_state-npc1": 0.009644997119903563, "sim_compute_robot_state-npc2": 0.009641380310058591, "sim_compute_robot_state-npc3": 0.009788987636566162, "sim_compute_robot_state-parked0": 0.009856051603953043}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.9394965692074544, "get_ui_image": 0.09126455386479695, "step_physics": 0.24285515467325847, "survival_time": 14.950000000000076, "driven_lanedir": 0.67247127448488, "get_state_dump": 0.03387017250061035, "sim_render-ego": 0.007395718097686768, "in-drivable-lane": 9.150000000000087, "agent_compute-ego": 0.06072246472040812, "deviation-heading": 1.181666879132539, "complete-iteration": 0.5258548585573832, "set_robot_commands": 0.006336784362792969, "deviation-center-line": 0.14143474235831285, "driven_lanedir_consec": 0.67247127448488, "sim_compute_sim_state": 0.01845680077870687, "sim_compute_performance-ego": 0.005688302516937256, "sim_compute_robot_state-ego": 0.009939336776733398, "sim_compute_robot_state-npc0": 0.009940995375315348, "sim_compute_robot_state-npc1": 0.009691413243611653, "sim_compute_robot_state-npc2": 0.009987175464630129, "sim_compute_robot_state-npc3": 0.009722088972727458, "sim_compute_robot_state-parked0": 0.009680407842000326}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.1100842675376603, "get_ui_image": 0.0974880854288737, "step_physics": 0.24734206720330248, "survival_time": 8.699999999999989, "driven_lanedir": 0.8576428000126031, "get_state_dump": 0.03370821613004838, "sim_render-ego": 0.007092045641493523, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.06261702789657417, "deviation-heading": 2.3586347911859877, "complete-iteration": 0.5393954104390638, "set_robot_commands": 0.006145833552568808, "deviation-center-line": 0.7508255124390314, "driven_lanedir_consec": 0.8576428000126031, "sim_compute_sim_state": 0.01902482564421906, "sim_compute_performance-ego": 0.005761171209401098, "sim_compute_robot_state-ego": 0.009706793160274112, "sim_compute_robot_state-npc0": 0.010182605392631444, "sim_compute_robot_state-npc1": 0.010247367551957052, "sim_compute_robot_state-npc2": 0.010217235006135084, "sim_compute_robot_state-npc3": 0.009979548125431456, "sim_compute_robot_state-parked0": 0.00960665050594286}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.939644760374179, "get_ui_image": 0.08987606525421142, "step_physics": 0.2326355679829915, "survival_time": 14.950000000000076, "driven_lanedir": 1.6310828004420173, "get_state_dump": 0.03359442631403605, "sim_render-ego": 0.008679545720418295, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.062330877780914305, "deviation-heading": 3.9406098311515465, "complete-iteration": 0.516736228466034, "set_robot_commands": 0.006246976057688395, "deviation-center-line": 1.2130274971386938, "driven_lanedir_consec": 1.6310828004420173, "sim_compute_sim_state": 0.01685209592183431, "sim_compute_performance-ego": 0.00597200870513916, "sim_compute_robot_state-ego": 0.010053223768870035, "sim_compute_robot_state-npc0": 0.010042925675710045, "sim_compute_robot_state-npc1": 0.010200600624084472, "sim_compute_robot_state-npc2": 0.010235695044199626, "sim_compute_robot_state-npc3": 0.009848178227742511, "sim_compute_robot_state-parked0": 0.009884799321492513}}
set_robot_commands_max0.006436880320718844
set_robot_commands_mean0.006316518482435522
set_robot_commands_median0.006339492842003152
set_robot_commands_min0.006145833552568808
sim_compute_performance-ego_max0.0060510966512891985
sim_compute_performance-ego_mean0.005815881560046608
sim_compute_performance-ego_median0.005788108521494372
sim_compute_performance-ego_min0.005612154529519277
sim_compute_robot_state-ego_max0.010442894917947277
sim_compute_robot_state-ego_mean0.010029138454783777
sim_compute_robot_state-ego_median0.01003122779472036
sim_compute_robot_state-ego_min0.009706793160274112
sim_compute_robot_state-npc0_max0.01037260597827388
sim_compute_robot_state-npc0_mean0.009977293215014038
sim_compute_robot_state-npc0_median0.009991960525512695
sim_compute_robot_state-npc0_min0.009667615974898888
sim_compute_robot_state-npc1_max0.010354705052833035
sim_compute_robot_state-npc1_mean0.010060148147502224
sim_compute_robot_state-npc1_median0.010109671086681132
sim_compute_robot_state-npc1_min0.009644997119903563
sim_compute_robot_state-npc2_max0.0102771765565219
sim_compute_robot_state-npc2_mean0.00998684765947499
sim_compute_robot_state-npc2_median0.009967381203616107
sim_compute_robot_state-npc2_min0.009641380310058591
sim_compute_robot_state-npc3_max0.010315619262994504
sim_compute_robot_state-npc3_mean0.00987262084056227
sim_compute_robot_state-npc3_median0.009818582932154336
sim_compute_robot_state-npc3_min0.009652372908918823
sim_compute_robot_state-parked0_max0.01023137127911603
sim_compute_robot_state-parked0_mean0.009871876365297232
sim_compute_robot_state-parked0_median0.00987042546272278
sim_compute_robot_state-parked0_min0.00960665050594286
sim_compute_sim_state_max0.022303286720724663
sim_compute_sim_state_mean0.019167118298828067
sim_compute_sim_state_median0.01853259285291036
sim_compute_sim_state_min0.01685209592183431
sim_render-ego_max0.008679545720418295
sim_render-ego_mean0.0073037298624068995
sim_render-ego_median0.007129197222644952
sim_render-ego_min0.006674952702979519
simulation-passed1
step_physics_max0.25197712689229884
step_physics_mean0.24270284267288375
step_physics_median0.24286184984094955
step_physics_min0.2326355679829915
survival_time_max14.950000000000076
survival_time_mean9.310000000000024
survival_time_min2.549999999999999

Highlights

34386

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-1-1

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-2-1

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-3-1

ETHZ_autolab_technical_track-4-0

ETHZ_autolab_technical_track-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.