Duckietown Challenges Home Challenges Submissions

Job 33469

Job ID33469
submission6871
userBea Baselines 🐤
user labelstraight
challengeaido5-LF-sim-validation
stepLFv-sim
statussuccess
up to date Note that this job is not up to date; the challenge has been changed.
evaluatorreg10-d4835fbb66a3-1
date started
date completed
duration0:20:02
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6430501145491379
survival_time_median10.90000000000002
deviation-center-line_median0.3525330450206732
in-drivable-lane_median2.225000000000011


other stats
agent_compute-ego_max0.02498880299654874
agent_compute-ego_mean0.023709157242376884
agent_compute-ego_median0.02343931441536788
agent_compute-ego_min0.023153449712174663
complete-iteration_max0.311591435881222
complete-iteration_mean0.29785725286383363
complete-iteration_median0.30292403402399926
complete-iteration_min0.2703941617130248
deviation-center-line_max0.9632944711251068
deviation-center-line_mean0.4630340322034023
deviation-center-line_min0.14192664544797587
deviation-heading_max2.098533601853976
deviation-heading_mean0.9754792675440108
deviation-heading_median0.7342551245090743
deviation-heading_min0.585297346117501
driven_any_max2.420991347968776
driven_any_mean1.6207752930494792
driven_any_median1.7473878924063322
driven_any_min0.6646238014128742
driven_lanedir_consec_max2.0163429659604093
driven_lanedir_consec_mean0.9238482055775374
driven_lanedir_consec_min0.4265885495638271
driven_lanedir_max2.0163429659604093
driven_lanedir_mean0.9238482055775374
driven_lanedir_median0.6430501145491379
driven_lanedir_min0.4265885495638271
get_state_dump_max0.019332745843682407
get_state_dump_mean0.01806471343181331
get_state_dump_median0.017989072286016573
get_state_dump_min0.01695867379506429
get_ui_image_max0.051468914205377754
get_ui_image_mean0.050382726683417735
get_ui_image_median0.05051932369725089
get_ui_image_min0.04944410847454536
in-drivable-lane_max10.500000000000083
in-drivable-lane_mean4.055000000000026
in-drivable-lane_min1.3499999999999952
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.2994563656887796, "get_ui_image": 0.04944410847454536, "step_physics": 0.1376509055858705, "survival_time": 8.199999999999982, "driven_lanedir": 0.8875163355320987, "get_state_dump": 0.01795326209649807, "sim_render-ego": 0.0073119358318607984, "in-drivable-lane": 2.449999999999994, "agent_compute-ego": 0.02345226159909876, "deviation-heading": 0.656882474004175, "complete-iteration": 0.29092199046437334, "set_robot_commands": 0.006682128441043016, "deviation-center-line": 0.5442231045907214, "driven_lanedir_consec": 0.8875163355320987, "sim_compute_sim_state": 0.020718035174579156, "sim_compute_performance-ego": 0.006083382339012332, "sim_compute_robot_state-ego": 0.010909628577348665, "sim_compute_robot_state-parked0": 0.010502662600540532}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 2.1953194191238845, "get_ui_image": 0.0508375685004627, "step_physics": 0.15531071757569032, "survival_time": 13.600000000000058, "driven_lanedir": 1.1856250938826185, "get_state_dump": 0.018306265859042894, "sim_render-ego": 0.007422758375897128, "in-drivable-lane": 6.050000000000077, "agent_compute-ego": 0.023538540391361013, "deviation-heading": 0.6506184484994173, "complete-iteration": 0.311591435881222, "set_robot_commands": 0.006368078729685615, "deviation-center-line": 0.7153797678025385, "driven_lanedir_consec": 1.1856250938826185, "sim_compute_sim_state": 0.022170500720248502, "sim_compute_performance-ego": 0.006192287101465113, "sim_compute_robot_state-ego": 0.01117899049730862, "sim_compute_robot_state-parked0": 0.010048606816460104}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 0.7783468901478676, "get_ui_image": 0.050716187439712825, "step_physics": 0.1555688357820698, "survival_time": 5.09999999999999, "driven_lanedir": 0.4870179525099734, "get_state_dump": 0.01695867379506429, "sim_render-ego": 0.007216303956274893, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.023155415759367103, "deviation-heading": 0.7371537164253312, "complete-iteration": 0.3071237802505493, "set_robot_commands": 0.006905875953973508, "deviation-center-line": 0.31383033576316843, "driven_lanedir_consec": 0.4870179525099734, "sim_compute_sim_state": 0.01869891204086005, "sim_compute_performance-ego": 0.006080826123555501, "sim_compute_robot_state-ego": 0.010952108046587776, "sim_compute_robot_state-parked0": 0.01065370148303462}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 0.678601870577068, "get_ui_image": 0.050328412752472955, "step_physics": 0.1495145679859633, "survival_time": 4.449999999999992, "driven_lanedir": 0.4265885495638271, "get_state_dump": 0.017800708835044605, "sim_render-ego": 0.007563210605235582, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.023153449712174663, "deviation-heading": 0.7313565325928172, "complete-iteration": 0.3019209309910121, "set_robot_commands": 0.006595635682009579, "deviation-center-line": 0.2683902859812928, "driven_lanedir_consec": 0.4265885495638271, "sim_compute_sim_state": 0.0186280534508523, "sim_compute_performance-ego": 0.006359879890184724, "sim_compute_robot_state-ego": 0.011350516522868295, "sim_compute_robot_state-parked0": 0.010410590118236756}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.420991347968776, "get_ui_image": 0.050772811571757, "step_physics": 0.1522169621785482, "survival_time": 14.950000000000076, "driven_lanedir": 0.6446180995854834, "get_state_dump": 0.01774014949798584, "sim_render-ego": 0.007430936495463053, "in-drivable-lane": 10.500000000000083, "agent_compute-ego": 0.02410286823908488, "deviation-heading": 0.8468082391327437, "complete-iteration": 0.301361517906189, "set_robot_commands": 0.006480255921681722, "deviation-center-line": 0.14192664544797587, "driven_lanedir_consec": 0.6446180995854834, "sim_compute_sim_state": 0.015001036326090495, "sim_compute_performance-ego": 0.006176680723826091, "sim_compute_robot_state-ego": 0.011124277114868164, "sim_compute_robot_state-parked0": 0.010100971857706706}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.4072325102045298, "get_ui_image": 0.05071023464202881, "step_physics": 0.1541277058919271, "survival_time": 14.950000000000076, "driven_lanedir": 0.6414821295127923, "get_state_dump": 0.018024882475535076, "sim_render-ego": 0.007579862276713053, "in-drivable-lane": 10.500000000000083, "agent_compute-ego": 0.02467813014984131, "deviation-heading": 0.8474318367616545, "complete-iteration": 0.3049422804514567, "set_robot_commands": 0.006757165590922038, "deviation-center-line": 0.14728565348872835, "driven_lanedir_consec": 0.6414821295127923, "sim_compute_sim_state": 0.014826801617940267, "sim_compute_performance-ego": 0.006387005647023519, "sim_compute_robot_state-ego": 0.01116608222325643, "sim_compute_robot_state-parked0": 0.010468551317850749}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.411956006437587, "get_ui_image": 0.05013073841730754, "step_physics": 0.15415448745091756, "survival_time": 14.950000000000076, "driven_lanedir": 2.0163429659604093, "get_state_dump": 0.01808371861775716, "sim_render-ego": 0.0073699680964152015, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.02336780389149984, "deviation-heading": 2.098533601853976, "complete-iteration": 0.30733694156010943, "set_robot_commands": 0.006473016738891601, "deviation-center-line": 0.8309439677931447, "driven_lanedir_consec": 2.0163429659604093, "sim_compute_sim_state": 0.0201938525835673, "sim_compute_performance-ego": 0.006179229418436686, "sim_compute_robot_state-ego": 0.010893398920694988, "sim_compute_robot_state-parked0": 0.01027332623799642}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.410019798332097, "get_ui_image": 0.04993436892827352, "step_physics": 0.15182865619659425, "survival_time": 14.950000000000076, "driven_lanedir": 2.008955624758421, "get_state_dump": 0.01761022090911865, "sim_render-ego": 0.007276886304219563, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.023227932453155516, "deviation-heading": 2.0093607750461997, "complete-iteration": 0.3039271370569865, "set_robot_commands": 0.0063266674677530926, "deviation-center-line": 0.9632944711251068, "driven_lanedir_consec": 2.008955624758421, "sim_compute_sim_state": 0.020471618175506592, "sim_compute_performance-ego": 0.006111617088317871, "sim_compute_robot_state-ego": 0.010959555308024088, "sim_compute_robot_state-parked0": 0.009968121846516928}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 0.6646238014128742, "get_ui_image": 0.051468914205377754, "step_physics": 0.11934995380314914, "survival_time": 4.399999999999992, "driven_lanedir": 0.4333735891477426, "get_state_dump": 0.018836506388404152, "sim_render-ego": 0.007918715476989746, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.02498880299654874, "deviation-heading": 0.5913497050062915, "complete-iteration": 0.279052352363413, "set_robot_commands": 0.007564514875411987, "deviation-center-line": 0.31869876800675323, "driven_lanedir_consec": 0.4333735891477426, "sim_compute_sim_state": 0.018017595464533024, "sim_compute_performance-ego": 0.006937823512337424, "sim_compute_robot_state-ego": 0.012222035364671186, "sim_compute_robot_state-parked0": 0.011507722464474764}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 0.9412049206013268, "get_ui_image": 0.04948392190223883, "step_physics": 0.1205006059536264, "survival_time": 6.0499999999999865, "driven_lanedir": 0.5069617153220096, "get_state_dump": 0.019332745843682407, "sim_render-ego": 0.007151733745228161, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.02342636723163699, "deviation-heading": 0.585297346117501, "complete-iteration": 0.2703941617130248, "set_robot_commands": 0.006834211428303364, "deviation-center-line": 0.3863673220345931, "driven_lanedir_consec": 0.5069617153220096, "sim_compute_sim_state": 0.016196562238961213, "sim_compute_performance-ego": 0.005866038897805963, "sim_compute_robot_state-ego": 0.010842512461764754, "sim_compute_robot_state-parked0": 0.010544410421828592}}
set_robot_commands_max0.007564514875411987
set_robot_commands_mean0.006698755082967552
set_robot_commands_median0.0066388820615262975
set_robot_commands_min0.0063266674677530926
sim_compute_performance-ego_max0.006937823512337424
sim_compute_performance-ego_mean0.006237477074196522
sim_compute_performance-ego_median0.006177955071131388
sim_compute_performance-ego_min0.005866038897805963
sim_compute_robot_state-ego_max0.012222035364671186
sim_compute_robot_state-ego_mean0.011159910503739295
sim_compute_robot_state-ego_median0.011041916211446129
sim_compute_robot_state-ego_min0.010842512461764754
sim_compute_robot_state-parked0_max0.011507722464474764
sim_compute_robot_state-parked0_mean0.010447866516464618
sim_compute_robot_state-parked0_median0.010439570718043752
sim_compute_robot_state-parked0_min0.009968121846516928
sim_compute_sim_state_max0.022170500720248502
sim_compute_sim_state_mean0.01849229677931389
sim_compute_sim_state_median0.01866348274585617
sim_compute_sim_state_min0.014826801617940267
sim_render-ego_max0.007918715476989746
sim_render-ego_mean0.007424231116429718
sim_render-ego_median0.0073963632361561645
sim_render-ego_min0.007151733745228161
simulation-passed1
step_physics_max0.1555688357820698
step_physics_mean0.1450223398404357
step_physics_median0.15202280918757122
step_physics_min0.11934995380314914
survival_time_max14.950000000000076
survival_time_mean10.16000000000003
survival_time_min4.399999999999992

Highlights

33469

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-0-1

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-1-1

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-2-1

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-3-1

ETHZ_autolab_technical_track-4-0

ETHZ_autolab_technical_track-4-1

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.