Duckietown Challenges Home Challenges Submissions

Submission 2253

Submission2253
Competingyes
Challengeaido2_LF_r2-v4
UserJulian Zilly
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 17186
Next
User labelBaseline solution using imitation learning from logs
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
17186step1-simulationsuccessyes0:07:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2469151058065284
survival_time_median4.549999999999992
deviation-center-line_median0.04673004722572329
in-drivable-lane_median0.849999999999997


other stats
agent_compute-ego_max0.23555966523977423
agent_compute-ego_mean0.22302934553022444
agent_compute-ego_median0.23014935556348864
agent_compute-ego_min0.2072117203160336
deviation-center-line_max0.061457877720478366
deviation-center-line_mean0.05095058286703961
deviation-center-line_min0.042501106286433485
deviation-heading_max0.36517707596691096
deviation-heading_mean0.3372931031687029
deviation-heading_median0.34410295297602933
deviation-heading_min0.298864949256562
driven_any_max1.5853517251659737
driven_any_mean1.347864839296439
driven_any_median1.584670967044581
driven_any_min0.9919467599574832
driven_lanedir_consec_max1.3525881201642544
driven_lanedir_consec_mean1.0530227741105436
driven_lanedir_consec_min0.6573330891045548
driven_lanedir_max1.3525881201642544
driven_lanedir_mean1.0530227741105436
driven_lanedir_median1.2469151058065284
driven_lanedir_min0.6573330891045548
in-drivable-lane_max0.849999999999997
in-drivable-lane_mean0.7499999999999973
in-drivable-lane_min0.5999999999999979
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9919467599574832, "sim_physics": 0.004287251254968476, "survival_time": 2.849999999999998, "driven_lanedir": 0.6573330891045548, "sim_render-ego": 0.06315779685974121, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.2072117203160336, "deviation-heading": 0.34410295297602933, "set_robot_commands": 0.07814210339596397, "deviation-center-line": 0.042501106286433485, "driven_lanedir_consec": 0.6573330891045548, "sim_compute_sim_state": 0.04085655379713627, "sim_compute_performance-ego": 0.06508303525155051, "sim_compute_robot_state-ego": 0.3012176187414872}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9926024685247504, "sim_physics": 0.0026083410831919886, "survival_time": 2.849999999999998, "driven_lanedir": 0.7613569691244798, "sim_render-ego": 0.05898722431115937, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.21071600495723256, "deviation-heading": 0.298864949256562, "set_robot_commands": 0.07725640765407629, "deviation-center-line": 0.05733461368242161, "driven_lanedir_consec": 0.7613569691244798, "sim_compute_sim_state": 0.043356100718180336, "sim_compute_performance-ego": 0.061631871942888224, "sim_compute_robot_state-ego": 0.0756362237428364}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5853517251659737, "sim_physics": 0.003139545629312704, "survival_time": 4.549999999999992, "driven_lanedir": 1.3525881201642544, "sim_render-ego": 0.056749273132491895, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.23014935556348864, "deviation-heading": 0.3131585902966368, "set_robot_commands": 0.08109266417367118, "deviation-center-line": 0.061457877720478366, "driven_lanedir_consec": 1.3525881201642544, "sim_compute_sim_state": 0.04230534113370455, "sim_compute_performance-ego": 0.06022455142094539, "sim_compute_robot_state-ego": 0.0733658926827567}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5847522757894064, "sim_physics": 0.002739450433752039, "survival_time": 4.549999999999992, "driven_lanedir": 1.2469205863529005, "sim_render-ego": 0.05922895997435182, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.23150998157459304, "deviation-heading": 0.3651619473473758, "set_robot_commands": 0.07979523742591942, "deviation-center-line": 0.04672926942014128, "driven_lanedir_consec": 1.2469205863529005, "sim_compute_sim_state": 0.04418608382507995, "sim_compute_performance-ego": 0.06209033924144703, "sim_compute_robot_state-ego": 0.07881901290390518}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.584670967044581, "sim_physics": 0.002798046384538923, "survival_time": 4.549999999999992, "driven_lanedir": 1.2469151058065284, "sim_render-ego": 0.061275330218640005, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.23555966523977423, "deviation-heading": 0.36517707596691096, "set_robot_commands": 0.07996899479038112, "deviation-center-line": 0.04673004722572329, "driven_lanedir_consec": 1.2469151058065284, "sim_compute_sim_state": 0.04438006222903074, "sim_compute_performance-ego": 0.06479465830457079, "sim_compute_robot_state-ego": 0.07670148650368491}}
set_robot_commands_max0.08109266417367118
set_robot_commands_mean0.07925108148800239
set_robot_commands_median0.07979523742591942
set_robot_commands_min0.07725640765407629
sim_compute_performance-ego_max0.06508303525155051
sim_compute_performance-ego_mean0.06276489123228039
sim_compute_performance-ego_median0.06209033924144703
sim_compute_performance-ego_min0.06022455142094539
sim_compute_robot_state-ego_max0.3012176187414872
sim_compute_robot_state-ego_mean0.12114804691493408
sim_compute_robot_state-ego_median0.07670148650368491
sim_compute_robot_state-ego_min0.0733658926827567
sim_compute_sim_state_max0.04438006222903074
sim_compute_sim_state_mean0.04301682834062637
sim_compute_sim_state_median0.043356100718180336
sim_compute_sim_state_min0.04085655379713627
sim_physics_max0.004287251254968476
sim_physics_mean0.003114526957152826
sim_physics_median0.002798046384538923
sim_physics_min0.0026083410831919886
sim_render-ego_max0.06315779685974121
sim_render-ego_mean0.05987971689927686
sim_render-ego_median0.05922895997435182
sim_render-ego_min0.056749273132491895
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean3.869999999999995
survival_time_min2.849999999999998
No reset possible
17101step1-simulationsuccessno0:09:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
17034step1-simulationsuccessno0:06:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16965step1-simulationsuccessno0:10:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
16818step1-simulationerrorno0:19:05
Error while running [...]

Pulling evaluator      ... done
stderr | ERROR: for simulator  write /var/lib/docker/tmp/GetImageBlob998925750: no space left on device
stderr | write /var/lib/docker/tmp/GetImageBlob998925750: no space left on device
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible