Duckietown Challenges Home Challenges Submissions

Submission 5300

Submission5300
Competingyes
Challengeaido3-LF-sim-validation
UserCharles Cossette 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 28298
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessingn/a
User priority50

28298

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
28298step1-simulationsuccessyes0:06:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8456106458621762
survival_time_median3.8499999999999943
deviation-center-line_median0.26983439330449555
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.07224392581295658
agent_compute-ego_mean0.06548300652423149
agent_compute-ego_median0.06797403585715373
agent_compute-ego_min0.05930702928183736
deviation-center-line_max0.8022899930644706
deviation-center-line_mean0.4317850912554199
deviation-center-line_min0.1263889048637164
deviation-heading_max2.5660298850996557
deviation-heading_mean1.463995547323408
deviation-heading_median0.998514910518803
deviation-heading_min0.5411256965796114
driven_any_max4.436428773521588
driven_any_mean2.1542720297555484
driven_any_median0.870820311054286
driven_any_min0.8536644928845308
driven_lanedir_consec_max3.777435017870282
driven_lanedir_consec_mean1.8856538079727925
driven_lanedir_consec_min0.7933737317943355
driven_lanedir_max3.777435017870282
driven_lanedir_mean1.8856538079727925
driven_lanedir_median0.8456106458621762
driven_lanedir_min0.7933737317943355
in-drivable-lane_max2.1500000000000004
in-drivable-lane_mean0.8099999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.750754625757883, "sim_physics": 0.06853607018788656, "survival_time": 14.950000000000076, "driven_lanedir": 3.1707674744457655, "sim_render-ego": 0.011502261956532795, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.0597858190536499, "deviation-heading": 2.5660298850996557, "set_robot_commands": 0.009232045809427896, "deviation-center-line": 0.8022899930644706, "driven_lanedir_consec": 3.1707674744457655, "sim_compute_sim_state": 0.005162471135457356, "sim_compute_performance-ego": 0.007152283986409505, "sim_compute_robot_state-ego": 0.00869850476582845}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.870820311054286, "sim_physics": 0.07640973381374193, "survival_time": 3.4499999999999957, "driven_lanedir": 0.8456106458621762, "sim_render-ego": 0.012296082316965296, "in-drivable-lane": 0, "agent_compute-ego": 0.05930702928183736, "deviation-heading": 0.71544000532169, "set_robot_commands": 0.009495780087899471, "deviation-center-line": 0.1795210583273447, "driven_lanedir_consec": 0.8456106458621762, "sim_compute_sim_state": 0.005567215491032255, "sim_compute_performance-ego": 0.007319623145504274, "sim_compute_robot_state-ego": 0.009222296700961348}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.436428773521588, "sim_physics": 0.07288867553075154, "survival_time": 14.950000000000076, "driven_lanedir": 3.777435017870282, "sim_render-ego": 0.01279854377110799, "in-drivable-lane": 2.1500000000000004, "agent_compute-ego": 0.0681042226155599, "deviation-heading": 2.498867239097281, "set_robot_commands": 0.010412388642628988, "deviation-center-line": 0.7808911067170724, "driven_lanedir_consec": 3.777435017870282, "sim_compute_sim_state": 0.005661152203877767, "sim_compute_performance-ego": 0.007991929848988851, "sim_compute_robot_state-ego": 0.00951172351837158}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8536644928845308, "sim_physics": 0.07123903485087606, "survival_time": 3.8499999999999943, "driven_lanedir": 0.7933737317943355, "sim_render-ego": 0.012029239109584264, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.07224392581295658, "deviation-heading": 0.998514910518803, "set_robot_commands": 0.009870346490438884, "deviation-center-line": 0.26983439330449555, "driven_lanedir_consec": 0.7933737317943355, "sim_compute_sim_state": 0.005439875961898209, "sim_compute_performance-ego": 0.007222578123018339, "sim_compute_robot_state-ego": 0.00877036057509385}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.859691945559452, "sim_physics": 0.08188834737558834, "survival_time": 3.049999999999997, "driven_lanedir": 0.8410821698914022, "sim_render-ego": 0.013904258853099384, "in-drivable-lane": 0, "agent_compute-ego": 0.06797403585715373, "deviation-heading": 0.5411256965796114, "set_robot_commands": 0.010515807104892418, "deviation-center-line": 0.1263889048637164, "driven_lanedir_consec": 0.8410821698914022, "sim_compute_sim_state": 0.0059890395305195795, "sim_compute_performance-ego": 0.0084196075064237, "sim_compute_robot_state-ego": 0.010576943882176133}}
set_robot_commands_max0.010515807104892418
set_robot_commands_mean0.009905273627057532
set_robot_commands_median0.009870346490438884
set_robot_commands_min0.009232045809427896
sim_compute_performance-ego_max0.0084196075064237
sim_compute_performance-ego_mean0.007621204522068934
sim_compute_performance-ego_median0.007319623145504274
sim_compute_performance-ego_min0.007152283986409505
sim_compute_robot_state-ego_max0.010576943882176133
sim_compute_robot_state-ego_mean0.009355965888486271
sim_compute_robot_state-ego_median0.009222296700961348
sim_compute_robot_state-ego_min0.00869850476582845
sim_compute_sim_state_max0.0059890395305195795
sim_compute_sim_state_mean0.005563950864557033
sim_compute_sim_state_median0.005567215491032255
sim_compute_sim_state_min0.005162471135457356
sim_physics_max0.08188834737558834
sim_physics_mean0.07419237235176887
sim_physics_median0.07288867553075154
sim_physics_min0.06853607018788656
sim_render-ego_max0.013904258853099384
sim_render-ego_mean0.012506077201457948
sim_render-ego_median0.012296082316965296
sim_render-ego_min0.011502261956532795
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.05000000000003
survival_time_min3.049999999999997
No reset possible
28297step1-simulationerroryes0:01:23
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible