Duckietown Challenges Home Challenges Submissions

Submission 3100

Submission3100
Competingyes
Challengeaido2-LF-sim-validation
UserAngel Woo 🇭🇰
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22618
Next
User labelHKU Duckietown Project
Admin priority50
Blessingn/a
User priority50

22618

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22618step1-simulationsuccessyes0:22:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3935727153650439
survival_time_median14.950000000000076
deviation-center-line_median0.6466427937780732
in-drivable-lane_median5.500000000000034


other stats
agent_compute-ego_max0.21337078742261203
agent_compute-ego_mean0.20239466227259464
agent_compute-ego_median0.20413884957631429
agent_compute-ego_min0.18890088717142745
deviation-center-line_max0.9779434166630756
deviation-center-line_mean0.6649754478321979
deviation-center-line_min0.4881676799918456
deviation-heading_max3.26314960386251
deviation-heading_mean2.0823416382275277
deviation-heading_median1.724625616762611
deviation-heading_min1.181027030878925
driven_any_max0.9412727235507892
driven_any_mean0.8637377362443888
driven_any_median0.9276922548524884
driven_any_min0.6766918480592531
driven_lanedir_consec_max0.8094803982364791
driven_lanedir_consec_mean0.5153489143728593
driven_lanedir_consec_min0.31149029580133125
driven_lanedir_max0.8094803982364791
driven_lanedir_mean0.5153489143728593
driven_lanedir_median0.3935727153650439
driven_lanedir_min0.31149029580133125
in-drivable-lane_max9.250000000000089
in-drivable-lane_mean5.07000000000005
in-drivable-lane_min1.6000000000000227
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.834392800838722, "sim_physics": 0.10123842257373736, "survival_time": 13.250000000000052, "driven_lanedir": 0.3935727153650439, "sim_render-ego": 0.060896583773055166, "in-drivable-lane": 6.700000000000069, "agent_compute-ego": 0.21337078742261203, "deviation-heading": 1.181027030878925, "set_robot_commands": 0.09021933843504708, "deviation-center-line": 0.7002521882241406, "driven_lanedir_consec": 0.3935727153650439, "sim_compute_sim_state": 0.03760909494364037, "sim_compute_performance-ego": 0.06703699309870882, "sim_compute_robot_state-ego": 0.0722113348403067}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9276922548524884, "sim_physics": 0.10807468016942344, "survival_time": 14.950000000000076, "driven_lanedir": 0.31149029580133125, "sim_render-ego": 0.06458664496739705, "in-drivable-lane": 9.250000000000089, "agent_compute-ego": 0.20413884957631429, "deviation-heading": 1.724625616762611, "set_robot_commands": 0.08972506443659464, "deviation-center-line": 0.4881676799918456, "driven_lanedir_consec": 0.31149029580133125, "sim_compute_sim_state": 0.03747052113215128, "sim_compute_performance-ego": 0.0656225315729777, "sim_compute_robot_state-ego": 0.07135714769363403}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9386390539206902, "sim_physics": 0.10496691465377808, "survival_time": 14.950000000000076, "driven_lanedir": 0.7501626448576149, "sim_render-ego": 0.05974237680435181, "in-drivable-lane": 2.3000000000000327, "agent_compute-ego": 0.20111995061238608, "deviation-heading": 3.26314960386251, "set_robot_commands": 0.08790677626927694, "deviation-center-line": 0.9779434166630756, "driven_lanedir_consec": 0.7501626448576149, "sim_compute_sim_state": 0.03854273160298665, "sim_compute_performance-ego": 0.06501022895177205, "sim_compute_robot_state-ego": 0.07117399772008261}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9412727235507892, "sim_physics": 0.09618916591008504, "survival_time": 14.950000000000076, "driven_lanedir": 0.8094803982364791, "sim_render-ego": 0.054257647196451826, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.18890088717142745, "deviation-heading": 2.7543938265147205, "set_robot_commands": 0.08426105737686157, "deviation-center-line": 0.6466427937780732, "driven_lanedir_consec": 0.8094803982364791, "sim_compute_sim_state": 0.03568856954574585, "sim_compute_performance-ego": 0.0605241068204244, "sim_compute_robot_state-ego": 0.06453232844670613}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6766918480592531, "sim_physics": 0.10217540404375862, "survival_time": 11.050000000000022, "driven_lanedir": 0.3120385176038276, "sim_render-ego": 0.06004637614634242, "in-drivable-lane": 5.500000000000034, "agent_compute-ego": 0.20444283658023335, "deviation-heading": 1.4885121131188732, "set_robot_commands": 0.09156613544101629, "deviation-center-line": 0.5118711605038551, "driven_lanedir_consec": 0.3120385176038276, "sim_compute_sim_state": 0.03817481692560118, "sim_compute_performance-ego": 0.06755214578965131, "sim_compute_robot_state-ego": 0.07242471492128674}}
set_robot_commands_max0.09156613544101629
set_robot_commands_mean0.0887356743917593
set_robot_commands_median0.08972506443659464
set_robot_commands_min0.08426105737686157
sim_compute_performance-ego_max0.06755214578965131
sim_compute_performance-ego_mean0.06514920124670685
sim_compute_performance-ego_median0.0656225315729777
sim_compute_performance-ego_min0.0605241068204244
sim_compute_robot_state-ego_max0.07242471492128674
sim_compute_robot_state-ego_mean0.07033990472440324
sim_compute_robot_state-ego_median0.07135714769363403
sim_compute_robot_state-ego_min0.06453232844670613
sim_compute_sim_state_max0.03854273160298665
sim_compute_sim_state_mean0.037497146830025065
sim_compute_sim_state_median0.03760909494364037
sim_compute_sim_state_min0.03568856954574585
sim_physics_max0.10807468016942344
sim_physics_mean0.10252891747015652
sim_physics_median0.10217540404375862
sim_physics_min0.09618916591008504
sim_render-ego_max0.06458664496739705
sim_render-ego_mean0.05990592577751965
sim_render-ego_median0.06004637614634242
sim_render-ego_min0.054257647196451826
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.83000000000006
survival_time_min11.050000000000022
No reset possible
22615step1-simulationhost-erroryes0:01:57
Error while running [...]

stderr | Pulling simulator      ... 
stderr | Pulling evaluator      ... 
stderr | Pulling scenario_maker ... 
stderr | Pulling solution       ... done
stderr | 
stderr | ERROR: for simulator  Get https://registry-1.docker.io/v2/andreacensi/aido2-lf-sim-validation-step1-simulation-simulator/manifests/2019_05_16_15_47_39: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lf-sim-validation-step1-simulation-simulator%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr | 
stderr | ERROR: for evaluator  Get https://registry-1.docker.io/v2/andreacensi/aido2-lf-sim-validation-step1-simulation-evaluator/manifests/2019_05_16_15_47_29: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lf-sim-validation-step1-simulation-evaluator%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr | 
stderr | ERROR: for scenario_maker  Get https://registry-1.docker.io/v2/andreacensi/aido2-lf-sim-validation-step1-simulation-scenario_maker/manifests/2019_05_16_15_47_59: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lf-sim-validation-step1-simulation-scenario_maker%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr | Get https://registry-1.docker.io/v2/andreacensi/aido2-lf-sim-validation-step1-simulation-simulator/manifests/2019_05_16_15_47_39: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lf-sim-validation-step1-simulation-simulator%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr | Get https://registry-1.docker.io/v2/andreacensi/aido2-lf-sim-validation-step1-simulation-evaluator/manifests/2019_05_16_15_47_29: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lf-sim-validation-step1-simulation-evaluator%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr | Get https://registry-1.docker.io/v2/andreacensi/aido2-lf-sim-validation-step1-simulation-scenario_maker/manifests/2019_05_16_15_47_59: Get https://auth.docker.io/token?scope=repository%3Aandreacensi%2Faido2-lf-sim-validation-step1-simulation-scenario_maker%3Apull&service=registry.docker.io: net/http: TLS handshake timeout
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20808step1-simulationsuccessno0:25:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20704step1-simulationsuccessno0:13:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible