Duckietown Challenges Home Challenges Submissions

Submission 3095

Submission3095
Competingyes
Challengeaido2-LF-sim-validation
UserAngel Woo 🇭🇰
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22623
Next
User labelBaseline-IL-logs-tensorflow
Admin priority50
Blessingn/a
User priority50

22623

Click the images to see detailed statistics about the episode.

ETHZ_autolab_technical_track-0-0

ETHZ_autolab_technical_track-1-0

ETHZ_autolab_technical_track-2-0

ETHZ_autolab_technical_track-3-0

ETHZ_autolab_technical_track-4-0

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
22623step1-simulationsuccessyes0:13:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6626451572998673
survival_time_median12.700000000000044
deviation-center-line_median0.579164605687578
in-drivable-lane_median0


other stats
agent_compute-ego_max0.21174285252888997
agent_compute-ego_mean0.20732999410293437
agent_compute-ego_median0.20771304460672232
agent_compute-ego_min0.2044666010563768
deviation-center-line_max0.7876298025621941
deviation-center-line_mean0.6026518212483782
deviation-center-line_min0.4120442272877873
deviation-heading_max3.7296027530774833
deviation-heading_mean2.1801189624090997
deviation-heading_median1.7981812167704303
deviation-heading_min0.8294865348998007
driven_any_max1.2032197823323167
driven_any_mean0.7991074015322965
driven_any_median0.9942712378208872
driven_any_min0.2744432793312555
driven_lanedir_consec_max1.1784491375135415
driven_lanedir_consec_mean0.6802702433965833
driven_lanedir_consec_min0.26763572113334133
driven_lanedir_max1.1784491375135415
driven_lanedir_mean0.6802702433965833
driven_lanedir_median0.6626451572998673
driven_lanedir_min0.26763572113334133
in-drivable-lane_max3.2000000000000455
in-drivable-lane_mean0.9700000000000136
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0200943148183406, "sim_physics": 0.05761255603283644, "survival_time": 12.800000000000049, "driven_lanedir": 0.6626451572998673, "sim_render-ego": 0.06593466084450483, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.2048044065013528, "deviation-heading": 3.7296027530774833, "set_robot_commands": 0.07728441432118416, "deviation-center-line": 0.579164605687578, "driven_lanedir_consec": 0.6626451572998673, "sim_compute_sim_state": 0.04377464950084686, "sim_compute_performance-ego": 0.06629474274814129, "sim_compute_robot_state-ego": 0.06357841473072767}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9942712378208872, "sim_physics": 0.05712471045847014, "survival_time": 12.700000000000044, "driven_lanedir": 0.807100633426297, "sim_render-ego": 0.06519666900784951, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.2044666010563768, "deviation-heading": 2.8389049295425326, "set_robot_commands": 0.07748046165376198, "deviation-center-line": 0.7876298025621941, "driven_lanedir_consec": 0.807100633426297, "sim_compute_sim_state": 0.04307326932591716, "sim_compute_performance-ego": 0.06670731822336752, "sim_compute_robot_state-ego": 0.06361567786359411}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2744432793312555, "sim_physics": 0.06034368515014649, "survival_time": 3.7499999999999942, "driven_lanedir": 0.26763572113334133, "sim_render-ego": 0.06803918838500976, "in-drivable-lane": 0, "agent_compute-ego": 0.21174285252888997, "deviation-heading": 0.8294865348998007, "set_robot_commands": 0.07802038828531901, "deviation-center-line": 0.4120442272877873, "driven_lanedir_consec": 0.26763572113334133, "sim_compute_sim_state": 0.04270016670227051, "sim_compute_performance-ego": 0.06692264556884765, "sim_compute_robot_state-ego": 0.06553738276163737}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.503508393358682, "sim_physics": 0.06034020093771127, "survival_time": 6.499999999999985, "driven_lanedir": 0.48552056760986906, "sim_render-ego": 0.06776747336754432, "in-drivable-lane": 0, "agent_compute-ego": 0.20771304460672232, "deviation-heading": 1.7044193777552517, "set_robot_commands": 0.07722812982705923, "deviation-center-line": 0.5044204827108707, "driven_lanedir_consec": 0.48552056760986906, "sim_compute_sim_state": 0.04362430022313045, "sim_compute_performance-ego": 0.06627352787898137, "sim_compute_robot_state-ego": 0.06491623291602501}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2032197823323167, "sim_physics": 0.05856090148289998, "survival_time": 14.950000000000076, "driven_lanedir": 1.1784491375135415, "sim_render-ego": 0.06665181398391723, "in-drivable-lane": 0, "agent_compute-ego": 0.20792306582132977, "deviation-heading": 1.7981812167704303, "set_robot_commands": 0.07761007308959961, "deviation-center-line": 0.7299999879934617, "driven_lanedir_consec": 1.1784491375135415, "sim_compute_sim_state": 0.04374019622802734, "sim_compute_performance-ego": 0.06886862675348918, "sim_compute_robot_state-ego": 0.06410152912139892}}
set_robot_commands_max0.07802038828531901
set_robot_commands_mean0.0775246934353848
set_robot_commands_median0.07748046165376198
set_robot_commands_min0.07722812982705923
sim_compute_performance-ego_max0.06886862675348918
sim_compute_performance-ego_mean0.06701337223456541
sim_compute_performance-ego_median0.06670731822336752
sim_compute_performance-ego_min0.06627352787898137
sim_compute_robot_state-ego_max0.06553738276163737
sim_compute_robot_state-ego_mean0.06434984747867663
sim_compute_robot_state-ego_median0.06410152912139892
sim_compute_robot_state-ego_min0.06357841473072767
sim_compute_sim_state_max0.04377464950084686
sim_compute_sim_state_mean0.04338251639603846
sim_compute_sim_state_median0.04362430022313045
sim_compute_sim_state_min0.04270016670227051
sim_physics_max0.06034368515014649
sim_physics_mean0.058796410812412866
sim_physics_median0.05856090148289998
sim_physics_min0.05712471045847014
sim_render-ego_max0.06803918838500976
sim_render-ego_mean0.06671796111776512
sim_render-ego_median0.06665181398391723
sim_render-ego_min0.06519666900784951
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.140000000000027
survival_time_min3.7499999999999942
No reset possible
20827step1-simulationsuccessno0:12:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20696step1-simulationsuccessno0:10:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
20695step1-simulationhost-errorno0:03:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20695-248229', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20695-248229', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20695-248229', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible