Job ID step status up to date date started date completed duration message 22815
step1-simulation success yes 2019-05-17 02:07:34+00:00 2019-05-17 02:29:56+00:00 0:22:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.26543479260232994 survival_time_median 3.5499999999999954 deviation-center-line_median 0.23910407569423 in-drivable-lane_median 0.30000000000000426
other stats agent_compute-ego_max 0.10860885514153376 agent_compute-ego_mean 0.09789067797329024 agent_compute-ego_median 0.0961849578221639 agent_compute-ego_min 0.0844975864286903 deviation-center-line_max 1.1535568089483947 deviation-center-line_mean 0.4925611681048516 deviation-center-line_min 0.14171773416189698 deviation-heading_max 6.730851577205935 deviation-heading_mean 3.1136331686511345 deviation-heading_median 1.6025051766500047 deviation-heading_min 0.5439981627131697 driven_any_max 2.348858998049182 driven_any_mean 1.116061327104622 driven_any_median 0.499959472880548 driven_any_min 0.23562442318253665 driven_lanedir_consec_max 1.563231605767316 driven_lanedir_consec_mean 0.6334436558637075 driven_lanedir_consec_min 0.1838990275548249 driven_lanedir_max 2.037126293343852 driven_lanedir_mean 0.7807369369178254 driven_lanedir_median 0.26543479260232994 driven_lanedir_min 0.2109222805807189 in-drivable-lane_max 3.6000000000000343 in-drivable-lane_mean 0.9600000000000072 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 0.499959472880548, "sim_physics": 0.23930889452007456, "survival_time": 3.5499999999999954, "driven_lanedir": 0.23148868050436144, "sim_render-ego": 0.06909680030715297, "in-drivable-lane": 0.8999999999999977, "agent_compute-ego": 0.09267558178431552, "deviation-heading": 1.6025051766500047, "set_robot_commands": 0.11561803414788044, "deviation-center-line": 0.23910407569423, "driven_lanedir_consec": 0.1838990275548249, "sim_compute_sim_state": 0.04144963748018506, "sim_compute_performance-ego": 0.07635457750777123, "sim_compute_robot_state-ego": 0.08474665964153451, "sim_compute_robot_state-npc0": 0.07816729747073752, "sim_compute_robot_state-npc1": 0.07566748202686578, "sim_compute_robot_state-npc2": 0.07496113844320808, "sim_compute_robot_state-npc3": 0.07688702663905184}, "udem1-1-0": {"driven_any": 0.3159741146440911, "sim_physics": 0.2373695943666541, "survival_time": 2.3, "driven_lanedir": 0.26543479260232994, "sim_render-ego": 0.07099132434181545, "in-drivable-lane": 0, "agent_compute-ego": 0.10748640868974768, "deviation-heading": 1.1083072802579417, "set_robot_commands": 0.11381580518639606, "deviation-center-line": 0.14171773416189698, "driven_lanedir_consec": 0.26543479260232994, "sim_compute_sim_state": 0.04328583116116731, "sim_compute_performance-ego": 0.07575909469438635, "sim_compute_robot_state-ego": 0.08443653065225352, "sim_compute_robot_state-npc0": 0.07419802313265593, "sim_compute_robot_state-npc1": 0.0754725984905077, "sim_compute_robot_state-npc2": 0.07704048571379288, "sim_compute_robot_state-npc3": 0.07397981311963953}, "udem1-2-0": {"driven_any": 2.1798896267667525, "sim_physics": 0.2087190622906033, "survival_time": 13.900000000000064, "driven_lanedir": 1.1587126375578642, "sim_render-ego": 0.06320085199616796, "in-drivable-lane": 3.6000000000000343, "agent_compute-ego": 0.0844975864286903, "deviation-heading": 6.730851577205935, "set_robot_commands": 0.10065491079426496, "deviation-center-line": 0.7841236293430482, "driven_lanedir_consec": 0.9437305728133478, "sim_compute_sim_state": 0.03918761486629787, "sim_compute_performance-ego": 0.06957814590536433, "sim_compute_robot_state-ego": 0.07666157904288752, "sim_compute_robot_state-npc0": 0.07632664896601396, "sim_compute_robot_state-npc1": 0.06828542064419753, "sim_compute_robot_state-npc2": 0.07350385960915105, "sim_compute_robot_state-npc3": 0.06963009199650168}, "udem1-3-0": {"driven_any": 0.23562442318253665, "sim_physics": 0.26782382196850246, "survival_time": 1.800000000000001, "driven_lanedir": 0.2109222805807189, "sim_render-ego": 0.07236828406651814, "in-drivable-lane": 0, "agent_compute-ego": 0.10860885514153376, "deviation-heading": 0.5439981627131697, "set_robot_commands": 0.1275033023622301, "deviation-center-line": 0.14430359237668816, "driven_lanedir_consec": 0.2109222805807189, "sim_compute_sim_state": 0.046732677353752985, "sim_compute_performance-ego": 0.08079432778888279, "sim_compute_robot_state-ego": 0.09050678544574314, "sim_compute_robot_state-npc0": 0.08146519793404473, "sim_compute_robot_state-npc1": 0.08052429225709704, "sim_compute_robot_state-npc2": 0.0833574997054206, "sim_compute_robot_state-npc3": 0.08062035507626003}, "udem1-4-0": {"driven_any": 2.348858998049182, "sim_physics": 0.2487187647819519, "survival_time": 14.950000000000076, "driven_lanedir": 2.037126293343852, "sim_render-ego": 0.07188812096913656, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.0961849578221639, "deviation-heading": 5.582503646428622, "set_robot_commands": 0.11770303328831992, "deviation-center-line": 1.1535568089483947, "driven_lanedir_consec": 1.563231605767316, "sim_compute_sim_state": 0.044566972255706785, "sim_compute_performance-ego": 0.080744415918986, "sim_compute_robot_state-ego": 0.08648629188537597, "sim_compute_robot_state-npc0": 0.08032128890355428, "sim_compute_robot_state-npc1": 0.08067387421925863, "sim_compute_robot_state-npc2": 0.07905415217081706, "sim_compute_robot_state-npc3": 0.07937532345453899}}set_robot_commands_max 0.1275033023622301 set_robot_commands_mean 0.1150590171558183 set_robot_commands_median 0.11561803414788044 set_robot_commands_min 0.10065491079426496 sim_compute_performance-ego_max 0.08079432778888279 sim_compute_performance-ego_mean 0.07664611236307814 sim_compute_performance-ego_median 0.07635457750777123 sim_compute_performance-ego_min 0.06957814590536433 sim_compute_robot_state-ego_max 0.09050678544574314 sim_compute_robot_state-ego_mean 0.08456756933355894 sim_compute_robot_state-ego_median 0.08474665964153451 sim_compute_robot_state-ego_min 0.07666157904288752 sim_compute_robot_state-npc0_max 0.08146519793404473 sim_compute_robot_state-npc0_mean 0.07809569128140129 sim_compute_robot_state-npc0_median 0.07816729747073752 sim_compute_robot_state-npc0_min 0.07419802313265593 sim_compute_robot_state-npc1_max 0.08067387421925863 sim_compute_robot_state-npc1_mean 0.07612473352758534 sim_compute_robot_state-npc1_median 0.07566748202686578 sim_compute_robot_state-npc1_min 0.06828542064419753 sim_compute_robot_state-npc2_max 0.0833574997054206 sim_compute_robot_state-npc2_mean 0.07758342712847795 sim_compute_robot_state-npc2_median 0.07704048571379288 sim_compute_robot_state-npc2_min 0.07350385960915105 sim_compute_robot_state-npc3_max 0.08062035507626003 sim_compute_robot_state-npc3_mean 0.0760985220571984 sim_compute_robot_state-npc3_median 0.07688702663905184 sim_compute_robot_state-npc3_min 0.06963009199650168 sim_compute_sim_state_max 0.046732677353752985 sim_compute_sim_state_mean 0.043044546623422 sim_compute_sim_state_median 0.04328583116116731 sim_compute_sim_state_min 0.03918761486629787 sim_physics_max 0.26782382196850246 sim_physics_mean 0.2403880275855573 sim_physics_median 0.23930889452007456 sim_physics_min 0.2087190622906033 sim_render-ego_max 0.07236828406651814 sim_render-ego_mean 0.06950907633615822 sim_render-ego_median 0.07099132434181545 sim_render-ego_min 0.06320085199616796 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 7.300000000000027 survival_time_min 1.800000000000001
No reset possible 21079
step1-simulation success no 2019-04-27 18:00:24+00:00 2019-04-27 18:17:18+00:00 0:16:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21070
step1-simulation host-error no 2019-04-27 17:48:30+00:00 2019-04-27 18:00:11+00:00 0:11:41 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2712/step1-simulation-ip-172-31-42-167-7227-job21070/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20390
step1-simulation success no 2019-04-25 12:01:51+00:00 2019-04-25 12:25:07+00:00 0:23:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20372
step1-simulation host-error no 2019-04-25 11:55:24+00:00 2019-04-25 12:00:07+00:00 0:04:43 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20372-621167', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20372-621167', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job20372-621167', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19415
step1-simulation success no 2019-04-24 14:31:52+00:00 2019-04-24 14:41:20+00:00 0:09:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19406
step1-simulation success no 2019-04-24 14:29:09+00:00 2019-04-24 14:48:49+00:00 0:19:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18670
step1-simulation error no 2019-04-20 09:36:59+00:00 2019-04-20 09:58:42+00:00 0:21:43 Waited 1203 seconds [...] Waited 1203 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18328
step1-simulation success no 2019-04-19 12:45:45+00:00 2019-04-19 13:03:20+00:00 0:17:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18093
step1-simulation success no 2019-04-17 15:11:14+00:00 2019-04-17 15:19:15+00:00 0:08:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18092
step1-simulation success no 2019-04-17 14:59:09+00:00 2019-04-17 15:09:54+00:00 0:10:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible