Duckietown Challenges Home Challenges Submissions

Submission 17117

Submission17117
Competingyes
Challengemooc-ros-template
UserMaxime Fournier
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim: 132229
Next
User labelROS template
Admin priority50
Blessingn/a
User priority50

132229

Click the images to see detailed statistics about the episode.

LF-full-loop-000

LF-full-loop-001

LF-full-loop-002

LF-full-loop-003

LF-full-loop-004

LF-full-loop-005

LF-full-loop-006

LF-full-loop-007

LF-full-loop-008

LF-full-loop-009

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
132229simsuccessyes0:41:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median6.508790639190804


other stats
deviation-center-line_max4.498905907579358
deviation-center-line_mean3.557717946842634
deviation-center-line_median3.874755429843975
deviation-center-line_min0.1266155155058548
deviation-heading_max8.890582490636316
deviation-heading_mean6.72362578048439
deviation-heading_median7.195854411133686
deviation-heading_min0.965254744375462
distance-from-start_max3.246150290904158
distance-from-start_mean2.4504371928075077
distance-from-start_median2.476054182029297
distance-from-start_min0.7148375274677834
driven_any_max7.921211411504835
driven_any_mean7.103953570624654
driven_any_median7.921168577499426
driven_any_min1.7869964632952753
driven_lanedir_consec_max7.205916999623032
driven_lanedir_consec_mean5.8650076082590825
driven_lanedir_consec_min0.10684633794818388
driven_lanedir_max7.205916999623032
driven_lanedir_mean5.8650076082590825
driven_lanedir_median6.508790639190804
driven_lanedir_min0.10684633794818388
in-drivable-lane_max13.10000000000007
in-drivable-lane_mean8.319999999999837
in-drivable-lane_median8.174999999999848
in-drivable-lane_min2.849999999999916
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 7.921181199039134, "survival_time": 59.99999999999873, "driven_lanedir": 6.336405857937223, "in-drivable-lane": 10.699999999999656, "deviation-heading": 7.097906492447905, "distance-from-start": 2.2836878583308735, "deviation-center-line": 3.9240821637899135, "driven_lanedir_consec": 6.336405857937223}, "LF-full-loop-001-ego0": {"driven_any": 7.90788812865445, "survival_time": 59.99999999999873, "driven_lanedir": 6.093320767932095, "in-drivable-lane": 12.34999999999964, "deviation-heading": 7.743606462437189, "distance-from-start": 2.452713419170429, "deviation-center-line": 4.498905907579358, "driven_lanedir_consec": 6.093320767932095}, "LF-full-loop-002-ego0": {"driven_any": 1.7869964632952753, "survival_time": 14.500000000000073, "driven_lanedir": 0.10684633794818388, "in-drivable-lane": 13.10000000000007, "deviation-heading": 0.965254744375462, "distance-from-start": 0.7148375274677834, "deviation-center-line": 0.1266155155058548, "driven_lanedir_consec": 0.10684633794818388}, "LF-full-loop-003-ego0": {"driven_any": 7.921192826121152, "survival_time": 59.99999999999873, "driven_lanedir": 6.686124498531289, "in-drivable-lane": 7.999999999999847, "deviation-heading": 7.372373557176945, "distance-from-start": 3.076951104483011, "deviation-center-line": 3.759077717793375, "driven_lanedir_consec": 6.686124498531289}, "LF-full-loop-004-ego0": {"driven_any": 7.921209792773971, "survival_time": 59.99999999999873, "driven_lanedir": 6.742715408555915, "in-drivable-lane": 7.649999999999846, "deviation-heading": 7.293802329819467, "distance-from-start": 3.246150290904158, "deviation-center-line": 3.8842199040746928, "driven_lanedir_consec": 6.742715408555915}, "LF-full-loop-005-ego0": {"driven_any": 7.921116401640843, "survival_time": 59.99999999999873, "driven_lanedir": 7.205916999623032, "in-drivable-lane": 3.799999999999903, "deviation-heading": 8.890582490636316, "distance-from-start": 2.600447060406674, "deviation-center-line": 3.8164269492575986, "driven_lanedir_consec": 7.205916999623032}, "LF-full-loop-006-ego0": {"driven_any": 5.8963870777390035, "survival_time": 45.449999999999555, "driven_lanedir": 5.493894826662364, "in-drivable-lane": 2.849999999999916, "deviation-heading": 5.831091757657797, "distance-from-start": 2.002903026278936, "deviation-center-line": 3.2420695808688373, "driven_lanedir_consec": 5.493894826662364}, "LF-full-loop-007-ego0": {"driven_any": 7.921155955959716, "survival_time": 59.99999999999873, "driven_lanedir": 6.987791959705165, "in-drivable-lane": 5.349999999999922, "deviation-heading": 8.741468212263912, "distance-from-start": 2.432785623625178, "deviation-center-line": 3.865290955613257, "driven_lanedir_consec": 6.987791959705165}, "LF-full-loop-008-ego0": {"driven_any": 7.921211411504835, "survival_time": 59.99999999999873, "driven_lanedir": 6.681175420444385, "in-drivable-lane": 8.349999999999849, "deviation-heading": 6.743332098902792, "distance-from-start": 2.4993949448881647, "deviation-center-line": 4.431467059149099, "driven_lanedir_consec": 6.681175420444385}, "LF-full-loop-009-ego0": {"driven_any": 7.921196449518166, "survival_time": 59.99999999999873, "driven_lanedir": 6.315884005251172, "in-drivable-lane": 11.049999999999716, "deviation-heading": 6.556839659126125, "distance-from-start": 3.194501072519865, "deviation-center-line": 4.029023714794355, "driven_lanedir_consec": 6.315884005251172}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean53.994999999998946
survival_time_min14.500000000000073
No reset possible
131565simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131565-510337, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131565-510337', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131561simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131561-502595, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131561-502595', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131557simhost-erroryes0:00:22
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131557-227375, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131557-227375', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131550simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131550-766100, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131550-766100', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131547simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131547-406902, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131547-406902', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131543simhost-erroryes0:00:21
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131543-423543, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131543-423543', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131535simhost-erroryes0:00:23
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131535-870345, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131535-870345', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131483simhost-erroryes0:00:19
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-05-job131483-983049, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-05-job131483-983049', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131478simhost-erroryes0:00:21
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-04-job131478-784559, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-04-job131478-784559', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131473simhost-erroryes0:00:19
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-04-job131473-404675, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-04-job131473-404675', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131468simhost-erroryes0:00:21
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-03-job131468-668797, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-03-job131468-668797', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131466simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-02-job131466-181314, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-02-job131466-181314', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131460simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-02-job131460-805239, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-02-job131460-805239', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131457simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-03-job131457-180283, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-03-job131457-180283', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131449simhost-erroryes0:00:25
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-03-job131449-871941, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-03-job131449-871941', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
89120simsuccessno1:09:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88927simtimeoutno0:00:16
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88922simhost-errorno0:14:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 275, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 166, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 152, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/mooc-ros-template/submission17117/sim-nogpu-production-b-spot-0-05-job88922-a-wd/challenge-evaluation-output/episodes/LF-full-loop-001/log.gs2.cbor' -> '/tmp/tmpk1zvet51log.gs2.cbor'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88920simhost-errorno0:18:37
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 275, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 166, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 152, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/mooc-ros-template/submission17117/sim-nogpu-production-b-spot-0-04-job88920-a-wd/challenge-evaluation-output/episodes/LF-full-loop-004/log.gs2.cbor' -> '/tmp/tmp5osr8wellog.gs2.cbor'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88915simsuccessno1:12:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86194simerrorno0:00:53
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17117/sim-montreal02_b87fca61d0e7-job86194-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17117/sim-montreal02_b87fca61d0e7-job86194-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17117/sim-montreal02_b87fca61d0e7-job86194-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17117/sim-montreal02_b87fca61d0e7-job86194-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17117/sim-montreal02_b87fca61d0e7-job86194-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17117/sim-montreal02_b87fca61d0e7-job86194-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17117/sim-montreal02_b87fca61d0e7-job86194-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17117/sim-montreal02_b87fca61d0e7-job86194-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17117/sim-montreal02_b87fca61d0e7-job86194-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17117/sim-montreal02_b87fca61d0e7-job86194-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17117/sim-montreal02_b87fca61d0e7-job86194-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17117/sim-montreal02_b87fca61d0e7-job86194-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17117/sim-montreal02_b87fca61d0e7-job86194-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible