Duckietown Challenges Home Challenges Submissions

Submission 17122

Submission17122
Competingyes
Challengemooc-ros-template
UserPaul Villedieu
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim: 132227
Next
User labelROS template
Admin priority50
Blessingn/a
User priority50

132227

Click the images to see detailed statistics about the episode.

LF-full-loop-000

LF-full-loop-001

LF-full-loop-002

LF-full-loop-003

LF-full-loop-004

LF-full-loop-005

LF-full-loop-006

LF-full-loop-007

LF-full-loop-008

LF-full-loop-009

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
132227simsuccessyes0:43:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median7.079941292842511


other stats
deviation-center-line_max4.649323239690349
deviation-center-line_mean3.296660109138979
deviation-center-line_median3.954041523800888
deviation-center-line_min0.11297185582155626
deviation-heading_max8.338556950436825
deviation-heading_mean6.077556784672915
deviation-heading_median7.104840204208611
deviation-heading_min0.9980327523657342
distance-from-start_max3.2590072942547135
distance-from-start_mean2.30305540302067
distance-from-start_median2.4797256090282858
distance-from-start_min0.6451100719993116
driven_any_max7.921227405966952
driven_any_mean6.590155885323942
driven_any_median7.921191318155707
driven_any_min1.222789690050458
driven_lanedir_consec_max7.617256469184879
driven_lanedir_consec_mean5.74963615478448
driven_lanedir_consec_min0.0781786404039595
driven_lanedir_max7.617256469184879
driven_lanedir_mean5.74963615478448
driven_lanedir_median7.079941292842511
driven_lanedir_min0.0781786404039595
in-drivable-lane_max9.70000000000002
in-drivable-lane_mean5.504999999999894
in-drivable-lane_median5.374999999999826
in-drivable-lane_min0.9499999999999966
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 1.3223944737821602, "survival_time": 11.00000000000002, "driven_lanedir": 0.0781786404039595, "in-drivable-lane": 9.70000000000002, "deviation-heading": 1.1067206852046674, "distance-from-start": 0.8498490312962449, "deviation-center-line": 0.11297185582155626, "driven_lanedir_consec": 0.0781786404039595}, "LF-full-loop-001-ego0": {"driven_any": 7.907920314868603, "survival_time": 59.99999999999873, "driven_lanedir": 6.508618538370583, "in-drivable-lane": 9.349999999999696, "deviation-heading": 7.535744188236613, "distance-from-start": 2.4633641359206244, "deviation-center-line": 4.564212650333717, "driven_lanedir_consec": 6.508618538370583}, "LF-full-loop-002-ego0": {"driven_any": 1.222789690050458, "survival_time": 10.25000000000001, "driven_lanedir": 0.08835971238963514, "in-drivable-lane": 8.95000000000001, "deviation-heading": 0.9980327523657342, "distance-from-start": 0.6451100719993116, "deviation-center-line": 0.11695142040615758, "driven_lanedir_consec": 0.08835971238963514}, "LF-full-loop-003-ego0": {"driven_any": 7.921222911366589, "survival_time": 59.99999999999873, "driven_lanedir": 6.887140088618155, "in-drivable-lane": 6.899999999999814, "deviation-heading": 6.298191122983862, "distance-from-start": 3.0750153380426495, "deviation-center-line": 3.9070117987710815, "driven_lanedir_consec": 6.887140088618155}, "LF-full-loop-004-ego0": {"driven_any": 7.92122721362373, "survival_time": 59.99999999999873, "driven_lanedir": 6.948780766004542, "in-drivable-lane": 6.199999999999816, "deviation-heading": 6.995500135558651, "distance-from-start": 3.2590072942547135, "deviation-center-line": 3.665224092211035, "driven_lanedir_consec": 6.948780766004542}, "LF-full-loop-005-ego0": {"driven_any": 7.921189595036179, "survival_time": 59.99999999999873, "driven_lanedir": 7.617256469184879, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 8.338556950436825, "distance-from-start": 2.6410903448554164, "deviation-center-line": 4.015254258832339, "driven_lanedir_consec": 7.617256469184879}, "LF-full-loop-006-ego0": {"driven_any": 7.921193041275235, "survival_time": 59.99999999999873, "driven_lanedir": 7.492464532015259, "in-drivable-lane": 1.9999999999999891, "deviation-heading": 7.858390424951909, "distance-from-start": 1.9938530488764472, "deviation-center-line": 4.649323239690349, "driven_lanedir_consec": 7.492464532015259}, "LF-full-loop-007-ego0": {"driven_any": 7.921183053121584, "survival_time": 59.99999999999873, "driven_lanedir": 7.328156359497002, "in-drivable-lane": 3.099999999999824, "deviation-heading": 8.172286281135476, "distance-from-start": 2.3892432513725557, "deviation-center-line": 4.02756872772178, "driven_lanedir_consec": 7.328156359497002}, "LF-full-loop-008-ego0": {"driven_any": 7.921227405966952, "survival_time": 59.99999999999873, "driven_lanedir": 7.211101819680479, "in-drivable-lane": 4.5499999999998355, "deviation-heading": 6.257965032996838, "distance-from-start": 2.4960870821359475, "deviation-center-line": 3.9354241590359833, "driven_lanedir_consec": 7.211101819680479}, "LF-full-loop-009-ego0": {"driven_any": 7.921211154147937, "survival_time": 59.99999999999873, "driven_lanedir": 7.336304621680309, "in-drivable-lane": 3.3499999999999366, "deviation-heading": 7.214180272858571, "distance-from-start": 3.2179344314527825, "deviation-center-line": 3.972658888565792, "driven_lanedir_consec": 7.336304621680309}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean50.12499999999899
survival_time_min10.25000000000001
No reset possible
131517simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-03-job131517-673995, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-03-job131517-673995', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131509simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-03-job131509-488589, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-03-job131509-488589', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131503simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-03-job131503-754454, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-03-job131503-754454', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131499simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-03-job131499-700093, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-03-job131499-700093', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131494simhost-erroryes0:00:19
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-03-job131494-283674, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-03-job131494-283674', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131492simhost-erroryes0:00:21
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-03-job131492-556697, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-03-job131492-556697', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131447simhost-erroryes0:00:21
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-05-job131447-621142, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-05-job131447-621142', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131442simhost-erroryes0:00:19
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-01-job131442-762043, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-01-job131442-762043', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131435simhost-erroryes0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-05-job131435-453454, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-05-job131435-453454', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131431simhost-erroryes0:00:21
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-02-job131431-306670, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-02-job131431-306670', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131425simhost-erroryes0:00:23
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-05-job131425-857873, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-05-job131425-857873', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131422simhost-erroryes0:01:03
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-02-job131422-952038, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-02-job131422-952038', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
131416simhost-erroryes0:02:06
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, davinci-04-job131416-336014, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'davinci-04-job131416-336014', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
89056simsuccessno1:17:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88926simtimeoutno0:00:04
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88924simhost-errorno0:16:46
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 275, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 166, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 152, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/mooc-ros-template/submission17122/sim-nogpu-production-b-spot-0-01-job88924-a-wd/docker-compose.yaml' -> '/tmp/tmpmyyob44vdocker-compose.yaml'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88919simhost-errorno0:51:56
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 275, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 166, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 152, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/mooc-ros-template/submission17122/sim-nogpu-production-b-spot-0-05-job88919-a-wd/challenge-evaluation-output/episodes/LF-full-loop-004/log.gs2.cbor' -> '/tmp/tmpuf5hkqqrlog.gs2.cbor'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88913simsuccessno1:11:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88907simhost-errorno0:10:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 862, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 48, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 275, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 418, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 275, in copyfile
    _fastcopy_sendfile(fsrc, fdst)
  File "/usr/lib/python3.8/shutil.py", line 166, in _fastcopy_sendfile
    raise err from None
  File "/usr/lib/python3.8/shutil.py", line 152, in _fastcopy_sendfile
    sent = os.sendfile(outfd, infd, offset, blocksize)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/mooc-ros-template/submission17122/sim-nogpu-production-b-spot-0-02-job88907-a-wd/docker-compose.yaml' -> '/tmp/tmpxsf0i6jbdocker-compose.yaml'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88903simsuccessno1:19:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
88901simsuccessno1:18:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
86200simerrorno0:00:48
The result file [...]
    The result file is not found in working dir /home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17122/sim-montreal03_a39f3a5a13b9-job86200-a-wd:

    File '/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17122/sim-montreal03_a39f3a5a13b9-job86200-a-wd/challenge-results/challenge_results.yaml' does not exist.

    This usually means that the evaluator did not finish and some times that there was an import error.
    Check the evaluator log to see what happened.

List of all files:

 -/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17122/sim-montreal03_a39f3a5a13b9-job86200-a-wd/docker-compose.original.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17122/sim-montreal03_a39f3a5a13b9-job86200-a-wd/runner
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17122/sim-montreal03_a39f3a5a13b9-job86200-a-wd/docker-compose.yaml
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17122/sim-montreal03_a39f3a5a13b9-job86200-a-wd/logs/evaluator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17122/sim-montreal03_a39f3a5a13b9-job86200-a-wd/logs/evaluator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17122/sim-montreal03_a39f3a5a13b9-job86200-a-wd/logs/simulator/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17122/sim-montreal03_a39f3a5a13b9-job86200-a-wd/logs/simulator/online.html
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17122/sim-montreal03_a39f3a5a13b9-job86200-a-wd/logs/challenges-runner/stdout.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17122/sim-montreal03_a39f3a5a13b9-job86200-a-wd/logs/challenges-runner/stderr.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17122/sim-montreal03_a39f3a5a13b9-job86200-a-wd/logs/solution-ego0/online.log
-/home/aido/duckietown-tmp-evals/production/mooc-ros-template/submission17122/sim-montreal03_a39f3a5a13b9-job86200-a-wd/logs/solution-ego0/online.html
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible