Duckietown Challenges Home Challenges Submissions

Submission 745

Submission745
Competingyes
Challengeaido1_LF1_r3-v3
UserAnton Mashikhin 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13992 step2-scoring: 14003 step3-videos: 14006 step4-viz: 14010
Next
User labelAI DL RL MML XXXL 2k18 yoo
Admin priority50
Blessingn/a
User priority50

14010

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

14006

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
14010step4-vizsuccessyes0:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.786550593794506
deviation-center-line_median0.28404222493894965
in-drivable-lane_median0.10000000000000007


other stats
deviation-center-line_max0.507717046310039
deviation-center-line_mean0.3324638806081811
deviation-center-line_min0.13837419446280794
deviation-heading_max1.3807878977781234
deviation-heading_mean1.0403851584282833
deviation-heading_median1.014705794765345
deviation-heading_min0.7267362721664988
driven_any_max5.456843632682162
driven_any_mean3.694340421977538
driven_any_median4.344556621469376
driven_any_min1.296523482621127
driven_lanedir_max5.012754736743167
driven_lanedir_mean3.174687908348678
driven_lanedir_min1.1324075168078194
in-drivable-lane_max1.8666666666666687
in-drivable-lane_mean0.4866666666666673
in-drivable-lane_min0.03333333333333344
per-episodes
details{"ep000": {"driven_any": 4.344556621469376, "driven_lanedir": 2.786550593794506, "in-drivable-lane": 1.8666666666666687, "deviation-heading": 0.8892441782679916, "deviation-center-line": 0.28404222493894965}, "ep001": {"driven_any": 2.456695880389858, "driven_lanedir": 2.3205439269201458, "in-drivable-lane": 0.03333333333333344, "deviation-heading": 0.7267362721664988, "deviation-center-line": 0.24295124092895337}, "ep002": {"driven_any": 5.456843632682162, "driven_lanedir": 5.012754736743167, "in-drivable-lane": 0.3666666666666673, "deviation-heading": 1.1904516491634574, "deviation-center-line": 0.507717046310039}, "ep003": {"driven_any": 4.9170824927251715, "driven_lanedir": 4.6211827674777535, "in-drivable-lane": 0.10000000000000007, "deviation-heading": 1.3807878977781234, "deviation-center-line": 0.4892346964001559}, "ep004": {"driven_any": 1.296523482621127, "driven_lanedir": 1.1324075168078194, "in-drivable-lane": 0.06666666666666687, "deviation-heading": 1.014705794765345, "deviation-center-line": 0.13837419446280794}}
No reset possible
14006step3-videossuccessyes0:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
14003step2-scoringsuccessyes0:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.266666666666658


other stats
episodes
details{"ep000": {"nsteps": 158, "reward": -6.443896666687878, "good_angle": 0.5558670749976514, "survival_time": 5.266666666666658, "traveled_tiles": 8, "valid_direction": 1.733333333333335}, "ep001": {"nsteps": 89, "reward": -10.729929503095285, "good_angle": 0.10515861578190572, "survival_time": 2.966666666666666, "traveled_tiles": 5, "valid_direction": 0.30000000000000093}, "ep002": {"nsteps": 186, "reward": -4.875641627297286, "good_angle": 0.22887121095168503, "survival_time": 6.199999999999988, "traveled_tiles": 10, "valid_direction": 0.7333333333333318}, "ep003": {"nsteps": 173, "reward": -5.27640387682901, "good_angle": 0.21153864216163695, "survival_time": 5.766666666666656, "traveled_tiles": 8, "valid_direction": 0.6666666666666664}, "ep004": {"nsteps": 64, "reward": -15.04919581123977, "good_angle": 0.5091537933886537, "survival_time": 2.1333333333333355, "traveled_tiles": 2, "valid_direction": 0.7666666666666679}}
good_angle_max0.5558670749976514
good_angle_mean0.3221178674563066
good_angle_median0.22887121095168503
good_angle_min0.10515861578190572
reward_max-4.875641627297286
reward_mean-8.475013497029845
reward_median-6.443896666687878
reward_min-15.04919581123977
survival_time_max6.199999999999988
survival_time_mean4.466666666666661
survival_time_min2.1333333333333355
traveled_tiles_max10
traveled_tiles_mean6.6
traveled_tiles_median8
traveled_tiles_min2
valid_direction_max1.733333333333335
valid_direction_mean0.8400000000000004
valid_direction_median0.7333333333333318
valid_direction_min0.30000000000000093
No reset possible
13992step1-simulationsuccessyes0:06:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10712step1-simulationfailedno0:10:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6614step1-simulationabortedno0:00:16
Error while running [...]

Creating job6614-6431_solution_1  ... error
stderr | ERROR: for job6614-6431_solution_1  Cannot start service solution: network job6614-6431_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job6614-6431_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job6614-6431_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6388step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission745/step1-simulation-nutonomy-P50-2570-job6388'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5653step4-vizsuccessno0:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5652step4-vizsuccessno0:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5651step3-videossuccessno0:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5650step2-scoringsuccessno0:01:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5649step2-scoringsuccessno0:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5648step1-simulationsuccessno0:09:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible