Duckietown Challenges Home Challenges Submissions

Submission 818

Submission818
Competingyes
Challengeaido1_LF1_r3-v3
UserGunshi Gupta 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12148 step2-scoring: 12165 step3-videos: 12168 step4-viz: 12171
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

12171

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

12168

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
12171step4-vizsuccessyes0:00:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3083855982558559
deviation-center-line_median0.10805014213083708
in-drivable-lane_median0


other stats
deviation-center-line_max0.1253931262064992
deviation-center-line_mean0.08993164049723107
deviation-center-line_min0.02575017388270385
deviation-heading_max0.8219031647836553
deviation-heading_mean0.32794525685454246
deviation-heading_median0.23116968987580724
deviation-heading_min0.11637751695558604
driven_any_max0.5995277395742603
driven_any_mean0.3383756844876683
driven_any_median0.3212489493943731
driven_any_min0.09632193593653636
driven_lanedir_max0.3672981692325208
driven_lanedir_mean0.2720452957129906
driven_lanedir_min0.0590640233175046
in-drivable-lane_max0.5666666666666667
in-drivable-lane_mean0.11333333333333331
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5995277395742603, "driven_lanedir": 0.32846359640721245, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 0.8219031647836553, "deviation-center-line": 0.1253931262064992}, "ep001": {"driven_any": 0.3212489493943731, "driven_lanedir": 0.3083855982558559, "in-drivable-lane": 0, "deviation-heading": 0.23116968987580724, "deviation-center-line": 0.07937594066447065}, "ep002": {"driven_any": 0.09632193593653636, "driven_lanedir": 0.0590640233175046, "in-drivable-lane": 0, "deviation-heading": 0.2774487130670167, "deviation-center-line": 0.02575017388270385}, "ep003": {"driven_any": 0.37489834751954626, "driven_lanedir": 0.3672981692325208, "in-drivable-lane": 0, "deviation-heading": 0.1928271995906471, "deviation-center-line": 0.1110888196016446}, "ep004": {"driven_any": 0.29988145001362554, "driven_lanedir": 0.2970150913518592, "in-drivable-lane": 0, "deviation-heading": 0.11637751695558604, "deviation-center-line": 0.10805014213083708}}
No reset possible
12168step3-videossuccessyes0:00:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
12165step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.0666666666666669


other stats
episodes
details{"ep000": {"nsteps": 58, "reward": -17.197546308667494, "good_angle": 1.1182921911063572, "survival_time": 1.933333333333336, "traveled_tiles": 1, "valid_direction": 1.600000000000002}, "ep001": {"nsteps": 32, "reward": -30.889099814230576, "good_angle": 0.12943177989907056, "survival_time": 1.0666666666666669, "traveled_tiles": 2, "valid_direction": 0.20000000000000007}, "ep002": {"nsteps": 11, "reward": -90.93398553302342, "good_angle": 0.3153497778408451, "survival_time": 0.36666666666666664, "traveled_tiles": 1, "valid_direction": 0.3333333333333333}, "ep003": {"nsteps": 37, "reward": -26.73538103951393, "good_angle": 0.10270639275678148, "survival_time": 1.2333333333333338, "traveled_tiles": 1, "valid_direction": 0.16666666666666718}, "ep004": {"nsteps": 30, "reward": -33.140036127964656, "good_angle": 0.020222921024106243, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.03333333333333333}}
good_angle_max1.1182921911063572
good_angle_mean0.33720061252543215
good_angle_median0.12943177989907056
good_angle_min0.020222921024106243
reward_max-17.197546308667494
reward_mean-39.77920976468001
reward_median-30.889099814230576
reward_min-90.93398553302342
survival_time_max1.933333333333336
survival_time_mean1.1200000000000006
survival_time_min0.36666666666666664
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.600000000000002
valid_direction_mean0.4666666666666671
valid_direction_median0.20000000000000007
valid_direction_min0.03333333333333333
No reset possible
12148step1-simulationsuccessyes0:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
6775step4-vizsuccessyes0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6774step3-videossuccessyes0:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6768step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6758step1-simulationsuccessno0:05:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6549step4-vizabortedyes0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission818/step4-viz-nutonomy-P50-2570-job6549'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6428step4-vizabortedyes0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission818/step4-viz-nutonomy-P50-2570-job6428'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6260step4-vizsuccessno0:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6258step3-videosabortedyes0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6256step2-scoringabortedyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6250step1-simulationabortedno0:04:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6059step1-simulationabortedno0:06:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6058step1-simulationsuccessno0:08:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible