Duckietown Challenges Home Challenges Submissions

Submission 687

Submission687
Competingyes
Challengeaido1_LF1_r3-v3
UserMandana Samiei 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13351 step2-scoring: 13364 step3-videos: 13367 step4-viz: 13371
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

13371

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13367

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13371step4-vizsuccessyes0:03:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.2714336594329
deviation-center-line_median0.5569188104981396
in-drivable-lane_median1.2666666666666622


other stats
deviation-center-line_max2.4630939170863377
deviation-center-line_mean1.149232047247004
deviation-center-line_min0.1307973252154854
deviation-heading_max1.5039038366024164
deviation-heading_mean1.0775100190062783
deviation-heading_median1.183763485773499
deviation-heading_min0.23411158561902337
driven_any_max5.335645546434336
driven_any_mean2.922600067214783
driven_any_median1.8532320531846775
driven_any_min0.4283472526665047
driven_lanedir_max4.610460048696211
driven_lanedir_mean2.317034588210382
driven_lanedir_min0.4187765336892091
in-drivable-lane_max3.9333333333333194
in-drivable-lane_mean1.6466666666666612
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.6601825818562577, "driven_lanedir": 1.24631845600737, "in-drivable-lane": 0.9666666666666662, "deviation-heading": 1.4279116339883189, "deviation-center-line": 0.38010402198937093}, "ep001": {"driven_any": 5.335645546434336, "driven_lanedir": 4.0381842432262225, "in-drivable-lane": 3.9333333333333194, "deviation-heading": 1.0378595530481345, "deviation-center-line": 2.215246161445687}, "ep002": {"driven_any": 5.335592901932138, "driven_lanedir": 4.610460048696211, "in-drivable-lane": 2.0666666666666593, "deviation-heading": 1.183763485773499, "deviation-center-line": 2.4630939170863377}, "ep003": {"driven_any": 0.4283472526665047, "driven_lanedir": 0.4187765336892091, "in-drivable-lane": 0, "deviation-heading": 0.23411158561902337, "deviation-center-line": 0.1307973252154854}, "ep004": {"driven_any": 1.8532320531846775, "driven_lanedir": 1.2714336594329, "in-drivable-lane": 1.2666666666666622, "deviation-heading": 1.5039038366024164, "deviation-center-line": 0.5569188104981396}}
No reset possible
13367step3-videossuccessyes0:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13364step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.833333333333322


other stats
episodes
details{"ep000": {"nsteps": 157, "reward": -5.853171486758248, "good_angle": 0.5706102847226819, "survival_time": 5.2333333333333245, "traveled_tiles": 3, "valid_direction": 1.7333333333333327}, "ep001": {"nsteps": 500, "reward": 0.22853902287059463, "good_angle": 0.5831963801408289, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.4333333333333291}, "ep002": {"nsteps": 500, "reward": 0.29473067964054644, "good_angle": 0.545817470332487, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.03333333333333}, "ep003": {"nsteps": 42, "reward": -23.5382668101007, "good_angle": 0.12195921403314522, "survival_time": 1.400000000000001, "traveled_tiles": 1, "valid_direction": 0.16666666666666696}, "ep004": {"nsteps": 175, "reward": -5.4731847972529275, "good_angle": 1.797869249021679, "survival_time": 5.833333333333322, "traveled_tiles": 5, "valid_direction": 2.033333333333327}}
good_angle_max1.797869249021679
good_angle_mean0.7238905196501644
good_angle_median0.5706102847226819
good_angle_min0.12195921403314522
reward_max0.29473067964054644
reward_mean-6.868270678320147
reward_median-5.4731847972529275
reward_min-23.5382668101007
survival_time_max16.666666666666654
survival_time_mean9.159999999999991
survival_time_min1.400000000000001
traveled_tiles_max10
traveled_tiles_mean5.8
traveled_tiles_median5
traveled_tiles_min1
valid_direction_max2.033333333333327
valid_direction_mean1.2799999999999971
valid_direction_median1.4333333333333291
valid_direction_min0.16666666666666696
No reset possible
13351step1-simulationsuccessyes0:05:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
7127step1-simulationfailedno0:08:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6676step1-simulationabortedno0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission687/step1-simulation-nutonomy-P50-2210-job6676'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6477step1-simulationabortedno0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission687/step1-simulation-nutonomy-P50-2570-job6477'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5390step1-simulationfailedno0:06:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible