Duckietown Challenges Home Challenges Submissions

Submission 940

Submission940
Competingyes
Challengeaido1_LF1_r3-v3
UserDavid Abraham
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 13328 step2-scoring: 7760 step3-videos: 7763 step4-viz: 7767
Next
User labelPytorch IL
Admin priority50
Blessingn/a
User priority50

7767

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

7763

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
13328step1-simulationerroryes0:03:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7767step4-vizsuccessyes0:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4524595137794645
deviation-center-line_median0.12839941939762656
in-drivable-lane_median0


other stats
deviation-center-line_max0.7983372443672196
deviation-center-line_mean0.3380569545926784
deviation-center-line_min0.07408682132034992
deviation-heading_max5.279562013364543
deviation-heading_mean2.036813170556792
deviation-heading_median0.3199694854199965
deviation-heading_min0.1808021473176744
driven_any_max9.64812532793395
driven_any_mean3.716725938501999
driven_any_median0.7942371126606618
driven_any_min0.4879643179665967
driven_lanedir_max4.224767646159132
driven_lanedir_mean1.4928239510861143
driven_lanedir_min0.2364698935657361
in-drivable-lane_max6.1000000000000085
in-drivable-lane_mean1.4600000000000009
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.869135875499666, "driven_lanedir": 2.2877849291825276, "in-drivable-lane": 6.1000000000000085, "deviation-heading": 5.279562013364543, "deviation-center-line": 0.6012225514085052}, "ep001": {"driven_any": 0.7942371126606618, "driven_lanedir": 0.26263777274371103, "in-drivable-lane": 0, "deviation-heading": 0.3199694854199965, "deviation-center-line": 0.08823873646969087}, "ep002": {"driven_any": 0.7841670584491253, "driven_lanedir": 0.4524595137794645, "in-drivable-lane": 0, "deviation-heading": 0.29175076592833826, "deviation-center-line": 0.12839941939762656}, "ep003": {"driven_any": 9.64812532793395, "driven_lanedir": 4.224767646159132, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 4.111981440753408, "deviation-center-line": 0.7983372443672196}, "ep004": {"driven_any": 0.4879643179665967, "driven_lanedir": 0.2364698935657361, "in-drivable-lane": 0, "deviation-heading": 0.1808021473176744, "deviation-center-line": 0.07408682132034992}}
No reset possible
7766step4-vizsuccessyes0:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7765step4-vizsuccessyes0:02:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7764step4-vizabortedyes0:00:13
Error while running [...]

Creating job7764-5029_visualization_1 ... error
stderr | ERROR: for job7764-5029_visualization_1  Cannot start service visualization: network job7764-5029_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job7764-5029_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7763step3-videossuccessyes0:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
7762step3-videosabortedyes0:00:12
Error while running [...]

Creating job7762-21_videos_1 ... error
stderr | ERROR: for job7762-21_videos_1  Cannot start service videos: network job7762-21_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job7762-21_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7761step3-videossuccessyes0:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7760step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.5666666666666682


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.4576184816499007, "good_angle": 40.9939386169918, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 9.933333333333335}, "ep001": {"nsteps": 30, "reward": -33.80661088923613, "good_angle": 0.13794416402598422, "survival_time": 1, "traveled_tiles": 1, "valid_direction": 0.33333333333333326}, "ep002": {"nsteps": 47, "reward": -21.693168340528263, "good_angle": 0.06418811201799242, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.1000000000000002}, "ep003": {"nsteps": 433, "reward": -2.8357827126970148, "good_angle": 8.859400916232572, "survival_time": 14.433333333333293, "traveled_tiles": 7, "valid_direction": 4.466666666666655}, "ep004": {"nsteps": 24, "reward": -42.15544073283672, "good_angle": 0.05680776574138376, "survival_time": 0.7999999999999999, "traveled_tiles": 1, "valid_direction": 0.1333333333333333}}
good_angle_max40.9939386169918
good_angle_mean10.022455915001943
good_angle_median0.13794416402598422
good_angle_min0.05680776574138376
reward_max-1.4576184816499007
reward_mean-20.389724231389607
reward_median-21.693168340528263
reward_min-42.15544073283672
survival_time_max16.666666666666654
survival_time_mean6.893333333333322
survival_time_min0.7999999999999999
traveled_tiles_max7
traveled_tiles_mean3
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max9.933333333333335
valid_direction_mean2.9933333333333314
valid_direction_median0.33333333333333326
valid_direction_min0.1000000000000002
No reset possible
7759step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7758step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible