AI Driving Olympics Home Challenges Submissions Jobs

Submission 940

Submission940
Competingyes
Challengeaido1_LF1_r3-v3
UserDavid
Date submitted
Completecomplete
Resulterror
Jobsstep1-simulation: 13328 step2-scoring: 7760 step3-videos: 7763 step4-viz: 7767
Next
User labelPytorch IL
Admin priority50
User priority50

7767

Click the images to see detailed statistics about the episode.

7763

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
13328940DavidPytorch ILaido1_LF1_r3-v3step1-simulationerroryes-0:03:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
(hidden)
7767940DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes-0:11:23(hidden)
driven_lanedir_median0.4524595137794645
deviation-center-line_median0.12839941939762656
in-drivable-lane_median0


other stats
deviation-center-line_max0.7983372443672196
deviation-center-line_mean0.3380569545926784
deviation-center-line_min0.07408682132034992
deviation-heading_max5.279562013364543
deviation-heading_mean2.036813170556792
deviation-heading_median0.3199694854199965
deviation-heading_min0.1808021473176744
driven_any_max9.64812532793395
driven_any_mean3.716725938501999
driven_any_median0.7942371126606618
driven_any_min0.4879643179665967
driven_lanedir_max4.224767646159132
driven_lanedir_mean1.4928239510861143
driven_lanedir_min0.2364698935657361
in-drivable-lane_max6.1000000000000085
in-drivable-lane_mean1.4600000000000009
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.869135875499666, "driven_lanedir": 2.2877849291825276, "in-drivable-lane": 6.1000000000000085, "deviation-heading": 5.279562013364543, "deviation-center-line": 0.6012225514085052}, "ep001": {"driven_any": 0.7942371126606618, "driven_lanedir": 0.26263777274371103, "in-drivable-lane": 0, "deviation-heading": 0.3199694854199965, "deviation-center-line": 0.08823873646969087}, "ep002": {"driven_any": 0.7841670584491253, "driven_lanedir": 0.4524595137794645, "in-drivable-lane": 0, "deviation-heading": 0.29175076592833826, "deviation-center-line": 0.12839941939762656}, "ep003": {"driven_any": 9.64812532793395, "driven_lanedir": 4.224767646159132, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 4.111981440753408, "deviation-center-line": 0.7983372443672196}, "ep004": {"driven_any": 0.4879643179665967, "driven_lanedir": 0.2364698935657361, "in-drivable-lane": 0, "deviation-heading": 0.1808021473176744, "deviation-center-line": 0.07408682132034992}}
7766940DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes-0:02:48(hidden)
driven_lanedir_median0.4524595137794645
deviation-center-line_median0.12839941939762656
in-drivable-lane_median0


other stats
deviation-center-line_max0.7983372443672196
deviation-center-line_mean0.3380569545926784
deviation-center-line_min0.07408682132034992
deviation-heading_max5.279562013364543
deviation-heading_mean2.036813170556792
deviation-heading_median0.3199694854199965
deviation-heading_min0.1808021473176744
driven_any_max9.64812532793395
driven_any_mean3.716725938501999
driven_any_median0.7942371126606618
driven_any_min0.4879643179665967
driven_lanedir_max4.224767646159132
driven_lanedir_mean1.4928239510861143
driven_lanedir_min0.2364698935657361
in-drivable-lane_max6.1000000000000085
in-drivable-lane_mean1.4600000000000009
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.869135875499666, "driven_lanedir": 2.2877849291825276, "in-drivable-lane": 6.1000000000000085, "deviation-heading": 5.279562013364543, "deviation-center-line": 0.6012225514085052}, "ep001": {"driven_any": 0.7942371126606618, "driven_lanedir": 0.26263777274371103, "in-drivable-lane": 0, "deviation-heading": 0.3199694854199965, "deviation-center-line": 0.08823873646969087}, "ep002": {"driven_any": 0.7841670584491253, "driven_lanedir": 0.4524595137794645, "in-drivable-lane": 0, "deviation-heading": 0.29175076592833826, "deviation-center-line": 0.12839941939762656}, "ep003": {"driven_any": 9.64812532793395, "driven_lanedir": 4.224767646159132, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 4.111981440753408, "deviation-center-line": 0.7983372443672196}, "ep004": {"driven_any": 0.4879643179665967, "driven_lanedir": 0.2364698935657361, "in-drivable-lane": 0, "deviation-heading": 0.1808021473176744, "deviation-center-line": 0.07408682132034992}}
7765940DavidPytorch ILaido1_LF1_r3-v3step4-vizsuccessyes-0:02:49(hidden)
driven_lanedir_median0.4524595137794645
deviation-center-line_median0.12839941939762656
in-drivable-lane_median0


other stats
deviation-center-line_max0.7983372443672196
deviation-center-line_mean0.3380569545926784
deviation-center-line_min0.07408682132034992
deviation-heading_max5.279562013364543
deviation-heading_mean2.036813170556792
deviation-heading_median0.3199694854199965
deviation-heading_min0.1808021473176744
driven_any_max9.64812532793395
driven_any_mean3.716725938501999
driven_any_median0.7942371126606618
driven_any_min0.4879643179665967
driven_lanedir_max4.224767646159132
driven_lanedir_mean1.4928239510861143
driven_lanedir_min0.2364698935657361
in-drivable-lane_max6.1000000000000085
in-drivable-lane_mean1.4600000000000009
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.869135875499666, "driven_lanedir": 2.2877849291825276, "in-drivable-lane": 6.1000000000000085, "deviation-heading": 5.279562013364543, "deviation-center-line": 0.6012225514085052}, "ep001": {"driven_any": 0.7942371126606618, "driven_lanedir": 0.26263777274371103, "in-drivable-lane": 0, "deviation-heading": 0.3199694854199965, "deviation-center-line": 0.08823873646969087}, "ep002": {"driven_any": 0.7841670584491253, "driven_lanedir": 0.4524595137794645, "in-drivable-lane": 0, "deviation-heading": 0.29175076592833826, "deviation-center-line": 0.12839941939762656}, "ep003": {"driven_any": 9.64812532793395, "driven_lanedir": 4.224767646159132, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 4.111981440753408, "deviation-center-line": 0.7983372443672196}, "ep004": {"driven_any": 0.4879643179665967, "driven_lanedir": 0.2364698935657361, "in-drivable-lane": 0, "deviation-heading": 0.1808021473176744, "deviation-center-line": 0.07408682132034992}}
7764940DavidPytorch ILaido1_LF1_r3-v3step4-vizabortedyes-0:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7764-5029', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7764-5029', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7764-5029_evaluation" with the default driver
stderr | Creating job7764-5029_visualization_1 ...
stderr | 
Creating job7764-5029_visualization_1 ... error

stderr | ERROR: for job7764-5029_visualization_1  Cannot start service visualization: network job7764-5029_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job7764-5029_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
(hidden)
7763940DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes-0:01:06(hidden)
other stats
videos1
7762940DavidPytorch ILaido1_LF1_r3-v3step3-videosabortedyes-0:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job7762-21', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job7762-21', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job7762-21_evaluation" with the default driver
stderr | Creating job7762-21_videos_1 ...
stderr | 
Creating job7762-21_videos_1 ... error

stderr | ERROR: for job7762-21_videos_1  Cannot start service videos: network job7762-21_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job7762-21_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
(hidden)
7761940DavidPytorch ILaido1_LF1_r3-v3step3-videossuccessyes-0:01:08(hidden)
other stats
videos1
7760940DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:20(hidden)
survival_time_median1.5666666666666682


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.4576184816499007, "good_angle": 40.9939386169918, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 9.933333333333335}, "ep001": {"nsteps": 30, "reward": -33.80661088923613, "good_angle": 0.13794416402598422, "survival_time": 1, "traveled_tiles": 1, "valid_direction": 0.33333333333333326}, "ep002": {"nsteps": 47, "reward": -21.693168340528263, "good_angle": 0.06418811201799242, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.1000000000000002}, "ep003": {"nsteps": 433, "reward": -2.8357827126970148, "good_angle": 8.859400916232572, "survival_time": 14.433333333333293, "traveled_tiles": 7, "valid_direction": 4.466666666666655}, "ep004": {"nsteps": 24, "reward": -42.15544073283672, "good_angle": 0.05680776574138376, "survival_time": 0.7999999999999999, "traveled_tiles": 1, "valid_direction": 0.1333333333333333}}
good_angle_max40.9939386169918
good_angle_mean10.022455915001943
good_angle_median0.13794416402598422
good_angle_min0.05680776574138376
reward_max-1.4576184816499007
reward_mean-20.389724231389607
reward_median-21.693168340528263
reward_min-42.15544073283672
survival_time_max16.666666666666654
survival_time_mean6.893333333333322
survival_time_min0.7999999999999999
traveled_tiles_max7
traveled_tiles_mean3
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max9.933333333333335
valid_direction_mean2.9933333333333314
valid_direction_median0.33333333333333326
valid_direction_min0.1000000000000002
7759940DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:21(hidden)
survival_time_median1.5666666666666682


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.4576184816499007, "good_angle": 40.9939386169918, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 9.933333333333335}, "ep001": {"nsteps": 30, "reward": -33.80661088923613, "good_angle": 0.13794416402598422, "survival_time": 1, "traveled_tiles": 1, "valid_direction": 0.33333333333333326}, "ep002": {"nsteps": 47, "reward": -21.693168340528263, "good_angle": 0.06418811201799242, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.1000000000000002}, "ep003": {"nsteps": 433, "reward": -2.8357827126970148, "good_angle": 8.859400916232572, "survival_time": 14.433333333333293, "traveled_tiles": 7, "valid_direction": 4.466666666666655}, "ep004": {"nsteps": 24, "reward": -42.15544073283672, "good_angle": 0.05680776574138376, "survival_time": 0.7999999999999999, "traveled_tiles": 1, "valid_direction": 0.1333333333333333}}
good_angle_max40.9939386169918
good_angle_mean10.022455915001943
good_angle_median0.13794416402598422
good_angle_min0.05680776574138376
reward_max-1.4576184816499007
reward_mean-20.389724231389607
reward_median-21.693168340528263
reward_min-42.15544073283672
survival_time_max16.666666666666654
survival_time_mean6.893333333333322
survival_time_min0.7999999999999999
traveled_tiles_max7
traveled_tiles_mean3
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max9.933333333333335
valid_direction_mean2.9933333333333314
valid_direction_median0.33333333333333326
valid_direction_min0.1000000000000002
7758940DavidPytorch ILaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22(hidden)
survival_time_median1.5666666666666682


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.4576184816499007, "good_angle": 40.9939386169918, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 9.933333333333335}, "ep001": {"nsteps": 30, "reward": -33.80661088923613, "good_angle": 0.13794416402598422, "survival_time": 1, "traveled_tiles": 1, "valid_direction": 0.33333333333333326}, "ep002": {"nsteps": 47, "reward": -21.693168340528263, "good_angle": 0.06418811201799242, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.1000000000000002}, "ep003": {"nsteps": 433, "reward": -2.8357827126970148, "good_angle": 8.859400916232572, "survival_time": 14.433333333333293, "traveled_tiles": 7, "valid_direction": 4.466666666666655}, "ep004": {"nsteps": 24, "reward": -42.15544073283672, "good_angle": 0.05680776574138376, "survival_time": 0.7999999999999999, "traveled_tiles": 1, "valid_direction": 0.1333333333333333}}
good_angle_max40.9939386169918
good_angle_mean10.022455915001943
good_angle_median0.13794416402598422
good_angle_min0.05680776574138376
reward_max-1.4576184816499007
reward_mean-20.389724231389607
reward_median-21.693168340528263
reward_min-42.15544073283672
survival_time_max16.666666666666654
survival_time_mean6.893333333333322
survival_time_min0.7999999999999999
traveled_tiles_max7
traveled_tiles_mean3
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max9.933333333333335
valid_direction_mean2.9933333333333314
valid_direction_median0.33333333333333326
valid_direction_min0.1000000000000002
7757940DavidPytorch ILaido1_LF1_r3-v3step1-simulationsuccessno-0:02:31(hidden)
other stats
simulation-passed1