AI Driving Olympics Home Challenges Submissions Jobs

Submission 785

Submission785
Competingyes
Challengeaido1_LF1_r3-v3
Userfmilano
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 11849 step2-scoring: 6826 step3-videos: 6828 step4-viz: 6832
Next
User labelAMOD18-AIDO not that random execution
Admin priority50
Blessing50
User priority

6832

Click the images to see detailed statistics about the episode.

6828

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
11849785fmilanoAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationerroryes-0:03:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 97, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6832785fmilanoAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyes-0:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.1457656061451469
deviation-center-line_median0.07346075850793322
in-drivable-lane_median0


other stats
deviation-center-line_max0.08063070759446563
deviation-center-line_mean0.06525960383834356
deviation-center-line_min0.03414125009254369
deviation-heading_max0.4004931717127147
deviation-heading_mean0.30729853033532556
deviation-heading_median0.314017142924901
deviation-heading_min0.24832242064753093
driven_any_max0.3658462447019392
driven_any_mean0.2015887470806599
driven_any_median0.1717237475131552
driven_any_min0.12692624816189793
driven_lanedir_max0.15419106879424893
driven_lanedir_mean0.11408044672409308
driven_lanedir_min0.002331408876295904
in-drivable-lane_max1.500000000000002
in-drivable-lane_mean0.3000000000000004
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3658462447019392, "driven_lanedir": 0.002331408876295904, "in-drivable-lane": 1.500000000000002, "deviation-heading": 0.24832242064753093, "deviation-center-line": 0.03414125009254369}, "ep001": {"driven_any": 0.12692624816189793, "driven_lanedir": 0.11427240428925912, "in-drivable-lane": 0, "deviation-heading": 0.24924170622426584, "deviation-center-line": 0.07346075850793322}, "ep002": {"driven_any": 0.16425749762127798, "driven_lanedir": 0.1457656061451469, "in-drivable-lane": 0, "deviation-heading": 0.3244182101672154, "deviation-center-line": 0.07493942418307827}, "ep003": {"driven_any": 0.17918999740502944, "driven_lanedir": 0.15384174551551455, "in-drivable-lane": 0, "deviation-heading": 0.4004931717127147, "deviation-center-line": 0.06312587881369701}, "ep004": {"driven_any": 0.1717237475131552, "driven_lanedir": 0.15419106879424893, "in-drivable-lane": 0, "deviation-heading": 0.314017142924901, "deviation-center-line": 0.08063070759446563}}
6831785fmilanoAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessyes-0:00:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.1457656061451469
deviation-center-line_median0.07346075850793322
in-drivable-lane_median0


other stats
deviation-center-line_max0.08063070759446563
deviation-center-line_mean0.06525960383834356
deviation-center-line_min0.03414125009254369
deviation-heading_max0.4004931717127147
deviation-heading_mean0.30729853033532556
deviation-heading_median0.314017142924901
deviation-heading_min0.24832242064753093
driven_any_max0.3658462447019392
driven_any_mean0.2015887470806599
driven_any_median0.1717237475131552
driven_any_min0.12692624816189793
driven_lanedir_max0.15419106879424893
driven_lanedir_mean0.11408044672409308
driven_lanedir_min0.002331408876295904
in-drivable-lane_max1.500000000000002
in-drivable-lane_mean0.3000000000000004
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3658462447019392, "driven_lanedir": 0.002331408876295904, "in-drivable-lane": 1.500000000000002, "deviation-heading": 0.24832242064753093, "deviation-center-line": 0.03414125009254369}, "ep001": {"driven_any": 0.12692624816189793, "driven_lanedir": 0.11427240428925912, "in-drivable-lane": 0, "deviation-heading": 0.24924170622426584, "deviation-center-line": 0.07346075850793322}, "ep002": {"driven_any": 0.16425749762127798, "driven_lanedir": 0.1457656061451469, "in-drivable-lane": 0, "deviation-heading": 0.3244182101672154, "deviation-center-line": 0.07493942418307827}, "ep003": {"driven_any": 0.17918999740502944, "driven_lanedir": 0.15384174551551455, "in-drivable-lane": 0, "deviation-heading": 0.4004931717127147, "deviation-center-line": 0.06312587881369701}, "ep004": {"driven_any": 0.1717237475131552, "driven_lanedir": 0.15419106879424893, "in-drivable-lane": 0, "deviation-heading": 0.314017142924901, "deviation-center-line": 0.08063070759446563}}
6828785fmilanoAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessyes-0:00:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6826785fmilanoAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.8333333333333333


other stats
episodes
details{"ep000": {"nsteps": 51, "reward": -21.1743085034849, "good_angle": 3.884118181265496, "survival_time": 1.700000000000002, "traveled_tiles": 1, "valid_direction": 1.5666666666666684}, "ep001": {"nsteps": 19, "reward": -53.28756666026617, "good_angle": 0.14422009081761158, "survival_time": 0.6333333333333333, "traveled_tiles": 1, "valid_direction": 0.4}, "ep002": {"nsteps": 24, "reward": -42.191059398154415, "good_angle": 0.20724530639980177, "survival_time": 0.7999999999999999, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}, "ep003": {"nsteps": 26, "reward": -38.8698256078821, "good_angle": 0.2809590101358145, "survival_time": 0.8666666666666666, "traveled_tiles": 1, "valid_direction": 0.5666666666666665}, "ep004": {"nsteps": 25, "reward": -40.539133900403975, "good_angle": 0.19690358841402775, "survival_time": 0.8333333333333333, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}}
good_angle_max3.884118181265496
good_angle_mean0.9426892354065504
good_angle_median0.20724530639980177
good_angle_min0.14422009081761158
reward_max-21.1743085034849
reward_mean-39.21237881403831
reward_median-40.539133900403975
reward_min-53.28756666026617
survival_time_max1.700000000000002
survival_time_mean0.966666666666667
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.5666666666666684
valid_direction_mean0.7000000000000003
valid_direction_median0.49999999999999994
valid_direction_min0.4
6821785fmilanoAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6573785fmilanoAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission785/step1-simulation-nutonomy-P50-2210-job6573'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6340785fmilanoAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission785/step1-simulation-nutonomy-P50-2110-job6340'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5875785fmilanoAMOD18-AIDO not that random executionaido1_LF1_r3-v3step4-vizsuccessno-0:00:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5874785fmilanoAMOD18-AIDO not that random executionaido1_LF1_r3-v3step3-videossuccessno-0:00:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5873785fmilanoAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessno-0:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.500000000000001


other stats
episodes
details{"ep000": {"nsteps": 45, "reward": -22.71031572982255, "good_angle": 1.396690490222933, "survival_time": 1.500000000000001, "traveled_tiles": 1, "valid_direction": 1.2000000000000013}, "ep001": {"nsteps": 44, "reward": -23.13684787942012, "good_angle": 1.3536491238787145, "survival_time": 1.466666666666668, "traveled_tiles": 1, "valid_direction": 1.200000000000001}, "ep002": {"nsteps": 37, "reward": -27.19666234525298, "good_angle": 0.934874607755796, "survival_time": 1.2333333333333338, "traveled_tiles": 2, "valid_direction": 0.9666666666666672}, "ep003": {"nsteps": 57, "reward": -18.826057127325615, "good_angle": 1.97953109777104, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 1.566666666666669}, "ep004": {"nsteps": 74, "reward": -15.535065579253274, "good_angle": 2.326161475490153, "survival_time": 2.4666666666666677, "traveled_tiles": 2, "valid_direction": 2.133333333333334}}
good_angle_max2.326161475490153
good_angle_mean1.5981813590237273
good_angle_median1.396690490222933
good_angle_min0.934874607755796
reward_max-15.535065579253274
reward_mean-21.480989732214905
reward_median-22.71031572982255
reward_min-27.19666234525298
survival_time_max2.4666666666666677
survival_time_mean1.7133333333333347
survival_time_min1.2333333333333338
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.133333333333334
valid_direction_mean1.4133333333333349
valid_direction_median1.2000000000000013
valid_direction_min0.9666666666666672
5872785fmilanoAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringsuccessno-0:01:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.500000000000001


other stats
episodes
details{"ep000": {"nsteps": 45, "reward": -22.71031572982255, "good_angle": 1.396690490222933, "survival_time": 1.500000000000001, "traveled_tiles": 1, "valid_direction": 1.2000000000000013}, "ep001": {"nsteps": 44, "reward": -23.13684787942012, "good_angle": 1.3536491238787145, "survival_time": 1.466666666666668, "traveled_tiles": 1, "valid_direction": 1.200000000000001}, "ep002": {"nsteps": 37, "reward": -27.19666234525298, "good_angle": 0.934874607755796, "survival_time": 1.2333333333333338, "traveled_tiles": 2, "valid_direction": 0.9666666666666672}, "ep003": {"nsteps": 57, "reward": -18.826057127325615, "good_angle": 1.97953109777104, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 1.566666666666669}, "ep004": {"nsteps": 74, "reward": -15.535065579253274, "good_angle": 2.326161475490153, "survival_time": 2.4666666666666677, "traveled_tiles": 2, "valid_direction": 2.133333333333334}}
good_angle_max2.326161475490153
good_angle_mean1.5981813590237273
good_angle_median1.396690490222933
good_angle_min0.934874607755796
reward_max-15.535065579253274
reward_mean-21.480989732214905
reward_median-22.71031572982255
reward_min-27.19666234525298
survival_time_max2.4666666666666677
survival_time_mean1.7133333333333347
survival_time_min1.2333333333333338
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.133333333333334
valid_direction_mean1.4133333333333349
valid_direction_median1.2000000000000013
valid_direction_min0.9666666666666672
5854785fmilanoAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringtimeoutno-0:31:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
5847785fmilanoAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1