AI Driving Olympics Home Challenges Submissions Jobs

Submission 767

Submission767
Competingyes
Challengeaido1_LF1_r3-v3
UserJulian Zilly
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 14222 step2-scoring: 14234 step3-videos: 14236 step4-viz: 14239
Next
User labelTuned lane controller - ETHZ baseline extension
Admin priority50
Blessing50
User priority

14239

Click the images to see detailed statistics about the episode.

14236

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
14239767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step4-vizsuccessyes-0:01:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5533877691159188
deviation-center-line_median0.12195015270098004
in-drivable-lane_median0.1


other stats
deviation-center-line_max0.3952009770202863
deviation-center-line_mean0.20558993323871327
deviation-center-line_min0.012087615152603554
deviation-heading_max1.4853694799393096
deviation-heading_mean0.7155492938914458
deviation-heading_median0.6235264555364126
deviation-heading_min0.18869816594760372
driven_any_max1.9925165029075664
driven_any_mean0.9637978834501147
driven_any_median0.8133661708515834
driven_any_min0.0854093673345604
driven_lanedir_max1.9204883512752304
driven_lanedir_mean0.8478993535618787
driven_lanedir_min0.029142320680923817
in-drivable-lane_max0.6666666666666662
in-drivable-lane_mean0.18666666666666645
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8133661708515834, "driven_lanedir": 0.5533877691159188, "in-drivable-lane": 0.6666666666666662, "deviation-heading": 0.6235264555364126, "deviation-center-line": 0.12195015270098004}, "ep001": {"driven_any": 0.0854093673345604, "driven_lanedir": 0.029142320680923817, "in-drivable-lane": 0.1, "deviation-heading": 0.18869816594760372, "deviation-center-line": 0.012087615152603554}, "ep002": {"driven_any": 0.4282325999174936, "driven_lanedir": 0.40894070968264873, "in-drivable-lane": 0, "deviation-heading": 0.26439147748685654, "deviation-center-line": 0.11163523996455237}, "ep003": {"driven_any": 1.4994647762393696, "driven_lanedir": 1.327537617054672, "in-drivable-lane": 0.16666666666666607, "deviation-heading": 1.4853694799393096, "deviation-center-line": 0.387075681355144}, "ep004": {"driven_any": 1.9925165029075664, "driven_lanedir": 1.9204883512752304, "in-drivable-lane": 0, "deviation-heading": 1.015760890547047, "deviation-center-line": 0.3952009770202863}}
14236767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step3-videossuccessyes-0:00:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
14234767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.6000000000000005


other stats
episodes
details{"ep000": {"nsteps": 78, "reward": -12.756363911840776, "good_angle": 1.636156239657223, "survival_time": 2.6000000000000005, "traveled_tiles": 2, "valid_direction": 1.2333333333333327}, "ep001": {"nsteps": 10, "reward": -100.91004661619664, "good_angle": 0.33074191462918245, "survival_time": 0.3333333333333333, "traveled_tiles": 1, "valid_direction": 0.26666666666666666}, "ep002": {"nsteps": 42, "reward": -23.48697125973801, "good_angle": 0.21567482182534817, "survival_time": 1.400000000000001, "traveled_tiles": 1, "valid_direction": 0.33333333333333415}, "ep003": {"nsteps": 142, "reward": -6.392020788558589, "good_angle": 0.7031103874795347, "survival_time": 4.733333333333326, "traveled_tiles": 4, "valid_direction": 1.1333333333333324}, "ep004": {"nsteps": 188, "reward": -4.8724688335143505, "good_angle": 0.434182889174325, "survival_time": 6.266666666666654, "traveled_tiles": 5, "valid_direction": 0.466666666666665}}
good_angle_max1.636156239657223
good_angle_mean0.6639732505531227
good_angle_median0.434182889174325
good_angle_min0.21567482182534817
reward_max-4.8724688335143505
reward_mean-29.683574281969676
reward_median-12.756363911840776
reward_min-100.91004661619664
survival_time_max6.266666666666654
survival_time_mean3.066666666666663
survival_time_min0.3333333333333333
traveled_tiles_max5
traveled_tiles_mean2.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.2333333333333327
valid_direction_mean0.6866666666666662
valid_direction_median0.466666666666665
valid_direction_min0.26666666666666666
14222767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationsuccessyes-0:05:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6936767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step4-vizsuccessyes-0:04:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.3951592279035328
deviation-center-line_median0.9209023156556018
in-drivable-lane_median0


other stats
deviation-center-line_max1.153170231723081
deviation-center-line_mean0.8814908991333796
deviation-center-line_min0.5775873104006392
deviation-heading_max3.1865238405586487
deviation-heading_mean1.4572051480522077
deviation-heading_median1.2092223609379702
deviation-heading_min0.5045415745149314
driven_any_max1.7787016440800651
driven_any_mean1.357224840138994
driven_any_median1.4965184567385157
driven_any_min0.632160064765642
driven_lanedir_max1.7765097039916993
driven_lanedir_mean1.2776032798047894
driven_lanedir_min0.6007379205207939
in-drivable-lane_max1.9666666666666692
in-drivable-lane_mean0.4066666666666672
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.7786763540123485, "driven_lanedir": 1.544686227965359, "in-drivable-lane": 1.9666666666666692, "deviation-heading": 1.3154095626075617, "deviation-center-line": 0.9615218532951404}, "ep001": {"driven_any": 0.632160064765642, "driven_lanedir": 0.6007379205207939, "in-drivable-lane": 0, "deviation-heading": 1.2092223609379702, "deviation-center-line": 0.5775873104006392}, "ep002": {"driven_any": 1.4965184567385157, "driven_lanedir": 1.3951592279035328, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 3.1865238405586487, "deviation-center-line": 0.9209023156556018}, "ep003": {"driven_any": 1.7787016440800651, "driven_lanedir": 1.7765097039916993, "in-drivable-lane": 0, "deviation-heading": 0.5045415745149314, "deviation-center-line": 1.153170231723081}, "ep004": {"driven_any": 1.1000676810983998, "driven_lanedir": 1.0709233186425622, "in-drivable-lane": 0, "deviation-heading": 1.0703284016419266, "deviation-center-line": 0.7942727845924359}}
6928767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step3-videossuccessyes-0:01:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6925767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.033333333333294


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.253138579121558, "good_angle": 0.4900760890824776, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0.7666666666666642}, "ep001": {"nsteps": 179, "reward": -6.190601719741049, "good_angle": 6.186553177054577, "survival_time": 5.966666666666655, "traveled_tiles": 2, "valid_direction": 1.2999999999999954}, "ep002": {"nsteps": 421, "reward": -2.665209446491584, "good_angle": 1.319257070271045, "survival_time": 14.033333333333294, "traveled_tiles": 4, "valid_direction": 1.0666666666666629}, "ep003": {"nsteps": 500, "reward": -0.3370800910294056, "good_angle": 0.04797618386752133, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 310, "reward": -3.620830317081944, "good_angle": 1.6901437714687553, "survival_time": 10.333333333333307, "traveled_tiles": 3, "valid_direction": 0.7999999999999972}}
good_angle_max6.186553177054577
good_angle_mean1.946801258348875
good_angle_median1.319257070271045
good_angle_min0.04797618386752133
reward_max-0.253138579121558
reward_mean-2.613372030693108
reward_median-2.665209446491584
reward_min-6.190601719741049
survival_time_max16.666666666666654
survival_time_mean12.733333333333311
survival_time_min5.966666666666655
traveled_tiles_max4
traveled_tiles_mean3.4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max1.2999999999999954
valid_direction_mean0.7866666666666638
valid_direction_median0.7999999999999972
valid_direction_min0
6897767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationsuccessno-0:07:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6596767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission767'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6367767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission767'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6366767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission767'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5765767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailedno-0:05:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 92, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.