AI Driving Olympics Home Challenges Submissions Jobs

Submission 756

Submission756
Competingyes
Challengeaido1_LF1_r3-v3
Usermarshin
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 14099 step2-scoring: 14108 step3-videos: 14110 step4-viz: 14116
Next
User labelPyTorch template
Admin priority50
Blessing50
User priority

14116

Click the images to see detailed statistics about the episode.

14110

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
14116756marshinPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes-0:01:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.8858153407964924
deviation-center-line_median0.17441314927091245
in-drivable-lane_median0.6666666666666687


other stats
deviation-center-line_max0.28726627655620873
deviation-center-line_mean0.1626439537975189
deviation-center-line_min0
deviation-heading_max0.975936345848301
deviation-heading_mean0.5829737165050173
deviation-heading_median0.7180071675439414
deviation-heading_min0
driven_any_max2.1320827418689627
driven_any_mean1.3892050939840312
driven_any_median1.3151904248404662
driven_any_min0.41262337881471894
driven_lanedir_max1.2827264979044273
driven_lanedir_mean0.8234662776140136
driven_lanedir_min0
in-drivable-lane_max1.2333333333333307
in-drivable-lane_mean0.7866666666666671
in-drivable-lane_min0.5000000000000016
per-episodes
details{"ep000": {"driven_any": 0.41262337881471894, "driven_lanedir": 0, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.7878176106413748, "driven_lanedir": 1.139007577475838, "in-drivable-lane": 0.9666666666666676, "deviation-heading": 0.7180071675439414, "deviation-center-line": 0.17441314927091245}, "ep002": {"driven_any": 2.1320827418689627, "driven_lanedir": 1.2827264979044273, "in-drivable-lane": 1.2333333333333307, "deviation-heading": 0.42587841461174314, "deviation-center-line": 0.28726627655620873}, "ep003": {"driven_any": 1.2983113137546327, "driven_lanedir": 0.8858153407964924, "in-drivable-lane": 0.5000000000000016, "deviation-heading": 0.7950466545211003, "deviation-center-line": 0.15709756272259523}, "ep004": {"driven_any": 1.3151904248404662, "driven_lanedir": 0.8097819718933101, "in-drivable-lane": 0.6666666666666687, "deviation-heading": 0.975936345848301, "deviation-center-line": 0.1944427804378779}}
14115756marshinPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes-0:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.8858153407964924
deviation-center-line_median0.17441314927091245
in-drivable-lane_median0.6666666666666687


other stats
deviation-center-line_max0.28726627655620873
deviation-center-line_mean0.1626439537975189
deviation-center-line_min0
deviation-heading_max0.975936345848301
deviation-heading_mean0.5829737165050173
deviation-heading_median0.7180071675439414
deviation-heading_min0
driven_any_max2.1320827418689627
driven_any_mean1.3892050939840312
driven_any_median1.3151904248404662
driven_any_min0.41262337881471894
driven_lanedir_max1.2827264979044273
driven_lanedir_mean0.8234662776140136
driven_lanedir_min0
in-drivable-lane_max1.2333333333333307
in-drivable-lane_mean0.7866666666666671
in-drivable-lane_min0.5000000000000016
per-episodes
details{"ep000": {"driven_any": 0.41262337881471894, "driven_lanedir": 0, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.7878176106413748, "driven_lanedir": 1.139007577475838, "in-drivable-lane": 0.9666666666666676, "deviation-heading": 0.7180071675439414, "deviation-center-line": 0.17441314927091245}, "ep002": {"driven_any": 2.1320827418689627, "driven_lanedir": 1.2827264979044273, "in-drivable-lane": 1.2333333333333307, "deviation-heading": 0.42587841461174314, "deviation-center-line": 0.28726627655620873}, "ep003": {"driven_any": 1.2983113137546327, "driven_lanedir": 0.8858153407964924, "in-drivable-lane": 0.5000000000000016, "deviation-heading": 0.7950466545211003, "deviation-center-line": 0.15709756272259523}, "ep004": {"driven_any": 1.3151904248404662, "driven_lanedir": 0.8097819718933101, "in-drivable-lane": 0.6666666666666687, "deviation-heading": 0.975936345848301, "deviation-center-line": 0.1944427804378779}}
14110756marshinPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes-0:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
14108756marshinPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.533333333333334


other stats
episodes
details{"ep000": {"nsteps": 18, "reward": -57.03630733821127, "good_angle": 0.11571258595810303, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0.3}, "ep001": {"nsteps": 94, "reward": -10.532014407217504, "good_angle": 0.6672842961044548, "survival_time": 3.133333333333332, "traveled_tiles": 4, "valid_direction": 1.8333333333333328}, "ep002": {"nsteps": 98, "reward": -10.241640255102242, "good_angle": 0.5094135991592251, "survival_time": 3.266666666666665, "traveled_tiles": 5, "valid_direction": 1.3333333333333308}, "ep003": {"nsteps": 76, "reward": -12.641809777393448, "good_angle": 0.4494155772546149, "survival_time": 2.533333333333334, "traveled_tiles": 3, "valid_direction": 1.066666666666666}, "ep004": {"nsteps": 75, "reward": -13.172232264094054, "good_angle": 0.8445498315973994, "survival_time": 2.500000000000001, "traveled_tiles": 4, "valid_direction": 1.6333333333333333}}
good_angle_max0.8445498315973994
good_angle_mean0.5172751780147594
good_angle_median0.5094135991592251
good_angle_min0.11571258595810303
reward_max-10.241640255102242
reward_mean-20.724800808403703
reward_median-12.641809777393448
reward_min-57.03630733821127
survival_time_max3.266666666666665
survival_time_mean2.4066666666666663
survival_time_min0.6
traveled_tiles_max5
traveled_tiles_mean3.4
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max1.8333333333333328
valid_direction_mean1.2333333333333325
valid_direction_median1.3333333333333308
valid_direction_min0.3
14099756marshinPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessyes-0:03:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6938756marshinPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes-0:04:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5757069480630213
deviation-center-line_median0.3322557836406373
in-drivable-lane_median3.2999999999999883


other stats
deviation-center-line_max0.5786941905407607
deviation-center-line_mean0.3377442083615078
deviation-center-line_min0.18855547367358297
deviation-heading_max3.758632683038244
deviation-heading_mean1.9811875966600605
deviation-heading_median2.097307918082255
deviation-heading_min0.9623147226295942
driven_any_max1.2584590019330784
driven_any_mean1.004524145951728
driven_any_median1.11910045538496
driven_any_min0.3397751108123201
driven_lanedir_max0.7521477226218158
driven_lanedir_mean0.5272163479401082
driven_lanedir_min0.10656125392172688
in-drivable-lane_max4.366666666666651
in-drivable-lane_mean2.4799999999999915
in-drivable-lane_min0.5333333333333314
per-episodes
details{"ep000": {"driven_any": 0.3397751108123201, "driven_lanedir": 0.10656125392172688, "in-drivable-lane": 0.7666666666666666, "deviation-heading": 2.097307918082255, "deviation-center-line": 0.18855547367358297}, "ep001": {"driven_any": 1.11910045538496, "driven_lanedir": 0.7521477226218158, "in-drivable-lane": 0.5333333333333314, "deviation-heading": 3.758632683038244, "deviation-center-line": 0.5786941905407607}, "ep002": {"driven_any": 1.2584590019330784, "driven_lanedir": 0.6742449772647152, "in-drivable-lane": 3.2999999999999883, "deviation-heading": 2.119646741028135, "deviation-center-line": 0.35989700221751453}, "ep003": {"driven_any": 1.253692855103408, "driven_lanedir": 0.5757069480630213, "in-drivable-lane": 4.366666666666651, "deviation-heading": 0.9680359185220728, "deviation-center-line": 0.3322557836406373}, "ep004": {"driven_any": 1.0515933065248737, "driven_lanedir": 0.5274208378292615, "in-drivable-lane": 3.433333333333321, "deviation-heading": 0.9623147226295942, "deviation-center-line": 0.22931859173504385}}
6935756marshinPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes-0:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6933756marshinPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.4666666666666535


other stats
episodes
details{"ep000": {"nsteps": 79, "reward": -12.94915088250514, "good_angle": 1.4056568702670158, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.1333333333333337}, "ep001": {"nsteps": 194, "reward": -6.540293557588587, "good_angle": 15.523981234782308, "survival_time": 6.4666666666666535, "traveled_tiles": 2, "valid_direction": 3.83333333333332}, "ep002": {"nsteps": 230, "reward": -4.823034799977651, "good_angle": 2.5736854933875097, "survival_time": 7.666666666666649, "traveled_tiles": 3, "valid_direction": 4.599999999999986}, "ep003": {"nsteps": 231, "reward": -5.560765733431875, "good_angle": 1.014795234557626, "survival_time": 7.699999999999982, "traveled_tiles": 3, "valid_direction": 4.733333333333318}, "ep004": {"nsteps": 187, "reward": -6.560316971241069, "good_angle": 1.5677518654645608, "survival_time": 6.233333333333321, "traveled_tiles": 2, "valid_direction": 4.7999999999999865}}
good_angle_max15.523981234782308
good_angle_mean4.417174139691803
good_angle_median1.5677518654645608
good_angle_min1.014795234557626
reward_max-4.823034799977651
reward_mean-7.286712388948866
reward_median-6.540293557588587
reward_min-12.94915088250514
survival_time_max7.699999999999982
survival_time_mean6.139999999999988
survival_time_min2.6333333333333337
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max4.7999999999999865
valid_direction_mean4.019999999999989
valid_direction_median4.599999999999986
valid_direction_min2.1333333333333337
6923756marshinPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno-0:02:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6603756marshinPyTorch templateaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission756/step1-simulation-nutonomy-P50-2570-job6603'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6376756marshinPyTorch templateaido1_LF1_r3-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission756/step1-simulation-nutonomy-P50-2570-job6376'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5704756marshinPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno-0:02:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5703756marshinPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno-0:02:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5702756marshinPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno-0:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5701756marshinPyTorch templateaido1_LF1_r3-v3step3-videossuccessno-0:02:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5700756marshinPyTorch templateaido1_LF1_r3-v3step3-videossuccessno-0:00:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5699756marshinPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno-0:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.066666666666658


other stats
episodes
details{"ep000": {"nsteps": 142, "reward": -9.008891619427104, "good_angle": 19.939321376995977, "survival_time": 4.733333333333326, "traveled_tiles": 2, "valid_direction": 3.299999999999992}, "ep001": {"nsteps": 152, "reward": -8.407879374529186, "good_angle": 0.6264757405275981, "survival_time": 5.066666666666658, "traveled_tiles": 2, "valid_direction": 2.933333333333326}, "ep002": {"nsteps": 173, "reward": -5.839067970302946, "good_angle": 0.25425855828864774, "survival_time": 5.766666666666656, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 155, "reward": -8.654264653882672, "good_angle": 8.5021220169946, "survival_time": 5.166666666666658, "traveled_tiles": 3, "valid_direction": 1.533333333333328}, "ep004": {"nsteps": 64, "reward": -18.293061058968306, "good_angle": 0.2165969685044949, "survival_time": 2.1333333333333355, "traveled_tiles": 2, "valid_direction": 1.0000000000000024}}
good_angle_max19.939321376995977
good_angle_mean5.907754932262264
good_angle_median0.6264757405275981
good_angle_min0.2165969685044949
reward_max-5.839067970302946
reward_mean-10.040632935422042
reward_median-8.654264653882672
reward_min-18.293061058968306
survival_time_max5.766666666666656
survival_time_mean4.573333333333327
survival_time_min2.1333333333333355
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.299999999999992
valid_direction_mean1.7533333333333296
valid_direction_median1.533333333333328
valid_direction_min0
5698756marshinPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno-0:02:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5697756marshinPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno-0:02:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5696756marshinPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno-0:02:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5695756marshinPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno-0:02:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1