AI Driving Olympics Home Challenges Submissions Jobs

Submission 674

Submission674
Competingyes
Challengeaido1_LF1_r3-v3
Userheyt0ny
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13226 step2-scoring: 13234 step3-videos: 13236 step4-viz: 13239
Next
User labelPyTorch template
Admin priority50
Blessing50
User priority

13239

Click the images to see detailed statistics about the episode.

13236

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
13239674heyt0nyPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes-0:00:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.32853221949848965
deviation-center-line_median0.029178863418914583
in-drivable-lane_median0.26666666666666666


other stats
deviation-center-line_max0.0328804891716038
deviation-center-line_mean0.024311240491748192
deviation-center-line_min0
deviation-heading_max0.1901881962314376
deviation-heading_mean0.14456384861610058
deviation-heading_median0.1776609797736027
deviation-heading_min0
driven_any_max0.9717508842080576
driven_any_mean0.6478339228053729
driven_any_median0.6478339228053732
driven_any_min0.32391696140268744
driven_lanedir_max0.36854495025397327
driven_lanedir_mean0.27171737073553714
driven_lanedir_min0
in-drivable-lane_max0.5999999999999999
in-drivable-lane_mean0.3333333333333333
in-drivable-lane_min0.23333333333333336
per-episodes
details{"ep000": {"driven_any": 0.32391696140268744, "driven_lanedir": 0, "in-drivable-lane": 0.3333333333333333, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.6478339228053732, "driven_lanedir": 0.36854495025397327, "in-drivable-lane": 0.23333333333333336, "deviation-heading": 0.1776609797736027, "deviation-center-line": 0.03098413263848446}, "ep002": {"driven_any": 0.9717508842080576, "driven_lanedir": 0.2992019402691497, "in-drivable-lane": 0.5999999999999999, "deviation-heading": 0.1700804349756996, "deviation-center-line": 0.029178863418914583}, "ep003": {"driven_any": 0.6478339228053718, "driven_lanedir": 0.3623077436560731, "in-drivable-lane": 0.23333333333333336, "deviation-heading": 0.1901881962314376, "deviation-center-line": 0.0328804891716038}, "ep004": {"driven_any": 0.6478339228053744, "driven_lanedir": 0.32853221949848965, "in-drivable-lane": 0.26666666666666666, "deviation-heading": 0.18488963209976303, "deviation-center-line": 0.02851271722973811}}
13236674heyt0nyPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes-0:00:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
13234674heyt0nyPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.6666666666666666


other stats
episodes
details{"ep000": {"nsteps": 11, "reward": -92.50842705639926, "good_angle": 0.12288007341212635, "survival_time": 0.36666666666666664, "traveled_tiles": 1, "valid_direction": 0.2666666666666666}, "ep001": {"nsteps": 20, "reward": -50.31161011345685, "good_angle": 0.5192716811551052, "survival_time": 0.6666666666666666, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}, "ep002": {"nsteps": 29, "reward": -35.265372710623616, "good_angle": 0.29881233094038684, "survival_time": 0.9666666666666666, "traveled_tiles": 3, "valid_direction": 0.5999999999999999}, "ep003": {"nsteps": 20, "reward": -50.37483152616769, "good_angle": 0.5515131875305687, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.5333333333333332}, "ep004": {"nsteps": 20, "reward": -50.50922786220908, "good_angle": 0.6191891306005425, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.5333333333333332}}
good_angle_max0.6191891306005425
good_angle_mean0.4223332807277459
good_angle_median0.5192716811551052
good_angle_min0.12288007341212635
reward_max-35.265372710623616
reward_mean-55.793893853771294
reward_median-50.37483152616769
reward_min-92.50842705639926
survival_time_max0.9666666666666666
survival_time_mean0.6666666666666666
survival_time_min0.36666666666666664
traveled_tiles_max3
traveled_tiles_mean1.6
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.5999999999999999
valid_direction_mean0.4866666666666665
valid_direction_median0.5333333333333332
valid_direction_min0.2666666666666666
13226674heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessyes-0:02:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
7189674heyt0nyPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes-0:01:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3488793237522416
deviation-center-line_median0.0889692481169104
in-drivable-lane_median0.7333333333333356


other stats
deviation-center-line_max0.10804224268701285
deviation-center-line_mean0.09487224786148496
deviation-center-line_min0.08348977239520798
deviation-heading_max0.608366051951121
deviation-heading_mean0.5574968980788961
deviation-heading_median0.5632226516257168
deviation-heading_min0.48363659503855955
driven_any_max1.1039685593698203
driven_any_mean0.758378401654052
driven_any_median0.6599812039710905
driven_any_min0.6479815457170728
driven_lanedir_max0.5716983112111842
driven_lanedir_mean0.39952468480261855
driven_lanedir_min0.33211979888331666
in-drivable-lane_max1.3666666666666638
in-drivable-lane_mean0.8666666666666678
in-drivable-lane_min0.733333333333335
per-episodes
details{"ep000": {"driven_any": 1.1039685593698203, "driven_lanedir": 0.5716983112111842, "in-drivable-lane": 1.3666666666666638, "deviation-heading": 0.608366051951121, "deviation-center-line": 0.10673177973707754}, "ep001": {"driven_any": 0.7199794952411871, "driven_lanedir": 0.39976300809979626, "in-drivable-lane": 0.733333333333335, "deviation-heading": 0.5955376409473666, "deviation-center-line": 0.10804224268701285}, "ep002": {"driven_any": 0.659981203971089, "driven_lanedir": 0.3488793237522416, "in-drivable-lane": 0.7333333333333356, "deviation-heading": 0.5367215508317167, "deviation-center-line": 0.08712819637121608}, "ep003": {"driven_any": 0.6599812039710905, "driven_lanedir": 0.34516298206655405, "in-drivable-lane": 0.766666666666669, "deviation-heading": 0.48363659503855955, "deviation-center-line": 0.08348977239520798}, "ep004": {"driven_any": 0.6479815457170728, "driven_lanedir": 0.33211979888331666, "in-drivable-lane": 0.7333333333333356, "deviation-heading": 0.5632226516257168, "deviation-center-line": 0.0889692481169104}}
7184674heyt0nyPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes-0:00:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
7183674heyt0nyPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.9000000000000024


other stats
episodes
details{"ep000": {"nsteps": 94, "reward": -11.171671843166129, "good_angle": 1.4044183981168703, "survival_time": 3.133333333333332, "traveled_tiles": 2, "valid_direction": 1.63333333333333}, "ep001": {"nsteps": 62, "reward": -17.048769331417017, "good_angle": 1.6329867996476355, "survival_time": 2.066666666666669, "traveled_tiles": 1, "valid_direction": 1.566666666666669}, "ep002": {"nsteps": 57, "reward": -18.454871453794144, "good_angle": 1.4903659537432206, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 1.5000000000000024}, "ep003": {"nsteps": 57, "reward": -18.47161357804904, "good_angle": 1.4299329130305087, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 1.4666666666666692}, "ep004": {"nsteps": 56, "reward": -18.81965266557277, "good_angle": 1.5658464039151478, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 1.533333333333336}}
good_angle_max1.6329867996476355
good_angle_mean1.5047100936906768
good_angle_median1.4903659537432206
good_angle_min1.4044183981168703
reward_max-11.171671843166129
reward_mean-16.793315774399822
reward_median-18.454871453794144
reward_min-18.81965266557277
survival_time_max3.133333333333332
survival_time_mean2.1733333333333347
survival_time_min1.8666666666666691
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.63333333333333
valid_direction_mean1.5400000000000014
valid_direction_median1.533333333333336
valid_direction_min1.4666666666666692
7175674heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno-0:01:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6690674heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationabortedno-0:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission674/step1-simulation-nutonomy-P50-2570-job6690'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6489674heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationabortedno-0:00:20
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job6489-6602', 'pull']:

   >  Command '['docker-compose', '-p', 'job6489-6602', 'pull']' returned non-zero exit status 1

stdout | 

stderr | Pulling evaluator ...
stderr | Pulling solution  ...
stderr | 
Pulling evaluator ... done

stderr | ERROR: for solution  write /var/lib/docker/tmp/GetImageBlob750880295: no space left on device
stderr | write /var/lib/docker/tmp/GetImageBlob750880295: no space left on device
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5325674heyt0nyPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno-0:00:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5324674heyt0nyPyTorch templateaido1_LF1_r3-v3step3-videossuccessno-0:00:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5323674heyt0nyPyTorch templateaido1_LF1_r3-v3step3-videossuccessno-0:00:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5322674heyt0nyPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno-0:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.466666666666668


other stats
episodes
details{"ep000": {"nsteps": 44, "reward": -23.88088265738704, "good_angle": 3.70949417577136, "survival_time": 1.466666666666668, "traveled_tiles": 2, "valid_direction": 1.0333333333333343}, "ep001": {"nsteps": 45, "reward": -23.776525971624583, "good_angle": 0.6708159161644452, "survival_time": 1.500000000000001, "traveled_tiles": 1, "valid_direction": 1.0333333333333348}, "ep002": {"nsteps": 52, "reward": -20.455973258528573, "good_angle": 0.9021072811734004, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 1.200000000000002}, "ep003": {"nsteps": 37, "reward": -29.080562771977604, "good_angle": 0.4446186164358923, "survival_time": 1.2333333333333338, "traveled_tiles": 2, "valid_direction": 0.8333333333333338}, "ep004": {"nsteps": 28, "reward": -38.27836284467152, "good_angle": 0.1990222119227902, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.5333333333333332}}
good_angle_max3.70949417577136
good_angle_mean1.1852116402935775
good_angle_median0.6708159161644452
good_angle_min0.1990222119227902
reward_max-20.455973258528573
reward_mean-27.09446150083786
reward_median-23.88088265738704
reward_min-38.27836284467152
survival_time_max1.7333333333333354
survival_time_mean1.3733333333333344
survival_time_min0.9333333333333332
traveled_tiles_max2
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.200000000000002
valid_direction_mean0.9266666666666676
valid_direction_median1.0333333333333343
valid_direction_min0.5333333333333332
5321674heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno-0:01:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5320674heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationtimeoutno-0:31:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
5319674heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationtimeoutno-0:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.