AI Driving Olympics Home Challenges Submissions Jobs

Submission 766

Submission766
Competingyes
Challengeaido1_LFV_r1-v3
UserAndrea Censi
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11569 step2-scoring: 11576 step3-videos: 11581 step4-viz: 15492
Next
User labelRandom execution
Admin priority52
Blessing52
User priority

15492

Click the images to see detailed statistics about the episode.

11581

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
15492766Andrea CensiRandom executionaido1_LFV_r1-v3step4-vizsuccessyes-0:03:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.031160225450642363
deviation-center-line_median0.19636251961557025
in-drivable-lane_median0.7666666666666688


other stats
deviation-center-line_max0.23589872458540137
deviation-center-line_mean0.15300238436386626
deviation-center-line_min0
deviation-heading_max0.7342713093415238
deviation-heading_mean0.3731877276965648
deviation-heading_median0.40241661887519536
deviation-heading_min0
driven_any_max0.059585467722623686
driven_any_mean0.039920067688992755
driven_any_median0.04375704638423899
driven_any_min0.02447280077041375
driven_lanedir_consec_max0.04270296740629999
driven_lanedir_consec_mean0.024604651763751963
driven_lanedir_consec_min0
driven_lanedir_max0.04270296740629999
driven_lanedir_mean0.024604651763751963
driven_lanedir_median0.031160225450642363
driven_lanedir_min0
in-drivable-lane_max1.8000000000000025
in-drivable-lane_mean1.026666666666666
in-drivable-lane_min0.6333333333333311
per-episodes
details{"ep000": {"driven_any": 0.02447280077041375, "driven_lanedir": 0, "in-drivable-lane": 1.8000000000000025, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.04375704638423899, "driven_lanedir": 0.031160225450642363, "in-drivable-lane": 0.6333333333333311, "deviation-heading": 0.7342713093415238, "deviation-center-line": 0.2268761019701035, "driven_lanedir_consec": 0.031160225450642363}, "ep002": {"driven_any": 0.027012576246216377, "driven_lanedir": 0.016133592445169872, "in-drivable-lane": 0.7666666666666688, "deviation-heading": 0.2092228708857977, "deviation-center-line": 0.10587457564825618, "driven_lanedir_consec": 0.016133592445169872}, "ep003": {"driven_any": 0.059585467722623686, "driven_lanedir": 0.04270296740629999, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 0.40241661887519536, "deviation-center-line": 0.19636251961557025, "driven_lanedir_consec": 0.04270296740629999}, "ep004": {"driven_any": 0.04477244732147097, "driven_lanedir": 0.0330264735166476, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 0.5200278393803074, "deviation-center-line": 0.23589872458540137, "driven_lanedir_consec": 0.0330264735166476}}
11586766Andrea CensiRandom executionaido1_LFV_r1-v3step4-vizsuccessno-0:01:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.1808502041783203
in-drivable-lane_median0.5999999999999979


other stats
deviation-center-line_max0.25157463157036003
deviation-center-line_mean0.1553470126090617
deviation-center-line_min0
deviation-heading_max0.9909225180967468
deviation-heading_mean0.5068556607349365
deviation-heading_median0.44470897098008416
deviation-heading_min0
driven_any_max1.787564031678713
driven_any_mean1.1976020306697832
driven_any_median1.3127113915271709
driven_any_min0.7341840231124117
driven_lanedir_max1.3199952566062716
driven_lanedir_mean0.8041577215336279
driven_lanedir_median0.936043622703392
driven_lanedir_min0
in-drivable-lane_max1.8000000000000025
in-drivable-lane_mean0.799999999999999
in-drivable-lane_min0.10000000000000007
per-episodes
details{"ep000": {"driven_any": 0.7341840231124117, "driven_lanedir": 0, "in-drivable-lane": 1.8000000000000025, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.3127113915271709, "driven_lanedir": 0.936043622703392, "in-drivable-lane": 0.5999999999999979, "deviation-heading": 0.7824735386143051, "deviation-center-line": 0.1808502041783203}, "ep002": {"driven_any": 0.8103772873864903, "driven_lanedir": 0.7542427479837897, "in-drivable-lane": 0.10000000000000007, "deviation-heading": 0.31617327598354605, "deviation-center-line": 0.1363436323867142}, "ep003": {"driven_any": 1.787564031678713, "driven_lanedir": 1.3199952566062716, "in-drivable-lane": 1.099999999999996, "deviation-heading": 0.44470897098008416, "deviation-center-line": 0.25157463157036003}, "ep004": {"driven_any": 1.34317341964413, "driven_lanedir": 1.0105069803746858, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 0.9909225180967468, "deviation-center-line": 0.20796659490991384}}
11581766Andrea CensiRandom executionaido1_LFV_r1-v3step3-videossuccessyes-0:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
11576766Andrea CensiRandom executionaido1_LFV_r1-v3step2-scoringsuccessyes-0:00:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.1999999999999984


other stats
episodes
details{"ep000": {"nsteps": 55, "reward": -19.75106725042517, "good_angle": 0.08074535676143828, "survival_time": 1.8333333333333357, "traveled_tiles": 2, "valid_direction": 0}, "ep001": {"nsteps": 96, "reward": -10.836697746844342, "good_angle": 5.142493650745697, "survival_time": 3.1999999999999984, "traveled_tiles": 4, "valid_direction": 1.3333333333333293}, "ep002": {"nsteps": 60, "reward": -16.670659626942747, "good_angle": 0.3637671872951537, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 0.9000000000000026}, "ep003": {"nsteps": 130, "reward": -8.105879586247298, "good_angle": 7.48304156177777, "survival_time": 4.333333333333328, "traveled_tiles": 4, "valid_direction": 1.3333333333333286}, "ep004": {"nsteps": 99, "reward": -11.491309873985522, "good_angle": 6.57756503517407, "survival_time": 3.299999999999998, "traveled_tiles": 3, "valid_direction": 1.366666666666662}}
good_angle_max7.48304156177777
good_angle_mean3.9295225583508255
good_angle_median5.142493650745697
good_angle_min0.08074535676143828
reward_max-8.105879586247298
reward_mean-13.371122816889017
reward_median-11.491309873985522
reward_min-19.75106725042517
survival_time_max4.333333333333328
survival_time_mean2.933333333333332
survival_time_min1.8333333333333357
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max1.366666666666662
valid_direction_mean0.9866666666666644
valid_direction_median1.3333333333333286
valid_direction_min0
11569766Andrea CensiRandom executionaido1_LFV_r1-v3step1-simulationsuccessyes-0:04:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6879766Andrea CensiRandom executionaido1_LFV_r1-v3step4-vizsuccessno-0:02:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.550767551322808
in-drivable-lane_median0.1999999999999993


other stats
deviation-center-line_max1.0237085651085394
deviation-center-line_mean0.555770687156869
deviation-center-line_min0.0197993101555234
deviation-heading_max4.501231489252565
deviation-heading_mean1.6939478330804107
deviation-heading_median1.3051434957089718
deviation-heading_min0.39444443087064
driven_any_max1.9700195265331624
driven_any_mean1.312818673314844
driven_any_median1.4046473493272058
driven_any_min0.5156540007324252
driven_lanedir_max1.6162792540244664
driven_lanedir_mean1.056244793640413
driven_lanedir_median1.34737596226459
driven_lanedir_min0.0005501770187192889
in-drivable-lane_max3.299999999999998
in-drivable-lane_mean1.1866666666666643
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.5156540007324252, "driven_lanedir": 0.0005501770187192889, "in-drivable-lane": 3.299999999999998, "deviation-heading": 0.6765958751848192, "deviation-center-line": 0.0197993101555234}, "ep001": {"driven_any": 0.7660824216337236, "driven_lanedir": 0.7639769674052694, "in-drivable-lane": 0, "deviation-heading": 0.39444443087064, "deviation-center-line": 0.444644001990105}, "ep002": {"driven_any": 1.4046473493272058, "driven_lanedir": 1.34737596226459, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.5923238743850574, "deviation-center-line": 0.550767551322808}, "ep003": {"driven_any": 1.9700195265331624, "driven_lanedir": 1.6162792540244664, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 4.501231489252565, "deviation-center-line": 1.0237085651085394}, "ep004": {"driven_any": 1.9076900683477027, "driven_lanedir": 1.5530416074890188, "in-drivable-lane": 2.3999999999999915, "deviation-heading": 1.3051434957089718, "deviation-center-line": 0.7399340072073692}}
6874766Andrea CensiRandom executionaido1_LFV_r1-v3step3-videossuccessyes-0:00:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6868766Andrea CensiRandom executionaido1_LFV_r1-v3step2-scoringsuccessyes-0:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.133333333333308


other stats
episodes
details{"ep000": {"nsteps": 113, "reward": -10.009281231774494, "good_angle": 4.267678654921192, "survival_time": 3.766666666666663, "traveled_tiles": 1, "valid_direction": 3.1666666666666634}, "ep001": {"nsteps": 166, "reward": -6.430396467806345, "good_angle": 1.0016955009125992, "survival_time": 5.5333333333333234, "traveled_tiles": 3, "valid_direction": 0.09999999999999964}, "ep002": {"nsteps": 304, "reward": -3.7939432701251032, "good_angle": 11.396548355448887, "survival_time": 10.133333333333308, "traveled_tiles": 3, "valid_direction": 1.7666666666666604}, "ep003": {"nsteps": 425, "reward": -3.017137137844282, "good_angle": 16.919984210536295, "survival_time": 14.166666666666629, "traveled_tiles": 4, "valid_direction": 3.9333333333333194}, "ep004": {"nsteps": 413, "reward": -2.9309417729705154, "good_angle": 23.088690671723665, "survival_time": 13.766666666666628, "traveled_tiles": 4, "valid_direction": 3.966666666666653}}
good_angle_max23.088690671723665
good_angle_mean11.334919478708528
good_angle_median11.396548355448887
good_angle_min1.0016955009125992
reward_max-2.9309417729705154
reward_mean-5.23633997610415
reward_median-3.7939432701251032
reward_min-10.009281231774494
survival_time_max14.166666666666629
survival_time_mean9.473333333333311
survival_time_min3.766666666666663
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.966666666666653
valid_direction_mean2.5866666666666593
valid_direction_median3.1666666666666634
valid_direction_min0.09999999999999964
6862766Andrea CensiRandom executionaido1_LFV_r1-v3step1-simulationsuccessno-0:02:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6583766Andrea CensiRandom executionaido1_LFV_r1-v3step1-simulationabortedno-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LFV_r1-v3/submission766/step1-simulation-nutonomy-P50-2210-job6583'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6353766Andrea CensiRandom executionaido1_LFV_r1-v3step1-simulationabortedno-0:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LFV_r1-v3/submission766/step1-simulation-nutonomy-P50-2210-job6353'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5759766Andrea CensiRandom executionaido1_LFV_r1-v3step4-vizsuccessno-0:00:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5758766Andrea CensiRandom executionaido1_LFV_r1-v3step4-vizsuccessno-0:00:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5757766Andrea CensiRandom executionaido1_LFV_r1-v3step4-vizsuccessno-0:01:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5756766Andrea CensiRandom executionaido1_LFV_r1-v3step4-vizsuccessno-0:01:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5753766Andrea CensiRandom executionaido1_LFV_r1-v3step3-videossuccessno-0:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5752766Andrea CensiRandom executionaido1_LFV_r1-v3step3-videossuccessno-0:00:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5751766Andrea CensiRandom executionaido1_LFV_r1-v3step3-videossuccessno-0:00:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5748766Andrea CensiRandom executionaido1_LFV_r1-v3step2-scoringsuccessno-0:01:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.666666666666656


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.793226854240193, "good_angle": 24.514739373338095, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.933333333333321}, "ep001": {"nsteps": 180, "reward": -6.071764395137628, "good_angle": 0.009215519679207373, "survival_time": 5.9999999999999885, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 112, "reward": -10.107387881293628, "good_angle": 4.629534678140666, "survival_time": 3.73333333333333, "traveled_tiles": 1, "valid_direction": 2.9666666666666632}, "ep003": {"nsteps": 41, "reward": -26.19490526071409, "good_angle": 0.04891935475235413, "survival_time": 1.3666666666666676, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -1.094580393433571, "good_angle": 0.09763253251803804, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 0}}
good_angle_max24.514739373338095
good_angle_mean5.860008291685672
good_angle_median0.09763253251803804
good_angle_min0.009215519679207373
reward_max-1.094580393433571
reward_mean-10.25237295696382
reward_median-7.793226854240193
reward_min-26.19490526071409
survival_time_max16.666666666666654
survival_time_mean6.6866666666666585
survival_time_min1.3666666666666676
traveled_tiles_max5
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.933333333333321
valid_direction_mean1.3799999999999968
valid_direction_median0
valid_direction_min0
5747766Andrea CensiRandom executionaido1_LFV_r1-v3step2-scoringsuccessno-0:02:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.666666666666656


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.793226854240193, "good_angle": 24.514739373338095, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.933333333333321}, "ep001": {"nsteps": 180, "reward": -6.071764395137628, "good_angle": 0.009215519679207373, "survival_time": 5.9999999999999885, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 112, "reward": -10.107387881293628, "good_angle": 4.629534678140666, "survival_time": 3.73333333333333, "traveled_tiles": 1, "valid_direction": 2.9666666666666632}, "ep003": {"nsteps": 41, "reward": -26.19490526071409, "good_angle": 0.04891935475235413, "survival_time": 1.3666666666666676, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -1.094580393433571, "good_angle": 0.09763253251803804, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 0}}
good_angle_max24.514739373338095
good_angle_mean5.860008291685672
good_angle_median0.09763253251803804
good_angle_min0.009215519679207373
reward_max-1.094580393433571
reward_mean-10.25237295696382
reward_median-7.793226854240193
reward_min-26.19490526071409
survival_time_max16.666666666666654
survival_time_mean6.6866666666666585
survival_time_min1.3666666666666676
traveled_tiles_max5
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.933333333333321
valid_direction_mean1.3799999999999968
valid_direction_median0
valid_direction_min0
5746766Andrea CensiRandom executionaido1_LFV_r1-v3step1-simulationsuccessno-0:01:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5745766Andrea CensiRandom executionaido1_LFV_r1-v3step1-simulationsuccessno-0:02:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5744766Andrea CensiRandom executionaido1_LFV_r1-v3step1-simulationsuccessno-0:01:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1