AI Driving Olympics Home Challenges Submissions Jobs

Submission 792

Submission792
Competingyes
Challengeaido1_LF1_r3-v3
UserEdward
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11935 step2-scoring: 11940 step3-videos: 11945 step4-viz: 11950
Next
User labelRandom execution
Admin priority50
Blessing50
User priority

11950

Click the images to see detailed statistics about the episode.

11945

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
11950792EdwardRandom executionaido1_LF1_r3-v3step4-vizsuccessyes-0:01:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7783192106360408
deviation-center-line_median0.11570483192692992
in-drivable-lane_median0.033333333333333326


other stats
deviation-center-line_max0.16670357033941505
deviation-center-line_mean0.09180087418015584
deviation-center-line_min0.010960488606122868
deviation-heading_max0.34166970533598884
deviation-heading_mean0.23686400729408288
deviation-heading_median0.26451178551660837
deviation-heading_min0.08753529617949395
driven_any_max1.1400000000000017
driven_any_mean0.9760000000000012
driven_any_median1.0799999999999996
driven_any_min0.7799999999999967
driven_lanedir_max1.1054561923632351
driven_lanedir_mean0.7307584818240866
driven_lanedir_min0.005399048963769193
in-drivable-lane_max1.633333333333335
in-drivable-lane_mean0.346666666666667
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.0799999999999996, "driven_lanedir": 0.005399048963769193, "in-drivable-lane": 1.633333333333335, "deviation-heading": 0.30335649020653566, "deviation-center-line": 0.010960488606122868}, "ep001": {"driven_any": 0.7800000000000074, "driven_lanedir": 0.7783192106360408, "in-drivable-lane": 0, "deviation-heading": 0.08753529617949395, "deviation-center-line": 0.11570483192692992}, "ep002": {"driven_any": 0.7799999999999967, "driven_lanedir": 0.706093028267093, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.34166970533598884, "deviation-center-line": 0.04371207325047091}, "ep003": {"driven_any": 1.100000000000001, "driven_lanedir": 1.0585249288902947, "in-drivable-lane": 0.06666666666666687, "deviation-heading": 0.18724675923178744, "deviation-center-line": 0.16670357033941505}, "ep004": {"driven_any": 1.1400000000000017, "driven_lanedir": 1.1054561923632351, "in-drivable-lane": 0, "deviation-heading": 0.26451178551660837, "deviation-center-line": 0.12192340677784048}}
11945792EdwardRandom executionaido1_LF1_r3-v3step3-videossuccessyes-0:00:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
11940792EdwardRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.8666666666666691


other stats
episodes
details{"ep000": {"nsteps": 56, "reward": -18.801444864565777, "good_angle": 1.0163992328464693, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 0.7000000000000022}, "ep001": {"nsteps": 41, "reward": -24.03603506269978, "good_angle": 0.00579980220315226, "survival_time": 1.3666666666666676, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 41, "reward": -23.988571963023123, "good_angle": 0.2649658884005068, "survival_time": 1.3666666666666676, "traveled_tiles": 2, "valid_direction": 0.500000000000001}, "ep003": {"nsteps": 57, "reward": -17.52574976100668, "good_angle": 0.229551202468404, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 0.533333333333335}, "ep004": {"nsteps": 59, "reward": -16.72157261646905, "good_angle": 0.229542941296041, "survival_time": 1.9666666666666697, "traveled_tiles": 2, "valid_direction": 0.5000000000000016}}
good_angle_max1.0163992328464693
good_angle_mean0.34925181344291467
good_angle_median0.229551202468404
good_angle_min0.00579980220315226
reward_max-16.72157261646905
reward_mean-20.21467485355288
reward_median-18.801444864565777
reward_min-24.03603506269978
survival_time_max1.9666666666666697
survival_time_mean1.6933333333333351
survival_time_min1.3666666666666676
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max0.7000000000000022
valid_direction_mean0.44666666666666793
valid_direction_median0.5000000000000016
valid_direction_min0
11935792EdwardRandom executionaido1_LF1_r3-v3step1-simulationsuccessyes-0:03:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
6818792EdwardRandom executionaido1_LF1_r3-v3step4-vizsuccessyes-0:01:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1339670031613929
deviation-center-line_median0.3453842981256443
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.4625904444299094
deviation-center-line_mean0.30597882595341497
deviation-center-line_min0.14843553015223906
deviation-heading_max2.5187871046739683
deviation-heading_mean1.1001213396346814
deviation-heading_median0.7191512154722794
deviation-heading_min0.124099113245172
driven_any_max2.1133333333332667
driven_any_mean1.1199999999999908
driven_any_median1.1733333333333549
driven_any_min0.36000000000000254
driven_lanedir_max2.0720400686018614
driven_lanedir_mean0.9952598020995628
driven_lanedir_min0.1479416971540677
in-drivable-lane_max0.5333333333333314
in-drivable-lane_mean0.1933333333333329
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3600000000000074, "driven_lanedir": 0.1479416971540677, "in-drivable-lane": 0.4, "deviation-heading": 1.453568460270295, "deviation-center-line": 0.14843553015223906}, "ep001": {"driven_any": 0.36000000000000254, "driven_lanedir": 0.35917351816203724, "in-drivable-lane": 0, "deviation-heading": 0.124099113245172, "deviation-center-line": 0.2016114458048761}, "ep002": {"driven_any": 1.1733333333333549, "driven_lanedir": 1.1339670031613929, "in-drivable-lane": 0, "deviation-heading": 0.7191512154722794, "deviation-center-line": 0.3453842981256443}, "ep003": {"driven_any": 2.1133333333332667, "driven_lanedir": 2.0720400686018614, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.685000804511693, "deviation-center-line": 0.4625904444299094}, "ep004": {"driven_any": 1.5933333333333222, "driven_lanedir": 1.263176723418455, "in-drivable-lane": 0.5333333333333314, "deviation-heading": 2.5187871046739683, "deviation-center-line": 0.3718724112544059}}
6806792EdwardRandom executionaido1_LF1_r3-v3step3-videossuccessyes-0:02:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
6568792EdwardRandom executionaido1_LF1_r3-v3step3-videosabortedyes-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission792/step3-videos-nutonomy-P50-2110-job6568'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6345792EdwardRandom executionaido1_LF1_r3-v3step3-videosabortedyes-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission792/step3-videos-nutonomy-P50-2210-job6345'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6344792EdwardRandom executionaido1_LF1_r3-v3step3-videosabortedyes-0:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission792/step3-videos-nutonomy-P50-2570-job6344'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
6335792EdwardRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.933333333333322


other stats
episodes
details{"ep000": {"nsteps": 56, "reward": -18.11559725355723, "good_angle": 0.8921105662302433, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 1.566666666666669}, "ep001": {"nsteps": 56, "reward": -18.42357532573598, "good_angle": 0.008400321768129769, "survival_time": 1.8666666666666691, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 178, "reward": -6.111355765063442, "good_angle": 0.6612090390214628, "survival_time": 5.933333333333322, "traveled_tiles": 3, "valid_direction": 1.4666666666666617}, "ep003": {"nsteps": 319, "reward": -3.4423892636517746, "good_angle": 0.7088851214962292, "survival_time": 10.633333333333306, "traveled_tiles": 4, "valid_direction": 1.533333333333328}, "ep004": {"nsteps": 241, "reward": -4.737908348469141, "good_angle": 14.163927690504837, "survival_time": 8.033333333333315, "traveled_tiles": 3, "valid_direction": 2.7333333333333245}}
good_angle_max14.163927690504837
good_angle_mean3.2869065478041803
good_angle_median0.7088851214962292
good_angle_min0.008400321768129769
reward_max-3.4423892636517746
reward_mean-10.166165191295514
reward_median-6.111355765063442
reward_min-18.42357532573598
survival_time_max10.633333333333306
survival_time_mean5.666666666666657
survival_time_min1.8666666666666691
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max2.7333333333333245
valid_direction_mean1.4599999999999966
valid_direction_median1.533333333333328
valid_direction_min0
6330792EdwardRandom executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5900792EdwardRandom executionaido1_LF1_r3-v3step4-vizsuccessno-0:00:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5899792EdwardRandom executionaido1_LF1_r3-v3step3-videossuccessno-0:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5893792EdwardRandom executionaido1_LF1_r3-v3step2-scoringsuccessno-0:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.333333333333321


other stats
episodes
details{"ep000": {"nsteps": 119, "reward": -10.29928544088572, "good_angle": 17.226891564339322, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 2.766666666666662}, "ep001": {"nsteps": 264, "reward": -4.779882687623754, "good_angle": 16.51740361855984, "survival_time": 8.79999999999998, "traveled_tiles": 3, "valid_direction": 2.7666666666666577}, "ep002": {"nsteps": 279, "reward": -3.644003686591512, "good_angle": 0.06896665489742422, "survival_time": 9.299999999999978, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 181, "reward": -7.788495979256393, "good_angle": 18.313907760322827, "survival_time": 6.033333333333322, "traveled_tiles": 3, "valid_direction": 2.766666666666657}, "ep004": {"nsteps": 190, "reward": -7.142260233303042, "good_angle": 3.5933936079923985, "survival_time": 6.333333333333321, "traveled_tiles": 3, "valid_direction": 2.1333333333333258}}
good_angle_max18.313907760322827
good_angle_mean11.144112641222362
good_angle_median16.51740361855984
good_angle_min0.06896665489742422
reward_max-3.644003686591512
reward_mean-6.730785605532084
reward_median-7.142260233303042
reward_min-10.29928544088572
survival_time_max9.299999999999978
survival_time_mean6.886666666666652
survival_time_min3.9666666666666623
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max2.766666666666662
valid_direction_mean2.08666666666666
valid_direction_median2.766666666666657
valid_direction_min0
5892792EdwardRandom executionaido1_LF1_r3-v3step2-scoringsuccessno-0:02:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.333333333333321


other stats
episodes
details{"ep000": {"nsteps": 119, "reward": -10.29928544088572, "good_angle": 17.226891564339322, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 2.766666666666662}, "ep001": {"nsteps": 264, "reward": -4.779882687623754, "good_angle": 16.51740361855984, "survival_time": 8.79999999999998, "traveled_tiles": 3, "valid_direction": 2.7666666666666577}, "ep002": {"nsteps": 279, "reward": -3.644003686591512, "good_angle": 0.06896665489742422, "survival_time": 9.299999999999978, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 181, "reward": -7.788495979256393, "good_angle": 18.313907760322827, "survival_time": 6.033333333333322, "traveled_tiles": 3, "valid_direction": 2.766666666666657}, "ep004": {"nsteps": 190, "reward": -7.142260233303042, "good_angle": 3.5933936079923985, "survival_time": 6.333333333333321, "traveled_tiles": 3, "valid_direction": 2.1333333333333258}}
good_angle_max18.313907760322827
good_angle_mean11.144112641222362
good_angle_median16.51740361855984
good_angle_min0.06896665489742422
reward_max-3.644003686591512
reward_mean-6.730785605532084
reward_median-7.142260233303042
reward_min-10.29928544088572
survival_time_max9.299999999999978
survival_time_mean6.886666666666652
survival_time_min3.9666666666666623
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max2.766666666666662
valid_direction_mean2.08666666666666
valid_direction_median2.766666666666657
valid_direction_min0
5891792EdwardRandom executionaido1_LF1_r3-v3step2-scoringsuccessno-0:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.333333333333321


other stats
episodes
details{"ep000": {"nsteps": 119, "reward": -10.29928544088572, "good_angle": 17.226891564339322, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 2.766666666666662}, "ep001": {"nsteps": 264, "reward": -4.779882687623754, "good_angle": 16.51740361855984, "survival_time": 8.79999999999998, "traveled_tiles": 3, "valid_direction": 2.7666666666666577}, "ep002": {"nsteps": 279, "reward": -3.644003686591512, "good_angle": 0.06896665489742422, "survival_time": 9.299999999999978, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 181, "reward": -7.788495979256393, "good_angle": 18.313907760322827, "survival_time": 6.033333333333322, "traveled_tiles": 3, "valid_direction": 2.766666666666657}, "ep004": {"nsteps": 190, "reward": -7.142260233303042, "good_angle": 3.5933936079923985, "survival_time": 6.333333333333321, "traveled_tiles": 3, "valid_direction": 2.1333333333333258}}
good_angle_max18.313907760322827
good_angle_mean11.144112641222362
good_angle_median16.51740361855984
good_angle_min0.06896665489742422
reward_max-3.644003686591512
reward_mean-6.730785605532084
reward_median-7.142260233303042
reward_min-10.29928544088572
survival_time_max9.299999999999978
survival_time_mean6.886666666666652
survival_time_min3.9666666666666623
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max2.766666666666662
valid_direction_mean2.08666666666666
valid_direction_median2.766666666666657
valid_direction_min0
5890792EdwardRandom executionaido1_LF1_r3-v3step1-simulationsuccessno-0:03:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5889792EdwardRandom executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5888792EdwardRandom executionaido1_LF1_r3-v3step1-simulationsuccessno-0:01:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5887792EdwardRandom executionaido1_LF1_r3-v3step1-simulationsuccessno-0:03:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1