AI Driving Olympics Home Challenges Submissions Jobs

Submission 507

Submission507
Competingyes
Challengeaido1_LF1_r3-v3
UserJon
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 14180 step2-scoring: 14190 step3-videos: 14193 step4-viz: 14196
Next
User labelJP pipeline
Admin priority50
Blessing50
User priority

14196

Click the images to see detailed statistics about the episode.

14193

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
14196507JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes-0:01:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.09214455109415363
deviation-center-line_median0.009179842381599752
in-drivable-lane_median4.533333333333326


other stats
deviation-center-line_max0.5796633783410841
deviation-center-line_mean0.1209098121585994
deviation-center-line_min0
deviation-heading_max8.853841885288634
deviation-heading_mean1.8574118411383056
deviation-heading_median0.15086978677159554
deviation-heading_min0
driven_any_max0.4811032074290481
driven_any_mean0.38035187058526465
driven_any_median0.406228046310888
driven_any_min0.23273485242025824
driven_lanedir_max0.1622245330469001
driven_lanedir_mean0.08651723688144282
driven_lanedir_min0
in-drivable-lane_max5.29999999999999
in-drivable-lane_mean3.4533333333333283
in-drivable-lane_min0.09999999999999998
per-episodes
details{"ep000": {"driven_any": 0.23273485242025824, "driven_lanedir": 0, "in-drivable-lane": 2.4666666666666677, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.406228046310888, "driven_lanedir": 0.09503714041736178, "in-drivable-lane": 4.866666666666658, "deviation-heading": 0.1928773481398994, "deviation-center-line": 0.009179842381599752}, "ep002": {"driven_any": 0.4811032074290481, "driven_lanedir": 0.1622245330469001, "in-drivable-lane": 0.09999999999999998, "deviation-heading": 8.853841885288634, "deviation-center-line": 0.5796633783410841}, "ep003": {"driven_any": 0.4114781437844365, "driven_lanedir": 0.09214455109415363, "in-drivable-lane": 4.533333333333326, "deviation-heading": 0.15086978677159554, "deviation-center-line": 0.0062512205733389935}, "ep004": {"driven_any": 0.3702151029816927, "driven_lanedir": 0.08317995984879856, "in-drivable-lane": 5.29999999999999, "deviation-heading": 0.08947018549139796, "deviation-center-line": 0.009454619496974176}}
14193507JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes-0:00:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
14190507JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.166666666666658


other stats
episodes
details{"ep000": {"nsteps": 75, "reward": -16.469658556779226, "good_angle": 5.023130551042082, "survival_time": 2.500000000000001, "traveled_tiles": 1, "valid_direction": 2.400000000000001}, "ep001": {"nsteps": 155, "reward": -9.0619213102806, "good_angle": 5.732044765967412, "survival_time": 5.166666666666658, "traveled_tiles": 1, "valid_direction": 4.999999999999991}, "ep002": {"nsteps": 214, "reward": -5.117444511885955, "good_angle": 11.53068705601369, "survival_time": 7.133333333333318, "traveled_tiles": 1, "valid_direction": 7.06666666666665}, "ep003": {"nsteps": 144, "reward": -9.578221540328943, "good_angle": 5.3039926200775325, "survival_time": 4.799999999999993, "traveled_tiles": 2, "valid_direction": 4.633333333333326}, "ep004": {"nsteps": 165, "reward": -8.702814062617042, "good_angle": 5.138312815742137, "survival_time": 5.49999999999999, "traveled_tiles": 2, "valid_direction": 5.3666666666666565}}
good_angle_max11.53068705601369
good_angle_mean6.545633561768571
good_angle_median5.3039926200775325
good_angle_min5.023130551042082
reward_max-5.117444511885955
reward_mean-9.786011996378353
reward_median-9.0619213102806
reward_min-16.469658556779226
survival_time_max7.133333333333318
survival_time_mean5.019999999999992
survival_time_min2.500000000000001
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max7.06666666666665
valid_direction_mean4.893333333333325
valid_direction_median4.999999999999991
valid_direction_min2.400000000000001
14180507JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessyes-0:02:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10128507JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno-0:06:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4433507JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno-0:01:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4432507JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno-0:01:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4431507JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno-0:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.1246948208808898, "good_angle": 67.85685316541604, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.499999999999986}, "ep001": {"nsteps": 500, "reward": -3.0380495955944062, "good_angle": 17.17991347809843, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 16.53333333333332}, "ep002": {"nsteps": 500, "reward": -2.907704526901245, "good_angle": 17.314454280860954, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.499999999999986}, "ep003": {"nsteps": 500, "reward": -3.119110053539276, "good_angle": 16.92364257371301, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.599999999999984}, "ep004": {"nsteps": 500, "reward": -2.4116466751098633, "good_angle": 1.8287785762794335, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max67.85685316541604
good_angle_mean24.220728414873573
good_angle_median17.17991347809843
good_angle_min1.8287785762794335
reward_max-1.1246948208808898
reward_mean-2.5202411344051363
reward_median-2.907704526901245
reward_min-3.119110053539276
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max16.599999999999984
valid_direction_mean13.226666666666654
valid_direction_median16.499999999999986
valid_direction_min0
4430507JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno-0:06:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1