AI Driving Olympics Home Challenges Submissions Jobs

Submission 506

Submission506
Competingyes
Challengeaido1_LF1_r3-v3
UserJon
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 14166 step2-scoring: 14174 step3-videos: 14179 step4-viz: 14187
Next
User labelJP pipeline
Admin priority50
Blessing50
User priority

14187

Click the images to see detailed statistics about the episode.

14179

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
14187506JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes-0:01:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.09214455109415363
deviation-center-line_median0.009179842381599752
in-drivable-lane_median4.533333333333326


other stats
deviation-center-line_max0.5796633783410841
deviation-center-line_mean0.1209098121585994
deviation-center-line_min0
deviation-heading_max8.853841885288634
deviation-heading_mean1.8574118411383056
deviation-heading_median0.15086978677159554
deviation-heading_min0
driven_any_max0.4811032074290481
driven_any_mean0.3846696233192129
driven_any_median0.406228046310888
driven_any_min0.2543236160899993
driven_lanedir_max0.1622245330469001
driven_lanedir_mean0.08651723688144282
driven_lanedir_min0
in-drivable-lane_max5.29999999999999
in-drivable-lane_mean3.179999999999995
in-drivable-lane_min0.09999999999999998
per-episodes
details{"ep000": {"driven_any": 0.2543236160899993, "driven_lanedir": 0, "in-drivable-lane": 1.1, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.406228046310888, "driven_lanedir": 0.09503714041736178, "in-drivable-lane": 4.866666666666658, "deviation-heading": 0.1928773481398994, "deviation-center-line": 0.009179842381599752}, "ep002": {"driven_any": 0.4811032074290481, "driven_lanedir": 0.1622245330469001, "in-drivable-lane": 0.09999999999999998, "deviation-heading": 8.853841885288634, "deviation-center-line": 0.5796633783410841}, "ep003": {"driven_any": 0.4114781437844365, "driven_lanedir": 0.09214455109415363, "in-drivable-lane": 4.533333333333326, "deviation-heading": 0.15086978677159554, "deviation-center-line": 0.0062512205733389935}, "ep004": {"driven_any": 0.3702151029816927, "driven_lanedir": 0.08317995984879856, "in-drivable-lane": 5.29999999999999, "deviation-heading": 0.08947018549139796, "deviation-center-line": 0.009454619496974176}}
14186506JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes-0:01:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.09214455109415363
deviation-center-line_median0.009179842381599752
in-drivable-lane_median4.533333333333326


other stats
deviation-center-line_max0.5796633783410841
deviation-center-line_mean0.1209098121585994
deviation-center-line_min0
deviation-heading_max8.853841885288634
deviation-heading_mean1.8574118411383056
deviation-heading_median0.15086978677159554
deviation-heading_min0
driven_any_max0.4811032074290481
driven_any_mean0.3846696233192129
driven_any_median0.406228046310888
driven_any_min0.2543236160899993
driven_lanedir_max0.1622245330469001
driven_lanedir_mean0.08651723688144282
driven_lanedir_min0
in-drivable-lane_max5.29999999999999
in-drivable-lane_mean3.179999999999995
in-drivable-lane_min0.09999999999999998
per-episodes
details{"ep000": {"driven_any": 0.2543236160899993, "driven_lanedir": 0, "in-drivable-lane": 1.1, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.406228046310888, "driven_lanedir": 0.09503714041736178, "in-drivable-lane": 4.866666666666658, "deviation-heading": 0.1928773481398994, "deviation-center-line": 0.009179842381599752}, "ep002": {"driven_any": 0.4811032074290481, "driven_lanedir": 0.1622245330469001, "in-drivable-lane": 0.09999999999999998, "deviation-heading": 8.853841885288634, "deviation-center-line": 0.5796633783410841}, "ep003": {"driven_any": 0.4114781437844365, "driven_lanedir": 0.09214455109415363, "in-drivable-lane": 4.533333333333326, "deviation-heading": 0.15086978677159554, "deviation-center-line": 0.0062512205733389935}, "ep004": {"driven_any": 0.3702151029816927, "driven_lanedir": 0.08317995984879856, "in-drivable-lane": 5.29999999999999, "deviation-heading": 0.08947018549139796, "deviation-center-line": 0.009454619496974176}}
14179506JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes-0:00:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
14174506JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.166666666666658


other stats
episodes
details{"ep000": {"nsteps": 34, "reward": -32.310612480430045, "good_angle": 2.0415144737904436, "survival_time": 1.1333333333333335, "traveled_tiles": 1, "valid_direction": 1.0333333333333334}, "ep001": {"nsteps": 155, "reward": -9.0619213102806, "good_angle": 5.732044765967412, "survival_time": 5.166666666666658, "traveled_tiles": 1, "valid_direction": 4.999999999999991}, "ep002": {"nsteps": 214, "reward": -5.117444511885955, "good_angle": 11.53068705601369, "survival_time": 7.133333333333318, "traveled_tiles": 1, "valid_direction": 7.06666666666665}, "ep003": {"nsteps": 144, "reward": -9.578221540328943, "good_angle": 5.3039926200775325, "survival_time": 4.799999999999993, "traveled_tiles": 2, "valid_direction": 4.633333333333326}, "ep004": {"nsteps": 165, "reward": -8.702814062617042, "good_angle": 5.138312815742137, "survival_time": 5.49999999999999, "traveled_tiles": 2, "valid_direction": 5.3666666666666565}}
good_angle_max11.53068705601369
good_angle_mean5.949310346318243
good_angle_median5.3039926200775325
good_angle_min2.0415144737904436
reward_max-5.117444511885955
reward_mean-12.954202781108515
reward_median-9.0619213102806
reward_min-32.310612480430045
survival_time_max7.133333333333318
survival_time_mean4.746666666666658
survival_time_min1.1333333333333335
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max7.06666666666665
valid_direction_mean4.619999999999991
valid_direction_median4.999999999999991
valid_direction_min1.0333333333333334
14166506JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessyes-0:02:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10131506JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno-0:07:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4429506JonJP pipelineaido1_LF1_r3-v3step1-simulationerrorno-0:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4429-1913', 'pull']:

   >  Command '['docker-compose', '-p', 'job4429-1913', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4428506JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno-0:06:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4427506JonJP pipelineaido1_LF1_r3-v3step1-simulationerrorno-0:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4427-7959', 'pull']:

   >  Command '['docker-compose', '-p', 'job4427-7959', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.