AI Driving Olympics Home Challenges Submissions Jobs

Submission 1147

Submission1147
Competingyes
Challengeaido1_LF1_r3-v3
Userkrishna
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 12835 step2-scoring: 12849 step3-videos: 12851 step4-viz: 12853
Next
User labelgym_duckietown + opencv
Admin priority50
User priority50

12853

Click the images to see detailed statistics about the episode.

12851

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
128531147krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes-0:01:55(hidden)
driven_lanedir_median0.8022656594596751
deviation-center-line_median0.3895358751701523
in-drivable-lane_median0.06666666666666643


other stats
deviation-center-line_max0.5644312500051327
deviation-center-line_mean0.30916881236567495
deviation-center-line_min0.03952421125648198
deviation-heading_max1.090057203280407
deviation-heading_mean0.7888487304507988
deviation-heading_median0.9006001932271327
deviation-heading_min0.29543162460579153
driven_any_max1.164000000000015
driven_any_mean0.999600000000013
driven_any_median1.1100000000000478
driven_any_min0.7919999999999843
driven_lanedir_max1.122816353614602
driven_lanedir_mean0.7447795421955965
driven_lanedir_min0.006153287918019501
in-drivable-lane_max5.633333333333323
in-drivable-lane_mean1.1866666666666643
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1100000000000478, "driven_lanedir": 0.006153287918019501, "in-drivable-lane": 5.633333333333323, "deviation-heading": 1.0111883006884457, "deviation-center-line": 0.03952421125648198}, "ep001": {"driven_any": 0.8040000000000087, "driven_lanedir": 0.8022656594596751, "in-drivable-lane": 0, "deviation-heading": 0.29543162460579153, "deviation-center-line": 0.3895358751701523}, "ep002": {"driven_any": 0.7919999999999843, "driven_lanedir": 0.7235130463812862, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.090057203280407, "deviation-center-line": 0.13900663920962658}, "ep003": {"driven_any": 1.128000000000009, "driven_lanedir": 1.0691493636043994, "in-drivable-lane": 0.2333333333333325, "deviation-heading": 0.6469663304522174, "deviation-center-line": 0.5644312500051327}, "ep004": {"driven_any": 1.164000000000015, "driven_lanedir": 1.122816353614602, "in-drivable-lane": 0, "deviation-heading": 0.9006001932271327, "deviation-center-line": 0.4133460861869811}}
128511147krishnagym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyes-0:00:49(hidden)
other stats
videos1
128491147krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22(hidden)
survival_time_median6.333333333333321


other stats
episodes
details{"ep000": {"nsteps": 190, "reward": -6.219939594554078, "good_angle": 3.3105776331581445, "survival_time": 6.333333333333321, "traveled_tiles": 2, "valid_direction": 2.2666666666666586}, "ep001": {"nsteps": 136, "reward": -6.991245471762822, "good_angle": 0.019439236071725936, "survival_time": 4.533333333333327, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 134, "reward": -7.029910685581419, "good_angle": 0.7735436978585568, "survival_time": 4.466666666666661, "traveled_tiles": 2, "valid_direction": 1.566666666666661}, "ep003": {"nsteps": 190, "reward": -5.2546508033416774, "good_angle": 0.7357409995085257, "survival_time": 6.333333333333321, "traveled_tiles": 2, "valid_direction": 1.699999999999994}, "ep004": {"nsteps": 196, "reward": -4.87610804751083, "good_angle": 0.7218968910061945, "survival_time": 6.53333333333332, "traveled_tiles": 3, "valid_direction": 1.5999999999999943}}
good_angle_max3.3105776331581445
good_angle_mean1.1122396915206294
good_angle_median0.7357409995085257
good_angle_min0.019439236071725936
reward_max-4.87610804751083
reward_mean-6.074370920550165
reward_median-6.219939594554078
reward_min-7.029910685581419
survival_time_max6.53333333333332
survival_time_mean5.63999999999999
survival_time_min4.466666666666661
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max2.2666666666666586
valid_direction_mean1.4266666666666616
valid_direction_median1.5999999999999943
valid_direction_min0
128351147krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessyes-0:03:38(hidden)
other stats
simulation-passed1
90421147krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes-0:03:45(hidden)
driven_lanedir_median0.993725116598154
deviation-center-line_median0.5250077714219962
in-drivable-lane_median0


other stats
deviation-center-line_max0.7726126305172341
deviation-center-line_mean0.5861487639610925
deviation-center-line_min0.4784991881634035
deviation-heading_max4.8001563106600385
deviation-heading_mean1.3576437708747016
deviation-heading_median0.4129115949793908
deviation-heading_min0.07942104943374341
driven_any_max0.9960000000000088
driven_any_mean0.7437333333333104
driven_any_median0.9959999999999054
driven_any_min0.36399999999998744
driven_lanedir_max0.9959758860580704
driven_lanedir_mean0.6994308115403024
driven_lanedir_min0.14899922016337996
in-drivable-lane_max1.500000000000001
in-drivable-lane_mean0.30000000000000027
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3666666666666991, "driven_lanedir": 0.14899922016337996, "in-drivable-lane": 1.500000000000001, "deviation-heading": 4.8001563106600385, "deviation-center-line": 0.4856116643692014}, "ep001": {"driven_any": 0.36399999999998744, "driven_lanedir": 0.3631534149294058, "in-drivable-lane": 0, "deviation-heading": 0.4129115949793908, "deviation-center-line": 0.6690125653336273}, "ep002": {"driven_any": 0.9959999999999518, "driven_lanedir": 0.9953004199525022, "in-drivable-lane": 0, "deviation-heading": 0.37171330518889034, "deviation-center-line": 0.7726126305172341}, "ep003": {"driven_any": 0.9959999999999054, "driven_lanedir": 0.9959758860580704, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374341, "deviation-center-line": 0.5250077714219962}, "ep004": {"driven_any": 0.9960000000000088, "driven_lanedir": 0.993725116598154, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.4784991881634035}}
90411147krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizabortedyes-0:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9041-6834', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9041-6834', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9041-6834_evaluation" with the default driver
stderr | Creating job9041-6834_visualization_1 ...
stderr | 
Creating job9041-6834_visualization_1 ... error

stderr | ERROR: for job9041-6834_visualization_1  Cannot start service visualization: network job9041-6834_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job9041-6834_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
(hidden)
90401147krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes-0:03:46(hidden)
driven_lanedir_median0.993725116598154
deviation-center-line_median0.5250077714219962
in-drivable-lane_median0


other stats
deviation-center-line_max0.7726126305172341
deviation-center-line_mean0.5861487639610925
deviation-center-line_min0.4784991881634035
deviation-heading_max4.8001563106600385
deviation-heading_mean1.3576437708747016
deviation-heading_median0.4129115949793908
deviation-heading_min0.07942104943374341
driven_any_max0.9960000000000088
driven_any_mean0.7437333333333104
driven_any_median0.9959999999999054
driven_any_min0.36399999999998744
driven_lanedir_max0.9959758860580704
driven_lanedir_mean0.6994308115403024
driven_lanedir_min0.14899922016337996
in-drivable-lane_max1.500000000000001
in-drivable-lane_mean0.30000000000000027
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3666666666666991, "driven_lanedir": 0.14899922016337996, "in-drivable-lane": 1.500000000000001, "deviation-heading": 4.8001563106600385, "deviation-center-line": 0.4856116643692014}, "ep001": {"driven_any": 0.36399999999998744, "driven_lanedir": 0.3631534149294058, "in-drivable-lane": 0, "deviation-heading": 0.4129115949793908, "deviation-center-line": 0.6690125653336273}, "ep002": {"driven_any": 0.9959999999999518, "driven_lanedir": 0.9953004199525022, "in-drivable-lane": 0, "deviation-heading": 0.37171330518889034, "deviation-center-line": 0.7726126305172341}, "ep003": {"driven_any": 0.9959999999999054, "driven_lanedir": 0.9959758860580704, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374341, "deviation-center-line": 0.5250077714219962}, "ep004": {"driven_any": 0.9960000000000088, "driven_lanedir": 0.993725116598154, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.4784991881634035}}
90391147krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes-0:03:48(hidden)
driven_lanedir_median0.993725116598154
deviation-center-line_median0.5250077714219962
in-drivable-lane_median0


other stats
deviation-center-line_max0.7726126305172341
deviation-center-line_mean0.5861487639610925
deviation-center-line_min0.4784991881634035
deviation-heading_max4.8001563106600385
deviation-heading_mean1.3576437708747016
deviation-heading_median0.4129115949793908
deviation-heading_min0.07942104943374341
driven_any_max0.9960000000000088
driven_any_mean0.7437333333333104
driven_any_median0.9959999999999054
driven_any_min0.36399999999998744
driven_lanedir_max0.9959758860580704
driven_lanedir_mean0.6994308115403024
driven_lanedir_min0.14899922016337996
in-drivable-lane_max1.500000000000001
in-drivable-lane_mean0.30000000000000027
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3666666666666991, "driven_lanedir": 0.14899922016337996, "in-drivable-lane": 1.500000000000001, "deviation-heading": 4.8001563106600385, "deviation-center-line": 0.4856116643692014}, "ep001": {"driven_any": 0.36399999999998744, "driven_lanedir": 0.3631534149294058, "in-drivable-lane": 0, "deviation-heading": 0.4129115949793908, "deviation-center-line": 0.6690125653336273}, "ep002": {"driven_any": 0.9959999999999518, "driven_lanedir": 0.9953004199525022, "in-drivable-lane": 0, "deviation-heading": 0.37171330518889034, "deviation-center-line": 0.7726126305172341}, "ep003": {"driven_any": 0.9959999999999054, "driven_lanedir": 0.9959758860580704, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374341, "deviation-center-line": 0.5250077714219962}, "ep004": {"driven_any": 0.9960000000000088, "driven_lanedir": 0.993725116598154, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.4784991881634035}}
90331147krishnagym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyes-0:01:12(hidden)
other stats
videos1
90321147krishnagym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyes-0:01:15(hidden)
other stats
videos1
90171147krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes-0:07:35(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 188, "reward": -5.582159952426507, "good_angle": 2.8921088224751617, "survival_time": 6.266666666666654, "traveled_tiles": 1, "valid_direction": 5.166666666666654}, "ep001": {"nsteps": 184, "reward": -6.006585545190003, "good_angle": 0.027950161519413434, "survival_time": 6.133333333333321, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.28698273333907126, "good_angle": 0.5037599778514814, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 1.7000000000000297}, "ep003": {"nsteps": 500, "reward": -0.09759001524746418, "good_angle": 0.00037922062684382017, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.026040908180526456, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max2.8921088224751617
good_angle_mean0.7000309788252965
good_angle_median0.07595671165358207
good_angle_min0.00037922062684382017
reward_max0.026040908180526456
reward_mean-2.389455467604504
reward_median-0.28698273333907126
reward_min-6.006585545190003
survival_time_max16.666666666666654
survival_time_mean12.479999999999986
survival_time_min6.133333333333321
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.166666666666654
valid_direction_mean1.3733333333333366
valid_direction_median0
valid_direction_min0
90161147krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:21(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 188, "reward": -5.582159952426507, "good_angle": 2.8921088224751617, "survival_time": 6.266666666666654, "traveled_tiles": 1, "valid_direction": 5.166666666666654}, "ep001": {"nsteps": 184, "reward": -6.006585545190003, "good_angle": 0.027950161519413434, "survival_time": 6.133333333333321, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.28698273333907126, "good_angle": 0.5037599778514814, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 1.7000000000000297}, "ep003": {"nsteps": 500, "reward": -0.09759001524746418, "good_angle": 0.00037922062684382017, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.026040908180526456, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max2.8921088224751617
good_angle_mean0.7000309788252965
good_angle_median0.07595671165358207
good_angle_min0.00037922062684382017
reward_max0.026040908180526456
reward_mean-2.389455467604504
reward_median-0.28698273333907126
reward_min-6.006585545190003
survival_time_max16.666666666666654
survival_time_mean12.479999999999986
survival_time_min6.133333333333321
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.166666666666654
valid_direction_mean1.3733333333333366
valid_direction_median0
valid_direction_min0
90111147krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessno-0:02:30(hidden)
other stats
simulation-passed1
90101147krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationabortedno-0:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9010-8249', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9010-8249', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9010-8249_evaluation" with the default driver
stderr | Creating job9010-8249_evaluator_1 ...
stderr | Creating job9010-8249_solution_1  ...
stderr | 
Creating job9010-8249_evaluator_1 ... error

stderr | ERROR: for job9010-8249_evaluator_1  Cannot start service evaluator: network job9010-8249_evaluation not found
stderr | 
Creating job9010-8249_solution_1  ... error

stderr | ERROR: for job9010-8249_solution_1  Cannot start service solution: network job9010-8249_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job9010-8249_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job9010-8249_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
(hidden)
90091147krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationfailedno-0:06:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 556, in run
    solve(params, cis)
  File "solution.py", line 521, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


(hidden)