AI Driving Olympics Home Challenges Submissions Jobs

Submission 1147

Submission1147
Competingyes
Challengeaido1_LF1_r3-v3
Userkrishna
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12835 step2-scoring: 12849 step3-videos: 12851 step4-viz: 12853
Next
User labelgym_duckietown + opencv
Admin priority50
Blessing50
User priority

12853

Click the images to see detailed statistics about the episode.

12851

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
128531147krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes-0:01:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.8022656594596751
deviation-center-line_median0.3895358751701523
in-drivable-lane_median0.06666666666666643


other stats
deviation-center-line_max0.5644312500051327
deviation-center-line_mean0.30916881236567495
deviation-center-line_min0.03952421125648198
deviation-heading_max1.090057203280407
deviation-heading_mean0.7888487304507988
deviation-heading_median0.9006001932271327
deviation-heading_min0.29543162460579153
driven_any_max1.164000000000015
driven_any_mean0.999600000000013
driven_any_median1.1100000000000478
driven_any_min0.7919999999999843
driven_lanedir_max1.122816353614602
driven_lanedir_mean0.7447795421955965
driven_lanedir_min0.006153287918019501
in-drivable-lane_max5.633333333333323
in-drivable-lane_mean1.1866666666666643
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.1100000000000478, "driven_lanedir": 0.006153287918019501, "in-drivable-lane": 5.633333333333323, "deviation-heading": 1.0111883006884457, "deviation-center-line": 0.03952421125648198}, "ep001": {"driven_any": 0.8040000000000087, "driven_lanedir": 0.8022656594596751, "in-drivable-lane": 0, "deviation-heading": 0.29543162460579153, "deviation-center-line": 0.3895358751701523}, "ep002": {"driven_any": 0.7919999999999843, "driven_lanedir": 0.7235130463812862, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.090057203280407, "deviation-center-line": 0.13900663920962658}, "ep003": {"driven_any": 1.128000000000009, "driven_lanedir": 1.0691493636043994, "in-drivable-lane": 0.2333333333333325, "deviation-heading": 0.6469663304522174, "deviation-center-line": 0.5644312500051327}, "ep004": {"driven_any": 1.164000000000015, "driven_lanedir": 1.122816353614602, "in-drivable-lane": 0, "deviation-heading": 0.9006001932271327, "deviation-center-line": 0.4133460861869811}}
128511147krishnagym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyes-0:00:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
128491147krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.333333333333321


other stats
episodes
details{"ep000": {"nsteps": 190, "reward": -6.219939594554078, "good_angle": 3.3105776331581445, "survival_time": 6.333333333333321, "traveled_tiles": 2, "valid_direction": 2.2666666666666586}, "ep001": {"nsteps": 136, "reward": -6.991245471762822, "good_angle": 0.019439236071725936, "survival_time": 4.533333333333327, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 134, "reward": -7.029910685581419, "good_angle": 0.7735436978585568, "survival_time": 4.466666666666661, "traveled_tiles": 2, "valid_direction": 1.566666666666661}, "ep003": {"nsteps": 190, "reward": -5.2546508033416774, "good_angle": 0.7357409995085257, "survival_time": 6.333333333333321, "traveled_tiles": 2, "valid_direction": 1.699999999999994}, "ep004": {"nsteps": 196, "reward": -4.87610804751083, "good_angle": 0.7218968910061945, "survival_time": 6.53333333333332, "traveled_tiles": 3, "valid_direction": 1.5999999999999943}}
good_angle_max3.3105776331581445
good_angle_mean1.1122396915206294
good_angle_median0.7357409995085257
good_angle_min0.019439236071725936
reward_max-4.87610804751083
reward_mean-6.074370920550165
reward_median-6.219939594554078
reward_min-7.029910685581419
survival_time_max6.53333333333332
survival_time_mean5.63999999999999
survival_time_min4.466666666666661
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max2.2666666666666586
valid_direction_mean1.4266666666666616
valid_direction_median1.5999999999999943
valid_direction_min0
128351147krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessyes-0:03:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
90421147krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes-0:03:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.993725116598154
deviation-center-line_median0.5250077714219962
in-drivable-lane_median0


other stats
deviation-center-line_max0.7726126305172341
deviation-center-line_mean0.5861487639610925
deviation-center-line_min0.4784991881634035
deviation-heading_max4.8001563106600385
deviation-heading_mean1.3576437708747016
deviation-heading_median0.4129115949793908
deviation-heading_min0.07942104943374341
driven_any_max0.9960000000000088
driven_any_mean0.7437333333333104
driven_any_median0.9959999999999054
driven_any_min0.36399999999998744
driven_lanedir_max0.9959758860580704
driven_lanedir_mean0.6994308115403024
driven_lanedir_min0.14899922016337996
in-drivable-lane_max1.500000000000001
in-drivable-lane_mean0.30000000000000027
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3666666666666991, "driven_lanedir": 0.14899922016337996, "in-drivable-lane": 1.500000000000001, "deviation-heading": 4.8001563106600385, "deviation-center-line": 0.4856116643692014}, "ep001": {"driven_any": 0.36399999999998744, "driven_lanedir": 0.3631534149294058, "in-drivable-lane": 0, "deviation-heading": 0.4129115949793908, "deviation-center-line": 0.6690125653336273}, "ep002": {"driven_any": 0.9959999999999518, "driven_lanedir": 0.9953004199525022, "in-drivable-lane": 0, "deviation-heading": 0.37171330518889034, "deviation-center-line": 0.7726126305172341}, "ep003": {"driven_any": 0.9959999999999054, "driven_lanedir": 0.9959758860580704, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374341, "deviation-center-line": 0.5250077714219962}, "ep004": {"driven_any": 0.9960000000000088, "driven_lanedir": 0.993725116598154, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.4784991881634035}}
90411147krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizabortedyes-0:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9041-6834', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9041-6834', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9041-6834_evaluation" with the default driver
stderr | Creating job9041-6834_visualization_1 ...
stderr | 
Creating job9041-6834_visualization_1 ... error

stderr | ERROR: for job9041-6834_visualization_1  Cannot start service visualization: network job9041-6834_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job9041-6834_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
90401147krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes-0:03:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.993725116598154
deviation-center-line_median0.5250077714219962
in-drivable-lane_median0


other stats
deviation-center-line_max0.7726126305172341
deviation-center-line_mean0.5861487639610925
deviation-center-line_min0.4784991881634035
deviation-heading_max4.8001563106600385
deviation-heading_mean1.3576437708747016
deviation-heading_median0.4129115949793908
deviation-heading_min0.07942104943374341
driven_any_max0.9960000000000088
driven_any_mean0.7437333333333104
driven_any_median0.9959999999999054
driven_any_min0.36399999999998744
driven_lanedir_max0.9959758860580704
driven_lanedir_mean0.6994308115403024
driven_lanedir_min0.14899922016337996
in-drivable-lane_max1.500000000000001
in-drivable-lane_mean0.30000000000000027
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3666666666666991, "driven_lanedir": 0.14899922016337996, "in-drivable-lane": 1.500000000000001, "deviation-heading": 4.8001563106600385, "deviation-center-line": 0.4856116643692014}, "ep001": {"driven_any": 0.36399999999998744, "driven_lanedir": 0.3631534149294058, "in-drivable-lane": 0, "deviation-heading": 0.4129115949793908, "deviation-center-line": 0.6690125653336273}, "ep002": {"driven_any": 0.9959999999999518, "driven_lanedir": 0.9953004199525022, "in-drivable-lane": 0, "deviation-heading": 0.37171330518889034, "deviation-center-line": 0.7726126305172341}, "ep003": {"driven_any": 0.9959999999999054, "driven_lanedir": 0.9959758860580704, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374341, "deviation-center-line": 0.5250077714219962}, "ep004": {"driven_any": 0.9960000000000088, "driven_lanedir": 0.993725116598154, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.4784991881634035}}
90391147krishnagym_duckietown + opencvaido1_LF1_r3-v3step4-vizsuccessyes-0:03:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.993725116598154
deviation-center-line_median0.5250077714219962
in-drivable-lane_median0


other stats
deviation-center-line_max0.7726126305172341
deviation-center-line_mean0.5861487639610925
deviation-center-line_min0.4784991881634035
deviation-heading_max4.8001563106600385
deviation-heading_mean1.3576437708747016
deviation-heading_median0.4129115949793908
deviation-heading_min0.07942104943374341
driven_any_max0.9960000000000088
driven_any_mean0.7437333333333104
driven_any_median0.9959999999999054
driven_any_min0.36399999999998744
driven_lanedir_max0.9959758860580704
driven_lanedir_mean0.6994308115403024
driven_lanedir_min0.14899922016337996
in-drivable-lane_max1.500000000000001
in-drivable-lane_mean0.30000000000000027
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3666666666666991, "driven_lanedir": 0.14899922016337996, "in-drivable-lane": 1.500000000000001, "deviation-heading": 4.8001563106600385, "deviation-center-line": 0.4856116643692014}, "ep001": {"driven_any": 0.36399999999998744, "driven_lanedir": 0.3631534149294058, "in-drivable-lane": 0, "deviation-heading": 0.4129115949793908, "deviation-center-line": 0.6690125653336273}, "ep002": {"driven_any": 0.9959999999999518, "driven_lanedir": 0.9953004199525022, "in-drivable-lane": 0, "deviation-heading": 0.37171330518889034, "deviation-center-line": 0.7726126305172341}, "ep003": {"driven_any": 0.9959999999999054, "driven_lanedir": 0.9959758860580704, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374341, "deviation-center-line": 0.5250077714219962}, "ep004": {"driven_any": 0.9960000000000088, "driven_lanedir": 0.993725116598154, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.4784991881634035}}
90331147krishnagym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyes-0:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
90321147krishnagym_duckietown + opencvaido1_LF1_r3-v3step3-videossuccessyes-0:01:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
90171147krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes-0:07:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 188, "reward": -5.582159952426507, "good_angle": 2.8921088224751617, "survival_time": 6.266666666666654, "traveled_tiles": 1, "valid_direction": 5.166666666666654}, "ep001": {"nsteps": 184, "reward": -6.006585545190003, "good_angle": 0.027950161519413434, "survival_time": 6.133333333333321, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.28698273333907126, "good_angle": 0.5037599778514814, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 1.7000000000000297}, "ep003": {"nsteps": 500, "reward": -0.09759001524746418, "good_angle": 0.00037922062684382017, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.026040908180526456, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max2.8921088224751617
good_angle_mean0.7000309788252965
good_angle_median0.07595671165358207
good_angle_min0.00037922062684382017
reward_max0.026040908180526456
reward_mean-2.389455467604504
reward_median-0.28698273333907126
reward_min-6.006585545190003
survival_time_max16.666666666666654
survival_time_mean12.479999999999986
survival_time_min6.133333333333321
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.166666666666654
valid_direction_mean1.3733333333333366
valid_direction_median0
valid_direction_min0
90161147krishnagym_duckietown + opencvaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 188, "reward": -5.582159952426507, "good_angle": 2.8921088224751617, "survival_time": 6.266666666666654, "traveled_tiles": 1, "valid_direction": 5.166666666666654}, "ep001": {"nsteps": 184, "reward": -6.006585545190003, "good_angle": 0.027950161519413434, "survival_time": 6.133333333333321, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.28698273333907126, "good_angle": 0.5037599778514814, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 1.7000000000000297}, "ep003": {"nsteps": 500, "reward": -0.09759001524746418, "good_angle": 0.00037922062684382017, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.026040908180526456, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max2.8921088224751617
good_angle_mean0.7000309788252965
good_angle_median0.07595671165358207
good_angle_min0.00037922062684382017
reward_max0.026040908180526456
reward_mean-2.389455467604504
reward_median-0.28698273333907126
reward_min-6.006585545190003
survival_time_max16.666666666666654
survival_time_mean12.479999999999986
survival_time_min6.133333333333321
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.166666666666654
valid_direction_mean1.3733333333333366
valid_direction_median0
valid_direction_min0
90111147krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationsuccessno-0:02:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
90101147krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationabortedno-0:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9010-8249', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9010-8249', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9010-8249_evaluation" with the default driver
stderr | Creating job9010-8249_evaluator_1 ...
stderr | Creating job9010-8249_solution_1  ...
stderr | 
Creating job9010-8249_evaluator_1 ... error

stderr | ERROR: for job9010-8249_evaluator_1  Cannot start service evaluator: network job9010-8249_evaluation not found
stderr | 
Creating job9010-8249_solution_1  ... error

stderr | ERROR: for job9010-8249_solution_1  Cannot start service solution: network job9010-8249_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job9010-8249_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job9010-8249_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
90091147krishnagym_duckietown + opencvaido1_LF1_r3-v3step1-simulationfailedno-0:06:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 556, in run
    solve(params, cis)
  File "solution.py", line 521, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Hidden. If you are the author, please login using the top-right link or use the dashboard.