AI Driving Olympics Home Challenges Submissions Jobs

Submission 1063

Submission1063
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 11662 step2-scoring: 11667 step3-videos: 11668 step4-viz: 11669
Next
User labelMy ROS solution
Admin priority75
User priority75

11669

Click the images to see detailed statistics about the episode.

11668

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
116691063BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes-0:04:54(hidden)
driven_lanedir_median14.04681817848216
deviation-center-line_median0.9076722698563474
in-drivable-lane_median0.5666666666666667


other stats
deviation-center-line_max1.0092880930537125
deviation-center-line_mean0.8069963870672325
deviation-center-line_min0.31431125075729577
deviation-heading_max1.5421563039631427
deviation-heading_mean1.0955971593327614
deviation-heading_median1.0837921528528982
deviation-heading_min0.6350371956923369
driven_any_max15.376558162844647
driven_any_mean12.720925107711068
driven_any_median14.997470487176995
driven_any_min3.438707478495325
driven_lanedir_max15.006699411525512
driven_lanedir_mean11.995991922453449
driven_lanedir_min3.127159260241255
in-drivable-lane_max1.566666666666666
in-drivable-lane_mean0.7133333333333324
in-drivable-lane_min0.2666666666666657
per-episodes
details{"ep000": {"driven_any": 14.997470487176995, "driven_lanedir": 13.557562248509369, "in-drivable-lane": 1.566666666666666, "deviation-heading": 1.1358582288981394, "deviation-center-line": 0.9076722698563474}, "ep001": {"driven_any": 14.701674168138112, "driven_lanedir": 14.04681817848216, "in-drivable-lane": 0.5666666666666667, "deviation-heading": 1.5421563039631427, "deviation-center-line": 1.0092880930537125}, "ep002": {"driven_any": 15.09021524190026, "driven_lanedir": 14.241720513508945, "in-drivable-lane": 0.8666666666666636, "deviation-heading": 1.0811419152572896, "deviation-center-line": 0.878326468557804}, "ep003": {"driven_any": 15.376558162844647, "driven_lanedir": 15.006699411525512, "in-drivable-lane": 0.2999999999999998, "deviation-heading": 1.0837921528528982, "deviation-center-line": 0.9253838531110026}, "ep004": {"driven_any": 3.438707478495325, "driven_lanedir": 3.127159260241255, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 0.6350371956923369, "deviation-center-line": 0.31431125075729577}}
116681063BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes-0:02:04(hidden)
other stats
videos1
116671063BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:23(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.4347895565838553, "good_angle": 0.4443466338917107, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.666666666666665}, "ep001": {"nsteps": 500, "reward": 0.5072826606929303, "good_angle": 0.43817474015522945, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.8333333333333325}, "ep002": {"nsteps": 500, "reward": 0.45172220971575006, "good_angle": 0.3697103496019338, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.5999999999999979}, "ep003": {"nsteps": 500, "reward": 0.4634158202065155, "good_angle": 0.397207218229095, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 0.5666666666666647}, "ep004": {"nsteps": 121, "reward": -7.769647268928618, "good_angle": 0.21632262274245953, "survival_time": 4.033333333333329, "traveled_tiles": 6, "valid_direction": 0.4333333333333328}}
good_angle_max0.4443466338917107
good_angle_mean0.3731523129240857
good_angle_median0.397207218229095
good_angle_min0.21632262274245953
reward_max0.5072826606929303
reward_mean-1.1824874043459133
reward_median0.45172220971575006
reward_min-7.769647268928618
survival_time_max16.666666666666654
survival_time_mean14.13999999999999
survival_time_min4.033333333333329
traveled_tiles_max18
traveled_tiles_mean15.6
traveled_tiles_median18
traveled_tiles_min6
valid_direction_max0.8333333333333325
valid_direction_mean0.6199999999999986
valid_direction_median0.5999999999999979
valid_direction_min0.4333333333333328
116621063BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessyes-0:10:08(hidden)
other stats
simulation-passed1
85111063BenjaminMy ROS solutionaido1_LF1_r3-v3step4-vizsuccessyes-0:04:26(hidden)
driven_lanedir_median4.756129785798899
deviation-center-line_median1.0730541900047572
in-drivable-lane_median1.1666666666666623


other stats
deviation-center-line_max2.3172319288572645
deviation-center-line_mean1.5133728326491311
deviation-center-line_min0.9686095062340104
deviation-heading_max2.2477063136047
deviation-heading_mean1.848510342809222
deviation-heading_median2.156107067922247
deviation-heading_min0.928476674852744
driven_any_max5.579022975679196
driven_any_mean5.227763183784536
driven_any_median5.1573245680692485
driven_any_min5.008479916044937
driven_lanedir_max5.549726756440515
driven_lanedir_mean4.897467431923838
driven_lanedir_min4.570234996830824
in-drivable-lane_max1.6666666666666623
in-drivable-lane_mean0.8666666666666639
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.1573245680692485, "driven_lanedir": 4.577019628674962, "in-drivable-lane": 1.6666666666666623, "deviation-heading": 2.156107067922247, "deviation-center-line": 1.0730541900047572}, "ep001": {"driven_any": 5.292426557977786, "driven_lanedir": 4.756129785798899, "in-drivable-lane": 1.499999999999995, "deviation-heading": 2.2477063136047, "deviation-center-line": 2.144153824323827}, "ep002": {"driven_any": 5.008479916044937, "driven_lanedir": 4.570234996830824, "in-drivable-lane": 1.1666666666666623, "deviation-heading": 2.2253538125178047, "deviation-center-line": 1.0638147138257974}, "ep003": {"driven_any": 5.101561901151513, "driven_lanedir": 5.034225991873988, "in-drivable-lane": 0, "deviation-heading": 1.6849078451486157, "deviation-center-line": 0.9686095062340104}, "ep004": {"driven_any": 5.579022975679196, "driven_lanedir": 5.549726756440515, "in-drivable-lane": 0, "deviation-heading": 0.928476674852744, "deviation-center-line": 2.3172319288572645}}
85101063BenjaminMy ROS solutionaido1_LF1_r3-v3step3-videossuccessyes-0:02:26(hidden)
other stats
videos1
85091063BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:19(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.25416273124999134, "good_angle": 0.7444893646124573, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 500, "reward": -0.44939830574346706, "good_angle": 23.524621673805804, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 4.166666666666655}, "ep002": {"nsteps": 500, "reward": -0.3045769970673136, "good_angle": 0.7257529187394196, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.5666666666666649}, "ep003": {"nsteps": 500, "reward": -0.2888979723546654, "good_angle": 0.4591799947974504, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 0.6999999999999975}, "ep004": {"nsteps": 500, "reward": -0.39088739768415687, "good_angle": 17.242621474406523, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.166666666666659}}
good_angle_max23.524621673805804
good_angle_mean8.539333085272329
good_angle_median0.7444893646124573
good_angle_min0.4591799947974504
reward_max-0.25416273124999134
reward_mean-0.3375846808199189
reward_median-0.3045769970673136
reward_min-0.44939830574346706
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max11
traveled_tiles_mean10.2
traveled_tiles_median10
traveled_tiles_min9
valid_direction_max4.166666666666655
valid_direction_mean2.013333333333327
valid_direction_median1.5666666666666649
valid_direction_min0.6999999999999975
85081063BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringabortedyes-0:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job8508-4132', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job8508-4132', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job8508-4132_evaluation" with the default driver
stderr | Creating job8508-4132_scorer_1 ...
stderr | 
Creating job8508-4132_scorer_1 ... error

stderr | ERROR: for job8508-4132_scorer_1  Cannot start service scorer: network job8508-4132_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job8508-4132_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
(hidden)
85071063BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:20(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.25416273124999134, "good_angle": 0.7444893646124573, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 500, "reward": -0.44939830574346706, "good_angle": 23.524621673805804, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 4.166666666666655}, "ep002": {"nsteps": 500, "reward": -0.3045769970673136, "good_angle": 0.7257529187394196, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.5666666666666649}, "ep003": {"nsteps": 500, "reward": -0.2888979723546654, "good_angle": 0.4591799947974504, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 0.6999999999999975}, "ep004": {"nsteps": 500, "reward": -0.39088739768415687, "good_angle": 17.242621474406523, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.166666666666659}}
good_angle_max23.524621673805804
good_angle_mean8.539333085272329
good_angle_median0.7444893646124573
good_angle_min0.4591799947974504
reward_max-0.25416273124999134
reward_mean-0.3375846808199189
reward_median-0.3045769970673136
reward_min-0.44939830574346706
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max11
traveled_tiles_mean10.2
traveled_tiles_median10
traveled_tiles_min9
valid_direction_max4.166666666666655
valid_direction_mean2.013333333333327
valid_direction_median1.5666666666666649
valid_direction_min0.6999999999999975
85061063BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes-0:09:35(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.25416273124999134, "good_angle": 0.7444893646124573, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 500, "reward": -0.44939830574346706, "good_angle": 23.524621673805804, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 4.166666666666655}, "ep002": {"nsteps": 500, "reward": -0.3045769970673136, "good_angle": 0.7257529187394196, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.5666666666666649}, "ep003": {"nsteps": 500, "reward": -0.2888979723546654, "good_angle": 0.4591799947974504, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 0.6999999999999975}, "ep004": {"nsteps": 500, "reward": -0.39088739768415687, "good_angle": 17.242621474406523, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.166666666666659}}
good_angle_max23.524621673805804
good_angle_mean8.539333085272329
good_angle_median0.7444893646124573
good_angle_min0.4591799947974504
reward_max-0.25416273124999134
reward_mean-0.3375846808199189
reward_median-0.3045769970673136
reward_min-0.44939830574346706
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max11
traveled_tiles_mean10.2
traveled_tiles_median10
traveled_tiles_min9
valid_direction_max4.166666666666655
valid_direction_mean2.013333333333327
valid_direction_median1.5666666666666649
valid_direction_min0.6999999999999975
85051063BenjaminMy ROS solutionaido1_LF1_r3-v3step2-scoringsuccessyes-0:00:21(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.25416273124999134, "good_angle": 0.7444893646124573, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 500, "reward": -0.44939830574346706, "good_angle": 23.524621673805804, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 4.166666666666655}, "ep002": {"nsteps": 500, "reward": -0.3045769970673136, "good_angle": 0.7257529187394196, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.5666666666666649}, "ep003": {"nsteps": 500, "reward": -0.2888979723546654, "good_angle": 0.4591799947974504, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 0.6999999999999975}, "ep004": {"nsteps": 500, "reward": -0.39088739768415687, "good_angle": 17.242621474406523, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.166666666666659}}
good_angle_max23.524621673805804
good_angle_mean8.539333085272329
good_angle_median0.7444893646124573
good_angle_min0.4591799947974504
reward_max-0.25416273124999134
reward_mean-0.3375846808199189
reward_median-0.3045769970673136
reward_min-0.44939830574346706
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max11
traveled_tiles_mean10.2
traveled_tiles_median10
traveled_tiles_min9
valid_direction_max4.166666666666655
valid_direction_mean2.013333333333327
valid_direction_median1.5666666666666649
valid_direction_min0.6999999999999975
85041063BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno-0:09:12(hidden)
other stats
simulation-passed1
85031063BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationsuccessno-0:08:41(hidden)
other stats
simulation-passed1
85021063BenjaminMy ROS solutionaido1_LF1_r3-v3step1-simulationfailedno-0:10:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

(hidden)