Duckietown Challenges Home Challenges Submissions

Submission 1057

Submission1057
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin Ramtoula 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 12021 step2-scoring: 8476 step3-videos: 8477 step4-viz: 8478
Next
User labelMy ROS solution
Admin priority50
Blessingn/a
User priority50

8478

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

8477

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
12021step1-simulationfailedyes0:09:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8478step4-vizsuccessyes0:04:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.034610742162956
deviation-center-line_median1.8956281287939272
in-drivable-lane_median6.099999999999979


other stats
deviation-center-line_max2.652751104603314
deviation-center-line_mean1.9755294461261648
deviation-center-line_min1.6460899544723115
deviation-heading_max2.4144712209664254
deviation-heading_mean1.7462435374566574
deviation-heading_median1.549177300553512
deviation-heading_min1.3896800543892318
driven_any_max4.823539949571194
driven_any_mean4.331121312274041
driven_any_median4.305734913326064
driven_any_min4.004167583190454
driven_lanedir_max4.769070445602773
driven_lanedir_mean3.2622858195009172
driven_lanedir_min2.367545820834376
in-drivable-lane_max6.933333333333344
in-drivable-lane_mean4.439999999999992
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 4.305734913326064, "driven_lanedir": 2.7093287000445647, "in-drivable-lane": 6.79999999999998, "deviation-heading": 1.416082836559443, "deviation-center-line": 1.6657844396461023}, "ep001": {"driven_any": 4.004167583190454, "driven_lanedir": 3.4308733888599168, "in-drivable-lane": 2.366666666666659, "deviation-heading": 2.4144712209664254, "deviation-center-line": 2.017393603115168}, "ep002": {"driven_any": 4.036269614585406, "driven_lanedir": 2.367545820834376, "in-drivable-lane": 6.933333333333344, "deviation-heading": 1.549177300553512, "deviation-center-line": 1.6460899544723115}, "ep003": {"driven_any": 4.485894500697086, "driven_lanedir": 3.034610742162956, "in-drivable-lane": 6.099999999999979, "deviation-heading": 1.3896800543892318, "deviation-center-line": 1.8956281287939272}, "ep004": {"driven_any": 4.823539949571194, "driven_lanedir": 4.769070445602773, "in-drivable-lane": 0, "deviation-heading": 1.9618062748146752, "deviation-center-line": 2.652751104603314}}
No reset possible
8477step3-videossuccessyes0:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8476step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5926259270254522, "good_angle": 0.8191843059460885, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 1.8333333333333268}, "ep001": {"nsteps": 500, "reward": -0.5868085568649695, "good_angle": 44.97307514874745, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 6.566666666666675}, "ep002": {"nsteps": 500, "reward": -0.660754750397522, "good_angle": 0.9797513618123548, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 2.666666666666661}, "ep003": {"nsteps": 500, "reward": -0.6510454961033538, "good_angle": 0.842613897542074, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 2.3333333333333273}, "ep004": {"nsteps": 500, "reward": -0.47875257387198505, "good_angle": 29.73362753251532, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 4.3333333333333215}}
good_angle_max44.97307514874745
good_angle_mean15.469650449312656
good_angle_median0.9797513618123548
good_angle_min0.8191843059460885
reward_max-0.47875257387198505
reward_mean-0.5939974608526565
reward_median-0.5926259270254522
reward_min-0.660754750397522
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max9
traveled_tiles_mean9
traveled_tiles_median9
traveled_tiles_min9
valid_direction_max6.566666666666675
valid_direction_mean3.5466666666666624
valid_direction_median2.666666666666661
valid_direction_min1.8333333333333268
No reset possible
8475step2-scoringsuccessyes0:09:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8474step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible