Duckietown Challenges Home Challenges Submissions

Submission 1125

Submission1125
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin Ramtoula 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 12631 step2-scoring: 8884 step3-videos: 8885 step4-viz: 8894
Next
User labelMy ROS solution
Admin priority50
Blessingn/a
User priority50

8894

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

8885

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
12631step1-simulationfailedyes0:08:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8894step4-vizsuccessyes0:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.401254793145835
deviation-center-line_median1.004071813202574
in-drivable-lane_median4.33333333333333


other stats
deviation-center-line_max1.6334991892077222
deviation-center-line_mean0.9257475435667752
deviation-center-line_min0.2525232676315132
deviation-heading_max2.9157783785804554
deviation-heading_mean1.8953560060396344
deviation-heading_median2.365965541896246
deviation-heading_min0.6930252417034689
driven_any_max5.46833029907314
driven_any_mean3.721113633643469
driven_any_median5.082566143627928
driven_any_min1.17078703020304
driven_lanedir_max3.9701898953282138
driven_lanedir_mean2.621207248845344
driven_lanedir_min0.7800845802918484
in-drivable-lane_max5.399999999999982
in-drivable-lane_mean3.406666666666659
in-drivable-lane_min0.8999999999999968
per-episodes
details{"ep000": {"driven_any": 5.082566143627928, "driven_lanedir": 3.5870343062156578, "in-drivable-lane": 5.033333333333323, "deviation-heading": 2.9157783785804554, "deviation-center-line": 1.1483376901396964}, "ep001": {"driven_any": 1.17078703020304, "driven_lanedir": 0.7800845802918484, "in-drivable-lane": 1.3666666666666618, "deviation-heading": 0.6930252417034689, "deviation-center-line": 0.2525232676315132}, "ep002": {"driven_any": 5.212069701613519, "driven_lanedir": 3.401254793145835, "in-drivable-lane": 5.399999999999982, "deviation-heading": 2.803529358749528, "deviation-center-line": 1.004071813202574}, "ep003": {"driven_any": 5.46833029907314, "driven_lanedir": 3.9701898953282138, "in-drivable-lane": 4.33333333333333, "deviation-heading": 2.365965541896246, "deviation-center-line": 1.6334991892077222}, "ep004": {"driven_any": 1.6718149936997175, "driven_lanedir": 1.3674726692451653, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 0.6984815092684744, "deviation-center-line": 0.5903057576523699}}
No reset possible
8893step4-vizsuccessyes0:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8892step4-vizsuccessyes0:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8885step3-videossuccessyes0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8884step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.28736362035316415, "good_angle": 1.3699398663502953, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.199999999999989}, "ep001": {"nsteps": 121, "reward": -9.44257581414855, "good_angle": 13.558964465031329, "survival_time": 4.033333333333329, "traveled_tiles": 3, "valid_direction": 2.7333333333333276}, "ep002": {"nsteps": 500, "reward": -0.30199863244325387, "good_angle": 1.3266642103894115, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.8333333333333304}, "ep003": {"nsteps": 500, "reward": -0.338634068045998, "good_angle": 1.1088716333917508, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 3.83333333333335}, "ep004": {"nsteps": 152, "reward": -7.412497799166503, "good_angle": 13.321708252101688, "survival_time": 5.066666666666658, "traveled_tiles": 3, "valid_direction": 2.4666666666666597}}
good_angle_max13.558964465031329
good_angle_mean6.137229685452894
good_angle_median1.3699398663502953
good_angle_min1.1088716333917508
reward_max-0.28736362035316415
reward_mean-3.5566139868314934
reward_median-0.338634068045998
reward_min-9.44257581414855
survival_time_max16.666666666666654
survival_time_mean11.81999999999999
survival_time_min4.033333333333329
traveled_tiles_max10
traveled_tiles_mean7.2
traveled_tiles_median10
traveled_tiles_min3
valid_direction_max4.199999999999989
valid_direction_mean3.4133333333333313
valid_direction_median3.8333333333333304
valid_direction_min2.4666666666666597
No reset possible
8883step2-scoringsuccessyes0:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible