Duckietown Challenges Home Challenges Submissions

Submission 1058

Submission1058
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin Ramtoula 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12027 step2-scoring: 12046 step3-videos: 12049 step4-viz: 12055
Next
User labelMy ROS solution
Admin priority68
Blessingn/a
User priority68

12055

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

12049

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
12055step4-vizsuccessyes0:04:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median9.370583551486996
deviation-center-line_median1.652736576668149
in-drivable-lane_median3.2666666666666675


other stats
deviation-center-line_max2.25196706769912
deviation-center-line_mean1.5606793704779909
deviation-center-line_min0.49309847296009574
deviation-heading_max1.7835178764991957
deviation-heading_mean1.408892472642639
deviation-heading_median1.4632398021601765
deviation-heading_min0.8788577550054195
driven_any_max13.48640838918567
driven_any_mean11.624357723602106
driven_any_median12.919609396314716
driven_any_min5.895378579336924
driven_lanedir_max11.09386724639062
driven_lanedir_mean9.10989596871912
driven_lanedir_min5.787938618204423
in-drivable-lane_max5.200000000000017
in-drivable-lane_mean3.273333333333332
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 12.816792477107033, "driven_lanedir": 10.250454211515976, "in-drivable-lane": 3.2666666666666675, "deviation-heading": 1.7835178764991957, "deviation-center-line": 1.5497512272576843}, "ep001": {"driven_any": 5.895378579336924, "driven_lanedir": 5.787938618204423, "in-drivable-lane": 0, "deviation-heading": 0.8788577550054195, "deviation-center-line": 0.49309847296009574}, "ep002": {"driven_any": 13.00359977606619, "driven_lanedir": 9.370583551486996, "in-drivable-lane": 4.999999999999984, "deviation-heading": 1.2714963850550345, "deviation-center-line": 2.25196706769912}, "ep003": {"driven_any": 13.48640838918567, "driven_lanedir": 11.09386724639062, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 1.6473505444933687, "deviation-center-line": 1.652736576668149}, "ep004": {"driven_any": 12.919609396314716, "driven_lanedir": 9.04663621599759, "in-drivable-lane": 5.200000000000017, "deviation-heading": 1.4632398021601765, "deviation-center-line": 1.8558435078049045}}
No reset possible
12049step3-videossuccessyes0:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
12046step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": 0.2900602426051628, "good_angle": 0.9261906984041685, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.9666666666666628}, "ep001": {"nsteps": 229, "reward": -3.8693864012633217, "good_angle": 0.12668814890376168, "survival_time": 7.633333333333316, "traveled_tiles": 10, "valid_direction": 0.26666666666666683}, "ep002": {"nsteps": 500, "reward": 0.12847663583792746, "good_angle": 0.702441511692494, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.4666666666666628}, "ep003": {"nsteps": 500, "reward": 0.27927410635398703, "good_angle": 0.4885631264252678, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.0666666666666649}, "ep004": {"nsteps": 500, "reward": 0.15516377209778875, "good_angle": 0.7728427704054253, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.6666666666666672}}
good_angle_max0.9261906984041685
good_angle_mean0.6033452511662235
good_angle_median0.702441511692494
good_angle_min0.12668814890376168
reward_max0.2900602426051628
reward_mean-0.6032823288736912
reward_median0.15516377209778875
reward_min-3.8693864012633217
survival_time_max16.666666666666654
survival_time_mean14.859999999999989
survival_time_min7.633333333333316
traveled_tiles_max18
traveled_tiles_mean16.4
traveled_tiles_median18
traveled_tiles_min10
valid_direction_max1.9666666666666628
valid_direction_mean1.2866666666666648
valid_direction_median1.4666666666666628
valid_direction_min0.26666666666666683
No reset possible
12027step1-simulationsuccessyes0:07:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8479step1-simulationfailedno0:08:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible