Duckietown Challenges Home Challenges Submissions

Submission 1190

Submission1190
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin Ramtoula 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 11626 step2-scoring: 9349 step3-videos: 9353 step4-viz: 9359
Next
User labelMy ROS solution
Admin priority64
Blessingn/a
User priority64

9359

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

9353

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
11626step1-simulationfailedyes0:13:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9359step4-vizsuccessyes0:04:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.984151000697771
deviation-center-line_median0.6893753521204821
in-drivable-lane_median3.200000000000024


other stats
deviation-center-line_max2.626477136716715
deviation-center-line_mean1.3433504990270713
deviation-center-line_min0.47395804848601863
deviation-heading_max2.0915769727992854
deviation-heading_mean1.6561532476546184
deviation-heading_median1.5009651979141128
deviation-heading_min1.3373728323140583
driven_any_max6.338709442005975
driven_any_mean6.241504701899715
driven_any_median6.2507791125124665
driven_any_min6.160823335985373
driven_lanedir_max6.285016317436751
driven_lanedir_mean4.3646513275512815
driven_lanedir_min2.1551422477187554
in-drivable-lane_max10.6
in-drivable-lane_mean4.833333333333338
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.190868387153463, "driven_lanedir": 2.8985258526718285, "in-drivable-lane": 8.700000000000006, "deviation-heading": 1.5009651979141128, "deviation-center-line": 0.5135610546891989}, "ep001": {"driven_any": 6.160823335985373, "driven_lanedir": 5.500421219231302, "in-drivable-lane": 1.6666666666666607, "deviation-heading": 2.0915769727992854, "deviation-center-line": 2.4133809031229423}, "ep002": {"driven_any": 6.2507791125124665, "driven_lanedir": 2.1551422477187554, "in-drivable-lane": 10.6, "deviation-heading": 1.3373728323140583, "deviation-center-line": 0.47395804848601863}, "ep003": {"driven_any": 6.266343231841298, "driven_lanedir": 4.984151000697771, "in-drivable-lane": 3.200000000000024, "deviation-heading": 1.924641661815529, "deviation-center-line": 0.6893753521204821}, "ep004": {"driven_any": 6.338709442005975, "driven_lanedir": 6.285016317436751, "in-drivable-lane": 0, "deviation-heading": 1.4262095734301063, "deviation-center-line": 2.626477136716715}}
No reset possible
9358step4-vizsuccessyes0:04:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9357step4-vizabortedyes0:00:12
Error while running [...]

Creating job9357-6031_visualization_1 ... error
stderr | ERROR: for job9357-6031_visualization_1  Cannot start service visualization: network job9357-6031_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job9357-6031_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9356step4-vizsuccessyes0:04:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9353step3-videossuccessyes0:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9352step3-videossuccessyes0:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9351step3-videossuccessyes0:02:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9350step3-videossuccessyes0:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9349step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6048743495787494, "good_angle": 0.8846231554803591, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 2.1333333333333258}, "ep001": {"nsteps": 500, "reward": -0.6484833833500743, "good_angle": 32.0327640143225, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 4.833333333333334}, "ep002": {"nsteps": 500, "reward": -0.7368488358687609, "good_angle": 0.7951790339256591, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 2.166666666666659}, "ep003": {"nsteps": 500, "reward": -0.28837004880889433, "good_angle": 0.7430058403559094, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 1.699999999999994}, "ep004": {"nsteps": 500, "reward": -0.5163634683582932, "good_angle": 23.348413220397077, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 2.9000000000000163}}
good_angle_max32.0327640143225
good_angle_mean11.560797052896302
good_angle_median0.8846231554803591
good_angle_min0.7430058403559094
reward_max-0.28837004880889433
reward_mean-0.5589880171929544
reward_median-0.6048743495787494
reward_min-0.7368488358687609
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max13
traveled_tiles_mean12.6
traveled_tiles_median13
traveled_tiles_min12
valid_direction_max4.833333333333334
valid_direction_mean2.7466666666666657
valid_direction_median2.166666666666659
valid_direction_min1.699999999999994
No reset possible
9348step2-scoringsuccessyes0:00:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9347step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible