Duckietown Challenges Home Challenges Submissions

Submission 1055

Submission1055
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin Ramtoula 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 12008 step2-scoring: 12030 step3-videos: 12033 step4-viz: 12039
Next
User labelMy ROS solution - param 3
Admin priority50
Blessingn/a
User priority50

12039

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

12033

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
12039step4-vizsuccessyes0:02:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2634746752487276
deviation-center-line_median0.06451844933855998
in-drivable-lane_median15.899999999999988


other stats
deviation-center-line_max0.06638236830985772
deviation-center-line_mean0.05157412024092489
deviation-center-line_min0
deviation-heading_max0.4897682705389025
deviation-heading_mean0.33498346423531383
deviation-heading_median0.4005581346927589
deviation-heading_min0
driven_any_max10.773044004590254
driven_any_mean8.474333192313349
driven_any_median10.593728029816356
driven_any_min0.1741629683159263
driven_lanedir_max0.29487511516313636
driven_lanedir_mean0.2184942742842754
driven_lanedir_min0
in-drivable-lane_max15.966666666666654
in-drivable-lane_mean12.813333333333324
in-drivable-lane_min0.4
per-episodes
details{"ep000": {"driven_any": 0.1741629683159263, "driven_lanedir": 0, "in-drivable-lane": 0.4, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 10.593728029816356, "driven_lanedir": 0.2785721528210736, "in-drivable-lane": 15.93333333333332, "deviation-heading": 0.4005581346927589, "deviation-center-line": 0.06451844933855998}, "ep002": {"driven_any": 10.773044004590254, "driven_lanedir": 0.2634746752487276, "in-drivable-lane": 15.966666666666654, "deviation-heading": 0.3629059808615146, "deviation-center-line": 0.06638236830985772}, "ep003": {"driven_any": 10.187922160080117, "driven_lanedir": 0.29487511516313636, "in-drivable-lane": 15.899999999999988, "deviation-heading": 0.4216849350833933, "deviation-center-line": 0.06155591678524533}, "ep004": {"driven_any": 10.642808798764095, "driven_lanedir": 0.2555494281884394, "in-drivable-lane": 15.866666666666656, "deviation-heading": 0.4897682705389025, "deviation-center-line": 0.06541386677096145}}
No reset possible
12033step3-videossuccessyes0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
12030step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 13, "reward": -78.75473564404707, "good_angle": 0.35487396678461625, "survival_time": 0.4333333333333333, "traveled_tiles": 1, "valid_direction": 0.4}, "ep001": {"nsteps": 500, "reward": -0.55235150109604, "good_angle": 1.0825997787881945, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.499999999999994}, "ep002": {"nsteps": 500, "reward": -0.5732073592171073, "good_angle": 1.184958682921207, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.0999999999999988}, "ep003": {"nsteps": 500, "reward": -0.5927707118186517, "good_angle": 1.4664564801600937, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.166666666666661}, "ep004": {"nsteps": 500, "reward": -0.5373357467278839, "good_angle": 1.1443883462408793, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.4666666666666797}}
good_angle_max1.4664564801600937
good_angle_mean1.0466554509789985
good_angle_median1.1443883462408793
good_angle_min0.35487396678461625
reward_max-0.5373357467278839
reward_mean-16.202080192581352
reward_median-0.5732073592171073
reward_min-78.75473564404707
survival_time_max16.666666666666654
survival_time_mean13.419999999999993
survival_time_min0.4333333333333333
traveled_tiles_max18
traveled_tiles_mean14.6
traveled_tiles_median18
traveled_tiles_min1
valid_direction_max3.166666666666661
valid_direction_mean2.3266666666666667
valid_direction_median2.499999999999994
valid_direction_min0.4
No reset possible
12008step1-simulationsuccessyes0:09:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8460step4-vizsuccessyes0:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8459step4-vizsuccessyes0:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8458step4-vizsuccessyes0:03:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8457step4-vizsuccessyes0:03:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8456step3-videossuccessyes0:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8455step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8454step2-scoringsuccessyes0:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8453step1-simulationsuccessno0:08:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8452step1-simulationfailedno0:07:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8451step1-simulationsuccessno0:08:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8450step1-simulationabortedno0:00:13
Error while running [...]

Creating job8450-4145_solution_1  ... error
stderr | ERROR: for job8450-4145_solution_1  Cannot start service solution: network job8450-4145_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8450-4145_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8450-4145_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8449step1-simulationfailedno0:11:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8448step1-simulationabortedno0:00:15
Error while running [...]

Creating job8448-1925_solution_1  ... error
stderr | ERROR: for job8448-1925_solution_1  Cannot start service solution: network job8448-1925_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8448-1925_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8448-1925_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8447step1-simulationabortedno0:00:16
Error while running [...]

Creating job8447-2184_solution_1  ... error
stderr | ERROR: for job8447-2184_solution_1  Cannot start service solution: network job8447-2184_evaluation not found
stderr | 
stderr | ERROR: for evaluator  Cannot start service evaluator: network job8447-2184_evaluation not found
stderr | 
stderr | ERROR: for solution  Cannot start service solution: network job8447-2184_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8446step1-simulationfailedno0:11:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible