Duckietown Challenges Home Challenges Submissions

Submission 1141

Submission1141
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin Ramtoula 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11666 step2-scoring: 11670 step3-videos: 11671 step4-viz: 11672
Next
User labelMy ROS solution
Admin priority71
Blessingn/a
User priority71

11672

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

11671

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
11672step4-vizsuccessyes0:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median7.1079948868631835
deviation-center-line_median0.6780000356923697
in-drivable-lane_median2.6333333333333253


other stats
deviation-center-line_max0.9176117040617467
deviation-center-line_mean0.5684658815315539
deviation-center-line_min0.0062578227279053555
deviation-heading_max2.4400762165433467
deviation-heading_mean1.492248372892265
deviation-heading_median1.5131089957711696
deviation-heading_min0.13473706936197322
driven_any_max12.794905418845843
driven_any_mean8.499723503300086
driven_any_median10.32614406718679
driven_any_min1.0636461670867805
driven_lanedir_max8.543814082240008
driven_lanedir_mean5.560074327057659
driven_lanedir_min0.015310975229611223
in-drivable-lane_max3.699999999999992
in-drivable-lane_mean2.2799999999999945
in-drivable-lane_min0.8333333333333333
per-episodes
details{"ep000": {"driven_any": 1.0636461670867805, "driven_lanedir": 0.015310975229611223, "in-drivable-lane": 0.8333333333333333, "deviation-heading": 0.13473706936197322, "deviation-center-line": 0.0062578227279053555}, "ep001": {"driven_any": 10.32614406718679, "driven_lanedir": 7.1079948868631835, "in-drivable-lane": 2.6333333333333253, "deviation-heading": 1.5131089957711696, "deviation-center-line": 0.6780000356923697}, "ep002": {"driven_any": 12.117951326362991, "driven_lanedir": 8.543814082240008, "in-drivable-lane": 2.799999999999992, "deviation-heading": 2.0004023683247403, "deviation-center-line": 0.9176117040617467}, "ep003": {"driven_any": 6.1959705370180265, "driven_lanedir": 4.207543977006413, "in-drivable-lane": 1.4333333333333296, "deviation-heading": 1.3729172144600954, "deviation-center-line": 0.40350628882627687}, "ep004": {"driven_any": 12.794905418845843, "driven_lanedir": 7.925707713949081, "in-drivable-lane": 3.699999999999992, "deviation-heading": 2.4400762165433467, "deviation-center-line": 0.8369535563494706}}
No reset possible
11671step3-videossuccessyes0:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11670step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.199999999999978


other stats
episodes
details{"ep000": {"nsteps": 29, "reward": -35.37664484104206, "good_angle": 0.5114915912986825, "survival_time": 0.9666666666666666, "traveled_tiles": 2, "valid_direction": 0.3999999999999999}, "ep001": {"nsteps": 276, "reward": -3.240260654304765, "good_angle": 0.9167618003399668, "survival_time": 9.199999999999978, "traveled_tiles": 18, "valid_direction": 2.433333333333328}, "ep002": {"nsteps": 325, "reward": -2.68029732119817, "good_angle": 0.9574565005822604, "survival_time": 10.833333333333306, "traveled_tiles": 18, "valid_direction": 2.4666666666666597}, "ep003": {"nsteps": 169, "reward": -5.6148724648798405, "good_angle": 1.4578398075667751, "survival_time": 5.633333333333323, "traveled_tiles": 10, "valid_direction": 1.999999999999996}, "ep004": {"nsteps": 344, "reward": -2.6680862060693893, "good_angle": 2.288685589904092, "survival_time": 11.466666666666637, "traveled_tiles": 18, "valid_direction": 3.4666666666666597}}
good_angle_max2.288685589904092
good_angle_mean1.2264470579383553
good_angle_median0.9574565005822604
good_angle_min0.5114915912986825
reward_max-2.6680862060693893
reward_mean-9.916032297498845
reward_median-3.240260654304765
reward_min-35.37664484104206
survival_time_max11.466666666666637
survival_time_mean7.619999999999981
survival_time_min0.9666666666666666
traveled_tiles_max18
traveled_tiles_mean13.2
traveled_tiles_median18
traveled_tiles_min2
valid_direction_max3.4666666666666597
valid_direction_mean2.153333333333329
valid_direction_median2.433333333333328
valid_direction_min0.3999999999999999
No reset possible
11666step1-simulationsuccessyes0:07:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
8983step4-vizsuccessyes0:03:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8982step4-vizsuccessyes0:03:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8981step4-vizsuccessyes0:03:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8980step4-vizsuccessyes0:10:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8972step3-videossuccessyes0:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8971step3-videosabortedyes0:00:14
Error while running [...]

Creating job8971-4054_videos_1 ... error
stderr | ERROR: for job8971-4054_videos_1  Cannot start service videos: network job8971-4054_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job8971-4054_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8970step3-videossuccessyes0:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8969step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8967step1-simulationsuccessno0:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8966step1-simulationfailedno0:05:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8965step1-simulationfailedno0:05:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8964step1-simulationfailedno0:05:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8963step1-simulationfailedno0:05:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible