Duckietown Challenges Home Challenges Submissions

Submission 1084

Submission1084
Competingyes
Challengeaido1_LF1_r3-v3
UserBenjamin Ramtoula ðŸ‡¨ðŸ‡¦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 12236 step2-scoring: 8617 step3-videos: 8618 step4-viz: 8619
Next
User labelMy ROS solution
Admin priority50
Blessingn/a
User priority50

8619

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

8618

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job ID
step
status
up to date
date started
date completed
duration
message
12236step1-simulationfailedyes0:10:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8619step4-vizsuccessyes0:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.65659990984182
deviation-center-line_median1.4082674322145912
in-drivable-lane_median1.266666666666663


other stats
deviation-center-line_max2.598287803809192
deviation-center-line_mean1.4368434833380426
deviation-center-line_min0.11832077297863462
deviation-heading_max3.2182514685999064
deviation-heading_mean1.9639829717950328
deviation-heading_median2.38208912938026
deviation-heading_min0.6107640969720017
driven_any_max5.535801207246784
driven_any_mean4.486527687716585
driven_any_median5.250326314507098
driven_any_min2.3114544895347224
driven_lanedir_max5.5110845986845955
driven_lanedir_mean4.109793163601647
driven_lanedir_min2.268460965489678
in-drivable-lane_max1.7666666666666604
in-drivable-lane_mean0.8733333333333307
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 3.991919420954133, "driven_lanedir": 3.4470457594872577, "in-drivable-lane": 1.2999999999999972, "deviation-heading": 2.38208912938026, "deviation-center-line": 0.8679192930496108}, "ep001": {"driven_any": 5.3431370063401875, "driven_lanedir": 4.665774584504881, "in-drivable-lane": 1.7666666666666604, "deviation-heading": 2.5042660980571645, "deviation-center-line": 2.1914221146381836}, "ep002": {"driven_any": 5.250326314507098, "driven_lanedir": 4.65659990984182, "in-drivable-lane": 1.266666666666663, "deviation-heading": 3.2182514685999064, "deviation-center-line": 1.4082674322145912}, "ep003": {"driven_any": 2.3114544895347224, "driven_lanedir": 2.268460965489678, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.6107640969720017, "deviation-center-line": 0.11832077297863462}, "ep004": {"driven_any": 5.535801207246784, "driven_lanedir": 5.5110845986845955, "in-drivable-lane": 0, "deviation-heading": 1.1045440659658303, "deviation-center-line": 2.598287803809192}}
No reset possible
8618step3-videossuccessyes0:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
8617step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 384, "reward": -2.8542698179462604, "good_angle": 1.1485083237515734, "survival_time": 12.799999999999963, "traveled_tiles": 7, "valid_direction": 2.499999999999994}, "ep001": {"nsteps": 500, "reward": -0.48986030906392264, "good_angle": 23.249960382087124, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 3.8666666666666543}, "ep002": {"nsteps": 500, "reward": -0.24118176720687187, "good_angle": 1.0989151172194476, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.8999999999999932}, "ep003": {"nsteps": 222, "reward": -4.579979553003271, "good_angle": 0.13607555120908302, "survival_time": 7.399999999999984, "traveled_tiles": 4, "valid_direction": 0.2666666666666657}, "ep004": {"nsteps": 500, "reward": -0.4455374931555707, "good_angle": 22.340756351027164, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.466666666666658}}
good_angle_max23.249960382087124
good_angle_mean9.594843145058878
good_angle_median1.1485083237515734
good_angle_min0.13607555120908302
reward_max-0.24118176720687187
reward_mean-1.7221657880751795
reward_median-0.48986030906392264
reward_min-4.579979553003271
survival_time_max16.666666666666654
survival_time_mean14.03999999999998
survival_time_min7.399999999999984
traveled_tiles_max11
traveled_tiles_mean8.6
traveled_tiles_median10
traveled_tiles_min4
valid_direction_max3.8666666666666543
valid_direction_mean2.199999999999993
valid_direction_median2.466666666666658
valid_direction_min0.2666666666666657
No reset possible
8616step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible