Duckietown Challenges Home Challenges Submissions

Submission 1257

Submission1257
Competingyes
Challengeaido1_LF1_r3-v3
UserGunshi Gupta 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 13998 step2-scoring: 10694 step3-videos: 10703 step4-viz: 10709
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

10709

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

10703

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
13998step1-simulationfailedyes0:08:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10709step4-vizsuccessyes0:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.2356650415079482
deviation-center-line_median0.20569792305699303
in-drivable-lane_median0


other stats
deviation-center-line_max0.3551265148863043
deviation-center-line_mean0.22830166914529915
deviation-center-line_min0.12065556310666244
deviation-heading_max1.7882773359193134
deviation-heading_mean0.7973169304292684
deviation-heading_median0.6002929184760882
deviation-heading_min0.2616245360905588
driven_any_max0.7714687660752666
driven_any_mean0.3442971468945156
driven_any_median0.249999610950642
driven_any_min0.14999921684897569
driven_lanedir_max0.5258842342296386
driven_lanedir_mean0.2823152534359754
driven_lanedir_min0.1280388999674369
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.7714687660752666, "driven_lanedir": 0.5258842342296386, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7882773359193134, "deviation-center-line": 0.32511113324718505}, "ep001": {"driven_any": 0.33573641552815336, "driven_lanedir": 0.33438634293376346, "in-drivable-lane": 0, "deviation-heading": 0.2616245360905588, "deviation-center-line": 0.3551265148863043}, "ep002": {"driven_any": 0.14999921684897569, "driven_lanedir": 0.1280388999674369, "in-drivable-lane": 0, "deviation-heading": 0.6002929184760882, "deviation-center-line": 0.12065556310666244}, "ep003": {"driven_any": 0.2142817250695406, "driven_lanedir": 0.1876017485410899, "in-drivable-lane": 0, "deviation-heading": 0.7731848239778019, "deviation-center-line": 0.13491721142935093}, "ep004": {"driven_any": 0.249999610950642, "driven_lanedir": 0.2356650415079482, "in-drivable-lane": 0, "deviation-heading": 0.5632050376825797, "deviation-center-line": 0.20569792305699303}}
No reset possible
10708step4-vizsuccessyes0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10703step3-videossuccessyes0:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10702step3-videossuccessyes0:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10694step2-scoringsuccessyes0:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4000000000000012


other stats
episodes
details{"ep000": {"nsteps": 218, "reward": -4.733045888046837, "good_angle": 0.8730727947660979, "survival_time": 7.266666666666651, "traveled_tiles": 2, "valid_direction": 0.8333333333333304}, "ep001": {"nsteps": 96, "reward": -11.001215070486069, "good_angle": 0.02613195916675251, "survival_time": 3.1999999999999984, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 44, "reward": -23.19450922649015, "good_angle": 0.4947327293520531, "survival_time": 1.466666666666668, "traveled_tiles": 2, "valid_direction": 0.666666666666668}, "ep003": {"nsteps": 62, "reward": -16.48422414929636, "good_angle": 0.6180961657508399, "survival_time": 2.066666666666669, "traveled_tiles": 1, "valid_direction": 0.7000000000000011}, "ep004": {"nsteps": 72, "reward": -14.341735198679896, "good_angle": 0.33473161191708783, "survival_time": 2.4000000000000012, "traveled_tiles": 1, "valid_direction": 0.6666666666666659}}
good_angle_max0.8730727947660979
good_angle_mean0.46935305219056617
good_angle_median0.4947327293520531
good_angle_min0.02613195916675251
reward_max-4.733045888046837
reward_mean-13.95094590659986
reward_median-14.341735198679896
reward_min-23.19450922649015
survival_time_max7.266666666666651
survival_time_mean3.2799999999999976
survival_time_min1.466666666666668
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max0.8333333333333304
valid_direction_mean0.573333333333333
valid_direction_median0.666666666666668
valid_direction_min0
No reset possible
9682step2-scoringabortedyes0:00:56
Error while running [...]

Creating job9682-5397_scorer_1 ... error
stderr | ERROR: for job9682-5397_scorer_1  Cannot start service scorer: network job9682-5397_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9682-5397_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9681step2-scoringsuccessyes0:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible