Duckietown Challenges Home Challenges Submissions

Submission 1241

Submission1241
Competingyes
Challengeaido1_LF1_r3-v3
UserGunshi Gupta 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 13827 step2-scoring: 13836 step3-videos: 13839 step4-viz: 13846
Next
User labelROS-based Lane Following
Admin priority50
Blessingn/a
User priority50

13846

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

13839

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
13846step4-vizsuccessyes0:03:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.0112446686487098
deviation-center-line_median0.5833575250537845
in-drivable-lane_median3.099999999999995


other stats
deviation-center-line_max0.9939573406673812
deviation-center-line_mean0.6441400763869072
deviation-center-line_min0.39639642613395376
deviation-heading_max7.762271591345482
deviation-heading_mean4.97012624849542
deviation-heading_median4.678510639850773
deviation-heading_min3.216738739883372
driven_any_max5.327394609415363
driven_any_mean3.342444431330879
driven_any_median2.994453145484006
driven_any_min2.086265898870574
driven_lanedir_max2.386158297414386
driven_lanedir_mean1.470119970946197
driven_lanedir_min0.8153610055228977
in-drivable-lane_max5.7333333333333245
in-drivable-lane_mean3.626666666666659
in-drivable-lane_min2.499999999999994
per-episodes
details{"ep000": {"driven_any": 2.387264909048229, "driven_lanedir": 1.00016952983618, "in-drivable-lane": 2.8999999999999937, "deviation-heading": 3.237413419670277, "deviation-center-line": 0.5833575250537845}, "ep001": {"driven_any": 5.327394609415363, "driven_lanedir": 2.386158297414386, "in-drivable-lane": 5.7333333333333245, "deviation-heading": 7.762271591345482, "deviation-center-line": 0.9939573406673812}, "ep002": {"driven_any": 2.994453145484006, "driven_lanedir": 1.0112446686487098, "in-drivable-lane": 3.899999999999988, "deviation-heading": 4.678510639850773, "deviation-center-line": 0.43452943926472265}, "ep003": {"driven_any": 3.9168435938362234, "driven_lanedir": 2.1376663533088105, "in-drivable-lane": 3.099999999999995, "deviation-heading": 5.9556968517272, "deviation-center-line": 0.812459650814694}, "ep004": {"driven_any": 2.086265898870574, "driven_lanedir": 0.8153610055228977, "in-drivable-lane": 2.499999999999994, "deviation-heading": 3.216738739883372, "deviation-center-line": 0.39639642613395376}}
No reset possible
13839step3-videossuccessyes0:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
13836step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.399999999999975


other stats
episodes
details{"ep000": {"nsteps": 225, "reward": -4.428948095630234, "good_angle": 4.2441681267979385, "survival_time": 7.499999999999983, "traveled_tiles": 2, "valid_direction": 4.966666666666655}, "ep001": {"nsteps": 500, "reward": -0.24782140393275767, "good_angle": 19.414167315763688, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 12.699999999999992}, "ep002": {"nsteps": 282, "reward": -3.9718595706867648, "good_angle": 8.665436931177032, "survival_time": 9.399999999999975, "traveled_tiles": 1, "valid_direction": 7.566666666666648}, "ep003": {"nsteps": 368, "reward": -2.7402932159488755, "good_angle": 7.670446940158128, "survival_time": 12.266666666666634, "traveled_tiles": 4, "valid_direction": 8.633333333333308}, "ep004": {"nsteps": 197, "reward": -5.29206687771493, "good_angle": 5.439425599720129, "survival_time": 6.566666666666653, "traveled_tiles": 2, "valid_direction": 4.99999999999999}}
good_angle_max19.414167315763688
good_angle_mean9.086728982723384
good_angle_median7.670446940158128
good_angle_min4.2441681267979385
reward_max-0.24782140393275767
reward_mean-3.3361978327827124
reward_median-3.9718595706867648
reward_min-5.29206687771493
survival_time_max16.666666666666654
survival_time_mean10.47999999999998
survival_time_min6.566666666666653
traveled_tiles_max4
traveled_tiles_mean2.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max12.699999999999992
valid_direction_mean7.773333333333319
valid_direction_median7.566666666666648
valid_direction_min4.966666666666655
No reset possible
13827step1-simulationsuccessyes0:06:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
9645step1-simulationerrorno0:12:04
Timeout: Waited 600 [...]
Timeout:

Waited 600.856384993 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9644step1-simulationfailedno0:11:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 95, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible