Duckietown Challenges Home Challenges Submissions

Submission 1240

Submission1240
Competingyes
Challengeaido1_LF1_r3-v3
UserAnton Mashikhin 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 13811 step2-scoring: 9648 step3-videos: 9649 step4-viz: 9652
Next
User labelSAIC MOSCOW MML
Admin priority50
Blessingn/a
User priority50

9652

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

9649

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
13811step1-simulationfailedyes0:12:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9652step4-vizsuccessyes0:12:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median2.0738231022989133
deviation-center-line_median0.7116612408743404
in-drivable-lane_median1.399999999999995


other stats
deviation-center-line_max0.925901111475584
deviation-center-line_mean0.5945266797558918
deviation-center-line_min0.2435136923747967
deviation-heading_max3.6382145944438986
deviation-heading_mean2.5110810486834083
deviation-heading_median2.906035526925262
deviation-heading_min1.2159711938569278
driven_any_max4.263875075671843
driven_any_mean2.596787927777529
driven_any_median2.413689698065759
driven_any_min1.0845154267163306
driven_lanedir_max3.831121332492839
driven_lanedir_mean2.0357980883279714
driven_lanedir_min0.7032177206667558
in-drivable-lane_max5.033333333333352
in-drivable-lane_mean2.073333333333334
in-drivable-lane_min1.1000000000000008
per-episodes
details{"ep000": {"driven_any": 2.413689698065759, "driven_lanedir": 2.0738231022989133, "in-drivable-lane": 1.1000000000000008, "deviation-heading": 2.906035526925262, "deviation-center-line": 0.7793493935560738}, "ep001": {"driven_any": 1.0845154267163306, "driven_lanedir": 0.755643838236794, "in-drivable-lane": 1.399999999999995, "deviation-heading": 1.2159711938569278, "deviation-center-line": 0.2435136923747967}, "ep002": {"driven_any": 1.3782746870934162, "driven_lanedir": 0.7032177206667558, "in-drivable-lane": 1.6333333333333275, "deviation-heading": 1.8733527073683736, "deviation-center-line": 0.31220796049866406}, "ep003": {"driven_any": 4.263875075671843, "driven_lanedir": 3.831121332492839, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 3.6382145944438986, "deviation-center-line": 0.925901111475584}, "ep004": {"driven_any": 3.843584751340294, "driven_lanedir": 2.8151844479445547, "in-drivable-lane": 5.033333333333352, "deviation-heading": 2.9218312208225816, "deviation-center-line": 0.7116612408743404}}
No reset possible
9649step3-videossuccessyes0:06:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9648step2-scoringsuccessyes0:02:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.833333333333307


other stats
episodes
details{"ep000": {"nsteps": 295, "reward": -3.495740544256484, "good_angle": 0.8437524014731178, "survival_time": 9.833333333333307, "traveled_tiles": 5, "valid_direction": 2.066666666666663}, "ep001": {"nsteps": 141, "reward": -8.276325672230822, "good_angle": 15.996851752106846, "survival_time": 4.699999999999993, "traveled_tiles": 3, "valid_direction": 3.166666666666658}, "ep002": {"nsteps": 157, "reward": -7.045858895764642, "good_angle": 2.3884615379621152, "survival_time": 5.2333333333333245, "traveled_tiles": 5, "valid_direction": 3.866666666666659}, "ep003": {"nsteps": 455, "reward": -2.249894424716003, "good_angle": 1.0133499739127358, "survival_time": 15.166666666666623, "traveled_tiles": 8, "valid_direction": 1.566666666666661}, "ep004": {"nsteps": 500, "reward": -0.7398527064763475, "good_angle": 35.164651620368794, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 7.233333333333343}}
good_angle_max35.164651620368794
good_angle_mean11.081413457164722
good_angle_median2.3884615379621152
good_angle_min0.8437524014731178
reward_max-0.7398527064763475
reward_mean-4.36153444868886
reward_median-3.495740544256484
reward_min-8.276325672230822
survival_time_max16.666666666666654
survival_time_mean10.319999999999984
survival_time_min4.699999999999993
traveled_tiles_max8
traveled_tiles_mean5.8
traveled_tiles_median5
traveled_tiles_min3
valid_direction_max7.233333333333343
valid_direction_mean3.579999999999997
valid_direction_median3.166666666666658
valid_direction_min1.566666666666661
No reset possible