Duckietown Challenges Home Challenges Submissions

Submission 1252

Submission1252
Competingyes
Challengeaido1_LF1_r3-v3
UserAnton Mashikhin 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 13941 step2-scoring: 9668 step3-videos: 9669 step4-viz: 9670
Next
User labelSAIC MOSCOW MML
Admin priority50
Blessingn/a
User priority50

9670

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

9669

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
13941step1-simulationfailedyes0:12:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9670step4-vizsuccessyes0:04:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.2237568345062462
deviation-center-line_median0.5255505066574591
in-drivable-lane_median0.7666666666666639


other stats
deviation-center-line_max1.1284977526080535
deviation-center-line_mean0.623917788943267
deviation-center-line_min0.4096956396980083
deviation-heading_max3.57311994111298
deviation-heading_mean2.254088297294393
deviation-heading_median2.585362095649338
deviation-heading_min0.9691292266181551
driven_any_max4.136167333607006
driven_any_mean1.9020135611935427
driven_any_median1.4810907703652432
driven_any_min1.0948001182085714
driven_lanedir_max3.61134816285692
driven_lanedir_mean1.5652151416562976
driven_lanedir_min0.7006939707855828
in-drivable-lane_max1.6000000000000163
in-drivable-lane_mean0.8133333333333358
in-drivable-lane_min0.33333333333333215
per-episodes
details{"ep000": {"driven_any": 1.2012008767727027, "driven_lanedir": 1.0196871948302384, "in-drivable-lane": 0.9333333333333348, "deviation-heading": 0.9691292266181551, "deviation-center-line": 0.4096956396980083}, "ep001": {"driven_any": 1.0948001182085714, "driven_lanedir": 0.7006939707855828, "in-drivable-lane": 0.4333333333333318, "deviation-heading": 2.585362095649338, "deviation-center-line": 0.5255505066574591}, "ep002": {"driven_any": 1.4810907703652432, "driven_lanedir": 1.2705895453025002, "in-drivable-lane": 0.33333333333333215, "deviation-heading": 2.688349100642005, "deviation-center-line": 0.6380697975902526}, "ep003": {"driven_any": 4.136167333607006, "driven_lanedir": 3.61134816285692, "in-drivable-lane": 1.6000000000000163, "deviation-heading": 3.57311994111298, "deviation-center-line": 1.1284977526080535}, "ep004": {"driven_any": 1.59680870701419, "driven_lanedir": 1.2237568345062462, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 1.454481122449486, "deviation-center-line": 0.4177752481625615}}
No reset possible
9669step3-videossuccessyes0:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
9668step2-scoringsuccessyes0:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.733333333333319


other stats
episodes
details{"ep000": {"nsteps": 154, "reward": -6.756369775678213, "good_angle": 0.26924966321218124, "survival_time": 5.133333333333325, "traveled_tiles": 3, "valid_direction": 0.7666666666666675}, "ep001": {"nsteps": 185, "reward": -6.319986207199258, "good_angle": 11.358373278490214, "survival_time": 6.1666666666666545, "traveled_tiles": 2, "valid_direction": 2.8333333333333233}, "ep002": {"nsteps": 223, "reward": -4.676453666757341, "good_angle": 0.9692714802305116, "survival_time": 7.433333333333317, "traveled_tiles": 4, "valid_direction": 2.1333333333333258}, "ep003": {"nsteps": 500, "reward": -0.17902887826110236, "good_angle": 0.8052548061128889, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 2.9333333333333425}, "ep004": {"nsteps": 202, "reward": -5.6194859258461705, "good_angle": 11.385585117165173, "survival_time": 6.733333333333319, "traveled_tiles": 3, "valid_direction": 2.333333333333325}}
good_angle_max11.385585117165173
good_angle_mean4.9575468690421935
good_angle_median0.9692714802305116
good_angle_min0.26924966321218124
reward_max-0.17902887826110236
reward_mean-4.710264890748418
reward_median-5.6194859258461705
reward_min-6.756369775678213
survival_time_max16.666666666666654
survival_time_mean8.426666666666653
survival_time_min5.133333333333325
traveled_tiles_max7
traveled_tiles_mean3.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max2.9333333333333425
valid_direction_mean2.1999999999999966
valid_direction_median2.333333333333325
valid_direction_min0.7666666666666675
No reset possible