Duckietown Challenges Home Challenges Submissions

Submission 557

Submission557
Competingyes
Challengeaido1_LF1_r3-v3
UserDzenan Lapandic
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobsstep1-simulation: 12117 step2-scoring: 10731 step3-videos: 10736 step4-viz: 10742
Next
User labelBaseline solution using imitation learning from logs
Admin priority50
Blessingn/a
User priority50

10742

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

10736

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
12117step1-simulationfailedyes0:05:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 120, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10742step4-vizsuccessyes0:07:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.697447157376711
deviation-center-line_median0.8333370531576382
in-drivable-lane_median1.2333333333333645


other stats
deviation-center-line_max0.8954064824764659
deviation-center-line_mean0.7696312303797095
deviation-center-line_min0.58835431142482
deviation-heading_max3.4315409257591747
deviation-heading_mean2.428374665292112
deviation-heading_median2.8280385066204383
deviation-heading_min0.8791768257264414
driven_any_max1.9333780766102693
driven_any_mean1.9333746117866073
driven_any_median1.9333757141071009
driven_any_min1.9333701519557005
driven_lanedir_max1.9200788676514409
driven_lanedir_mean1.5049861526237842
driven_lanedir_min0.8062156565309881
in-drivable-lane_max8.800000000000006
in-drivable-lane_mean3.1066666666666785
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.9333762991920855, "driven_lanedir": 1.7552625607851289, "in-drivable-lane": 1.100000000000001, "deviation-heading": 2.1480048187776437, "deviation-center-line": 0.8920941577548562}, "ep001": {"driven_any": 1.9333701519557005, "driven_lanedir": 0.8062156565309881, "in-drivable-lane": 8.800000000000006, "deviation-heading": 2.8280385066204383, "deviation-center-line": 0.6389641470847671}, "ep002": {"driven_any": 1.9333728170678803, "driven_lanedir": 1.697447157376711, "in-drivable-lane": 1.2333333333333645, "deviation-heading": 3.4315409257591747, "deviation-center-line": 0.8954064824764659}, "ep003": {"driven_any": 1.9333780766102693, "driven_lanedir": 1.9200788676514409, "in-drivable-lane": 0, "deviation-heading": 0.8791768257264414, "deviation-center-line": 0.8333370531576382}, "ep004": {"driven_any": 1.9333757141071009, "driven_lanedir": 1.345926520774653, "in-drivable-lane": 4.40000000000002, "deviation-heading": 2.855112249576862, "deviation-center-line": 0.58835431142482}}
No reset possible
10741step4-vizsuccessyes0:06:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10736step3-videossuccessyes0:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
10735step3-videossuccessyes0:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10731step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.1977541041908553, "good_angle": 0.36298213052672623, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0.9666666666666676}, "ep001": {"nsteps": 500, "reward": -1.339590645131888, "good_angle": 34.7735258835203, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 8.700000000000006}, "ep002": {"nsteps": 500, "reward": -0.29502056005381744, "good_angle": 2.2339003307145195, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 2.8999999999999897}, "ep003": {"nsteps": 500, "reward": -0.2434058041125536, "good_angle": 0.01939698164440947, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -0.4378754947655834, "good_angle": 16.878384306223346, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 4.066666666666652}}
good_angle_max34.7735258835203
good_angle_mean10.85363792652586
good_angle_median2.2339003307145195
good_angle_min0.01939698164440947
reward_max-0.1977541041908553
reward_mean-0.5027293216509395
reward_median-0.29502056005381744
reward_min-1.339590645131888
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max5
traveled_tiles_mean4.4
traveled_tiles_median4
traveled_tiles_min4
valid_direction_max8.700000000000006
valid_direction_mean3.326666666666663
valid_direction_median2.8999999999999897
valid_direction_min0
No reset possible
10730step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10729step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10728step2-scoringsuccessyes0:00:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10727step2-scoringsuccessyes0:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible