Duckietown Challenges Home Challenges Submissions

Submission 518

Submission518
Competingyes
Challengeaido1_LFV_r1-v3
UserDzenan Lapandic
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 11606 step2-scoring: 11624 step3-videos: 11625 step4-viz: 15499
Next
User labelBaseline solution using imitation learning from logs
Admin priority52
Blessingn/a
User priority52

15499

Click the images to see detailed statistics about the episode.

ep000

ep001

ep002

ep003

ep004

11625

ep000

ep001

ep002

ep003

ep004

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
15499step4-vizsuccessyes0:04:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.02621153847426453
deviation-center-line_median0.16033613800490878
in-drivable-lane_median0.13333333333333286


other stats
deviation-center-line_max0.9829273883213132
deviation-center-line_mean0.30801297366425195
deviation-center-line_min0
deviation-heading_max0.8779353992831164
deviation-heading_mean0.3874760701091404
deviation-heading_median0.3636271805573336
deviation-heading_min0
driven_any_max0.10909101550740911
driven_any_mean0.05800046347436878
driven_any_median0.04309265015263266
driven_any_min0.027563516349072108
driven_lanedir_consec_max0.10844301446137523
driven_lanedir_consec_mean0.040123732444708224
driven_lanedir_consec_min0
driven_lanedir_max0.10844301446137523
driven_lanedir_mean0.040123732444708224
driven_lanedir_median0.02621153847426453
driven_lanedir_min0
in-drivable-lane_max7.0999999999999845
in-drivable-lane_mean1.499999999999997
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.08230366817586769, "driven_lanedir": 0, "in-drivable-lane": 7.0999999999999845, "deviation-heading": 0, "deviation-center-line": 0, "driven_lanedir_consec": 0}, "ep001": {"driven_any": 0.027563516349072108, "driven_lanedir": 0.02528593550874639, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 0.3636271805573336, "deviation-center-line": 0.12714911004642246, "driven_lanedir_consec": 0.02528593550874639}, "ep002": {"driven_any": 0.10909101550740911, "driven_lanedir": 0.10844301446137523, "in-drivable-lane": 0, "deviation-heading": 0.8779353992831164, "deviation-center-line": 0.9829273883213132, "driven_lanedir_consec": 0.10844301446137523}, "ep003": {"driven_any": 0.04309265015263266, "driven_lanedir": 0.04067817377915496, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 0.45152042652226776, "deviation-center-line": 0.16033613800490878, "driven_lanedir_consec": 0.04067817377915496}, "ep004": {"driven_any": 0.027951467186862304, "driven_lanedir": 0.02621153847426453, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 0.2442973441829844, "deviation-center-line": 0.2696522319486154, "driven_lanedir_consec": 0.02621153847426453}}
No reset possible
11630step4-vizsuccessno0:02:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11625step3-videossuccessyes0:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
11624step2-scoringsuccessyes0:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.766666666666663


other stats
episodes
details{"ep000": {"nsteps": 214, "reward": -6.040047664647904, "good_angle": 14.621731347422983, "survival_time": 7.133333333333318, "traveled_tiles": 5, "valid_direction": 1.5999999999999943}, "ep001": {"nsteps": 73, "reward": -13.157494480645106, "good_angle": 0.9313798764141958, "survival_time": 2.4333333333333345, "traveled_tiles": 3, "valid_direction": 0.5333333333333319}, "ep002": {"nsteps": 283, "reward": -3.1960517289939703, "good_angle": 0.05823799387586157, "survival_time": 9.43333333333331, "traveled_tiles": 6, "valid_direction": 0}, "ep003": {"nsteps": 113, "reward": -8.175614983865382, "good_angle": 0.9475750114031812, "survival_time": 3.766666666666663, "traveled_tiles": 4, "valid_direction": 0.5666666666666647}, "ep004": {"nsteps": 74, "reward": -13.27360754787947, "good_angle": 0.7034046860967857, "survival_time": 2.4666666666666677, "traveled_tiles": 3, "valid_direction": 0.36666666666666536}}
good_angle_max14.621731347422983
good_angle_mean3.4524657830426024
good_angle_median0.9313798764141958
good_angle_min0.05823799387586157
reward_max-3.1960517289939703
reward_mean-8.768563281206367
reward_median-8.175614983865382
reward_min-13.27360754787947
survival_time_max9.43333333333331
survival_time_mean5.046666666666659
survival_time_min2.4333333333333345
traveled_tiles_max6
traveled_tiles_mean4.2
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max1.5999999999999943
valid_direction_mean0.6133333333333313
valid_direction_median0.5333333333333319
valid_direction_min0
No reset possible
11606step1-simulationsuccessyes0:04:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
10113step4-vizsuccessno0:03:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10107step3-videossuccessyes0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10104step2-scoringsuccessyes0:00:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10087step1-simulationsuccessno0:02:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4477step1-simulationfailedno0:02:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 120, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible