Duckietown Challenges Home Challenges Submissions

Submission 27788

Submission27788
Competingyes
Challengelx22-modcon
Useruser8655
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim: 191204
Next
User labellx22-modcon
Admin priority50
Blessingn/a
User priority50

191204

Click the images to see detailed statistics about the episode.

LF-full-loop-000

LF-full-loop-001

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
191204simsuccessyes0:13:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median28.649999999999707
deviation-center-line_median0.9145457285335632
driven_lanedir_consec_median0.9003231632659237
survival_time_median38.97499999999961


other stats
deviation-center-line_max1.4335979011194109
deviation-center-line_mean0.9145457285335632
deviation-center-line_min0.395493555947716
deviation-heading_max12.920120410291936
deviation-heading_mean8.42030003692502
deviation-heading_median8.42030003692502
deviation-heading_min3.9204796635581056
distance-from-start_max1.8583129243928256
distance-from-start_mean1.567361982409034
distance-from-start_median1.567361982409034
distance-from-start_min1.276411040425243
driven_any_max7.520105162351808
driven_any_mean5.294622633356203
driven_any_median5.294622633356203
driven_any_min3.0691401043605975
driven_lanedir_consec_max1.4867584471779385
driven_lanedir_consec_mean0.9003231632659237
driven_lanedir_consec_min0.3138878793539088
driven_lanedir_max1.4910480231028884
driven_lanedir_mean0.9024679512283986
driven_lanedir_median0.9024679512283986
driven_lanedir_min0.3138878793539088
in-drivable-lane_max38.24999999999924
in-drivable-lane_mean28.649999999999707
in-drivable-lane_min19.050000000000175
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.0691401043605975, "survival_time": 23.100000000000193, "driven_lanedir": 0.3138878793539088, "in-drivable-lane": 19.050000000000175, "deviation-heading": 3.9204796635581056, "distance-from-start": 1.8583129243928256, "deviation-center-line": 0.395493555947716, "driven_lanedir_consec": 0.3138878793539088}, "LF-full-loop-001-ego0": {"driven_any": 7.520105162351808, "survival_time": 54.84999999999902, "driven_lanedir": 1.4910480231028884, "in-drivable-lane": 38.24999999999924, "deviation-heading": 12.920120410291936, "distance-from-start": 1.276411040425243, "deviation-center-line": 1.4335979011194109, "driven_lanedir_consec": 1.4867584471779385}}
simulation-passed1
survival_time_max54.84999999999902
survival_time_mean38.97499999999961
survival_time_min23.100000000000193
No reset possible
191203simfailedyes0:04:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible