Duckietown Challenges Home Challenges Submissions

Submission 27684

Submission27684
Competinguser retired
Challengelx22-modcon
Useruser8126
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim: 190876
Next
User labellx22-modcon
Admin priority50
Blessingn/a
User priority50

190876

Click the images to see detailed statistics about the episode.

LF-full-loop-000

LF-full-loop-001

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
190876simsuccessyes0:17:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median11.399999999999997
deviation-center-line_median3.3852898168377132
driven_lanedir_consec_median5.22125300987874
survival_time_median52.34999999999916


other stats
deviation-center-line_max3.927362591671468
deviation-center-line_mean3.3852898168377132
deviation-center-line_min2.843217042003958
deviation-heading_max13.828431804746923
deviation-heading_mean12.291164673074803
deviation-heading_median12.291164673074803
deviation-heading_min10.75389754140268
distance-from-start_max7.93719419693308
distance-from-start_mean6.578952678538357
distance-from-start_median6.578952678538357
distance-from-start_min5.220711160143634
driven_any_max8.331185859158325
driven_any_mean7.216547337205966
driven_any_median7.216547337205966
driven_any_min6.101908815253607
driven_lanedir_consec_max7.120611288909363
driven_lanedir_consec_mean5.22125300987874
driven_lanedir_consec_min3.3218947308481166
driven_lanedir_max7.120611288909363
driven_lanedir_mean5.22125300987874
driven_lanedir_median5.22125300987874
driven_lanedir_min3.3218947308481166
in-drivable-lane_max16.149999999999945
in-drivable-lane_mean11.399999999999997
in-drivable-lane_min6.650000000000045
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.331185859158325, "survival_time": 59.99999999999873, "driven_lanedir": 7.120611288909363, "in-drivable-lane": 6.650000000000045, "deviation-heading": 10.75389754140268, "distance-from-start": 7.93719419693308, "deviation-center-line": 3.927362591671468, "driven_lanedir_consec": 7.120611288909363}, "LF-full-loop-001-ego0": {"driven_any": 6.101908815253607, "survival_time": 44.6999999999996, "driven_lanedir": 3.3218947308481166, "in-drivable-lane": 16.149999999999945, "deviation-heading": 13.828431804746923, "distance-from-start": 5.220711160143634, "deviation-center-line": 2.843217042003958, "driven_lanedir_consec": 3.3218947308481166}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean52.34999999999916
survival_time_min44.6999999999996
No reset possible
190875simfailedyes0:03:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible