Duckietown Challenges Home Challenges Submissions

Submission 18899

Submission18899
Competingyes
Challengemooc-BV1
UserYan Long Huang
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobssim-0of5: 137011 sim-1of5: 137017 sim-2of5: 137015 sim-3of5: 137016 sim-4of5: 137012
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

137017

Click the images to see detailed statistics about the episode.

d45

137016

Click the images to see detailed statistics about the episode.

d50

137015

Click the images to see detailed statistics about the episode.

d40

137011

Click the images to see detailed statistics about the episode.

d30

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
137017sim-1of5successyes0:03:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.3295108320058933


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.3295108320058933
distance-from-start_median1.3295108320058933
distance-from-start_min1.3295108320058933
driven_any_max1.4473247784662635
driven_any_mean1.4473247784662635
driven_any_median1.4473247784662635
driven_any_min1.4473247784662635
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max4.99999999999999
in-drivable-lane_mean4.99999999999999
in-drivable-lane_median4.99999999999999
in-drivable-lane_min4.99999999999999
per-episodes
details{"d45-ego0": {"driven_any": 1.4473247784662635, "survival_time": 4.99999999999999, "driven_lanedir": 0.0, "in-drivable-lane": 4.99999999999999, "deviation-heading": 0.0, "distance-from-start": 1.3295108320058933, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean4.99999999999999
survival_time_median4.99999999999999
survival_time_min4.99999999999999
No reset possible
137016sim-3of5successyes0:03:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.4715568436099555


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.4715568436099555
distance-from-start_median1.4715568436099555
distance-from-start_min1.4715568436099555
driven_any_max1.883457746980881
driven_any_mean1.883457746980881
driven_any_median1.883457746980881
driven_any_min1.883457746980881
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max6.149999999999986
in-drivable-lane_mean6.149999999999986
in-drivable-lane_median6.149999999999986
in-drivable-lane_min6.149999999999986
per-episodes
details{"d50-ego0": {"driven_any": 1.883457746980881, "survival_time": 6.149999999999986, "driven_lanedir": 0.0, "in-drivable-lane": 6.149999999999986, "deviation-heading": 0.0, "distance-from-start": 1.4715568436099555, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max6.149999999999986
survival_time_mean6.149999999999986
survival_time_median6.149999999999986
survival_time_min6.149999999999986
No reset possible
137015sim-2of5successyes0:03:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.4098589313409895


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.4098589313409895
distance-from-start_median1.4098589313409895
distance-from-start_min1.4098589313409895
driven_any_max2.1509122642479555
driven_any_mean2.1509122642479555
driven_any_median2.1509122642479555
driven_any_min2.1509122642479555
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max6.749999999999984
in-drivable-lane_mean6.749999999999984
in-drivable-lane_median6.749999999999984
in-drivable-lane_min6.749999999999984
per-episodes
details{"d40-ego0": {"driven_any": 2.1509122642479555, "survival_time": 6.749999999999984, "driven_lanedir": 0.0, "in-drivable-lane": 6.749999999999984, "deviation-heading": 0.0, "distance-from-start": 1.4098589313409895, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max6.749999999999984
survival_time_mean6.749999999999984
survival_time_median6.749999999999984
survival_time_min6.749999999999984
No reset possible
137014sim-1of5successyes0:03:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137013sim-3of5successyes0:03:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137012sim-4of5failedyes0:04:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 720, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 370, in read_until_over
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout while reading output of node "ego0" after 120 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137011sim-0of5successyes0:08:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1342592819729487


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1342592819729487
distance-from-start_median2.1342592819729487
distance-from-start_min2.1342592819729487
driven_any_max25.642073538582142
driven_any_mean25.642073538582142
driven_any_median25.642073538582142
driven_any_min25.642073538582142
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d30-ego0": {"driven_any": 25.642073538582142, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "distance-from-start": 2.1342592819729487, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
137008sim-0of5successyes0:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137007sim-4of5successyes0:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137006sim-1of5successyes0:04:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137005sim-3of5successyes0:03:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible