Duckietown Challenges Home Challenges Submissions

Submission 18903

Submission18903
Competingyes
Challengemooc-BV1
UserYan Long Huang
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobssim-0of5: 137065 sim-1of5: 137067 sim-2of5: 137068 sim-3of5: 137066 sim-4of5: 137072
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

137072

Click the images to see detailed statistics about the episode.

d60

137068

Click the images to see detailed statistics about the episode.

d40

137066

Click the images to see detailed statistics about the episode.

d50

137065

Click the images to see detailed statistics about the episode.

d30

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
137072sim-4of5successyes0:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.8291698909082328


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.8291698909082328
distance-from-start_median1.8291698909082328
distance-from-start_min1.8291698909082328
driven_any_max2.111155571095976
driven_any_mean2.111155571095976
driven_any_median2.111155571095976
driven_any_min2.111155571095976
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max6.549999999999985
in-drivable-lane_mean6.549999999999985
in-drivable-lane_median6.549999999999985
in-drivable-lane_min6.549999999999985
per-episodes
details{"d60-ego0": {"driven_any": 2.111155571095976, "survival_time": 6.549999999999985, "driven_lanedir": 0.0, "in-drivable-lane": 6.549999999999985, "deviation-heading": 0.0, "distance-from-start": 1.8291698909082328, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max6.549999999999985
survival_time_mean6.549999999999985
survival_time_median6.549999999999985
survival_time_min6.549999999999985
No reset possible
137068sim-2of5successyes0:03:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.2865889952324945


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.2865889952324945
distance-from-start_median1.2865889952324945
distance-from-start_min1.2865889952324945
driven_any_max1.565242006401922
driven_any_mean1.565242006401922
driven_any_median1.565242006401922
driven_any_min1.565242006401922
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max5.14999999999999
in-drivable-lane_mean5.14999999999999
in-drivable-lane_median5.14999999999999
in-drivable-lane_min5.14999999999999
per-episodes
details{"d40-ego0": {"driven_any": 1.565242006401922, "survival_time": 5.14999999999999, "driven_lanedir": 0.0, "in-drivable-lane": 5.14999999999999, "deviation-heading": 0.0, "distance-from-start": 1.2865889952324945, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean5.14999999999999
survival_time_median5.14999999999999
survival_time_min5.14999999999999
No reset possible
137067sim-1of5failedyes0:04:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 720, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 370, in read_until_over
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout while reading output of node "ego0" after 120 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137066sim-3of5successyes0:03:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.5266059045881777


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.5266059045881777
distance-from-start_median1.5266059045881777
distance-from-start_min1.5266059045881777
driven_any_max2.0525935570559524
driven_any_mean2.0525935570559524
driven_any_median2.0525935570559524
driven_any_min2.0525935570559524
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max6.399999999999985
in-drivable-lane_mean6.399999999999985
in-drivable-lane_median6.399999999999985
in-drivable-lane_min6.399999999999985
per-episodes
details{"d50-ego0": {"driven_any": 2.0525935570559524, "survival_time": 6.399999999999985, "driven_lanedir": 0.0, "in-drivable-lane": 6.399999999999985, "deviation-heading": 0.0, "distance-from-start": 1.5266059045881777, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max6.399999999999985
survival_time_mean6.399999999999985
survival_time_median6.399999999999985
survival_time_min6.399999999999985
No reset possible
137065sim-0of5successyes0:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.5614681305078557


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.5614681305078557
distance-from-start_median2.5614681305078557
distance-from-start_min2.5614681305078557
driven_any_max3.269203783710871
driven_any_mean3.269203783710871
driven_any_median3.269203783710871
driven_any_min3.269203783710871
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max9.750000000000004
in-drivable-lane_mean9.750000000000004
in-drivable-lane_median9.750000000000004
in-drivable-lane_min9.750000000000004
per-episodes
details{"d30-ego0": {"driven_any": 3.269203783710871, "survival_time": 9.750000000000004, "driven_lanedir": 0.0, "in-drivable-lane": 9.750000000000004, "deviation-heading": 0.0, "distance-from-start": 2.5614681305078557, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max9.750000000000004
survival_time_mean9.750000000000004
survival_time_median9.750000000000004
survival_time_min9.750000000000004
No reset possible
137064sim-4of5successyes0:03:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137063sim-4of5timeoutyes0:00:02
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137062sim-0of5timeoutyes0:00:09
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137061sim-3of5timeoutyes0:00:08
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137059sim-1of5failedyes0:05:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 720, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 370, in read_until_over
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout while reading output of node "ego0" after 120 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137058sim-2of5successyes0:09:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137057sim-0of5successyes0:04:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137056sim-3of5successyes0:03:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible