Duckietown Challenges Home Challenges Submissions

Submission 18902

Submission18902
Competingyes
Challengemooc-BV1
UserYan Long Huang
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobssim-0of5: 137043 sim-1of5: 137046 sim-2of5: 137045 sim-3of5: 137048 sim-4of5: 137047
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

137048

Click the images to see detailed statistics about the episode.

d50

137047

Click the images to see detailed statistics about the episode.

d60

137045

Click the images to see detailed statistics about the episode.

d40

137043

Click the images to see detailed statistics about the episode.

d30

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
137048sim-3of5successyes0:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.225164901935053


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.225164901935053
distance-from-start_median1.225164901935053
distance-from-start_min1.225164901935053
driven_any_max1.7601407310770525
driven_any_mean1.7601407310770525
driven_any_median1.7601407310770525
driven_any_min1.7601407310770525
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max5.649999999999988
in-drivable-lane_mean5.649999999999988
in-drivable-lane_median5.649999999999988
in-drivable-lane_min5.649999999999988
per-episodes
details{"d50-ego0": {"driven_any": 1.7601407310770525, "survival_time": 5.649999999999988, "driven_lanedir": 0.0, "in-drivable-lane": 5.649999999999988, "deviation-heading": 0.0, "distance-from-start": 1.225164901935053, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max5.649999999999988
survival_time_mean5.649999999999988
survival_time_median5.649999999999988
survival_time_min5.649999999999988
No reset possible
137047sim-4of5successyes0:03:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.4987025035163732


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.4987025035163732
distance-from-start_median1.4987025035163732
distance-from-start_min1.4987025035163732
driven_any_max1.6237939799386936
driven_any_mean1.6237939799386936
driven_any_median1.6237939799386936
driven_any_min1.6237939799386936
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max5.299999999999989
in-drivable-lane_mean5.299999999999989
in-drivable-lane_median5.299999999999989
in-drivable-lane_min5.299999999999989
per-episodes
details{"d60-ego0": {"driven_any": 1.6237939799386936, "survival_time": 5.299999999999989, "driven_lanedir": 0.0, "in-drivable-lane": 5.299999999999989, "deviation-heading": 0.0, "distance-from-start": 1.4987025035163732, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max5.299999999999989
survival_time_mean5.299999999999989
survival_time_median5.299999999999989
survival_time_min5.299999999999989
No reset possible
137046sim-1of5failedyes0:04:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 720, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 370, in read_until_over
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout while reading output of node "ego0" after 120 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137045sim-2of5successyes0:04:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.344658232404971


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.344658232404971
distance-from-start_median2.344658232404971
distance-from-start_min2.344658232404971
driven_any_max2.8357051143445866
driven_any_mean2.8357051143445866
driven_any_median2.8357051143445866
driven_any_min2.8357051143445866
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max8.349999999999984
in-drivable-lane_mean8.349999999999984
in-drivable-lane_median8.349999999999984
in-drivable-lane_min8.349999999999984
per-episodes
details{"d40-ego0": {"driven_any": 2.8357051143445866, "survival_time": 8.349999999999984, "driven_lanedir": 0.0, "in-drivable-lane": 8.349999999999984, "deviation-heading": 0.0, "distance-from-start": 2.344658232404971, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean8.349999999999984
survival_time_median8.349999999999984
survival_time_min8.349999999999984
No reset possible
137043sim-0of5successyes0:04:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.2071493060763663


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.2071493060763663
distance-from-start_median2.2071493060763663
distance-from-start_min2.2071493060763663
driven_any_max4.6034894140929765
driven_any_mean4.6034894140929765
driven_any_median4.6034894140929765
driven_any_min4.6034894140929765
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max13.250000000000052
in-drivable-lane_mean13.250000000000052
in-drivable-lane_median13.250000000000052
in-drivable-lane_min13.250000000000052
per-episodes
details{"d30-ego0": {"driven_any": 4.6034894140929765, "survival_time": 13.250000000000052, "driven_lanedir": 0.0, "in-drivable-lane": 13.250000000000052, "deviation-heading": 0.0, "distance-from-start": 2.2071493060763663, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max13.250000000000052
survival_time_mean13.250000000000052
survival_time_median13.250000000000052
survival_time_min13.250000000000052
No reset possible
137042sim-2of5successyes0:03:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137041sim-3of5successyes0:05:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137040sim-1of5failedyes0:05:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 720, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 370, in read_until_over
    raise ExternalTimeout(msg) from None
zuper_nodes.structures.ExternalTimeout: Timeout while reading output of node "ego0" after 120 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
137039sim-4of5successyes0:03:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible