Duckietown Challenges Home Challenges Submissions

Submission 18019

Submission18019
Competingyes
Challengeaido-hello-sim-validation
UserBence Pap
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssanity-check: 128270
Next
User labeltemplate-pytorch
Admin priority50
Blessingn/a
User priority50

128270

Click the images to see detailed statistics about the episode.

scenarios

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
128270sanity-checksuccessyes0:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.49999999999999994
in-drivable-lane_median0.0
driven_lanedir_consec_median0.04986172919610787
deviation-center-line_median0.006438704405979705


other stats
deviation-center-line_max0.006438704405979705
deviation-center-line_mean0.006438704405979705
deviation-center-line_min0.006438704405979705
deviation-heading_max0.26376696030909214
deviation-heading_mean0.26376696030909214
deviation-heading_median0.26376696030909214
deviation-heading_min0.26376696030909214
distance-from-start_max0.057480294262033535
distance-from-start_mean0.057480294262033535
distance-from-start_median0.057480294262033535
distance-from-start_min0.057480294262033535
driven_any_max0.057481137749750374
driven_any_mean0.057481137749750374
driven_any_median0.057481137749750374
driven_any_min0.057481137749750374
driven_lanedir_consec_max0.04986172919610787
driven_lanedir_consec_mean0.04986172919610787
driven_lanedir_consec_min0.04986172919610787
driven_lanedir_max0.04986172919610787
driven_lanedir_mean0.04986172919610787
driven_lanedir_median0.04986172919610787
driven_lanedir_min0.04986172919610787
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"scenarios-ego0": {"driven_any": 0.057481137749750374, "survival_time": 0.49999999999999994, "driven_lanedir": 0.04986172919610787, "in-drivable-lane": 0.0, "deviation-heading": 0.26376696030909214, "distance-from-start": 0.057480294262033535, "deviation-center-line": 0.006438704405979705, "driven_lanedir_consec": 0.04986172919610787}}
simulation-passed1
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible
128266sanity-checksuccessyes0:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
128259sanity-checksuccessyes0:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
128251sanity-checksuccessyes0:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
119900sanity-checkfailedno0:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
119896sanity-checkfailedno0:01:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
118498sanity-checkhost-errorno0:05:17
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible