Duckietown Challenges Home Challenges Submissions

Submission 13569

Submission13569
Competingyes
Challengeaido-LFI-sim-validation
UserMárton Tim 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 105614 sim-1of4: 105621 sim-2of4: 105628 sim-3of4: 105626
Next
User label3626
Admin priority50
Blessingn/a
User priority50

105621

Click the images to see detailed statistics about the episode.

4way-000

challenge-solution-output

105614

Click the images to see detailed statistics about the episode.

udem1-000

challenge-solution-output

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
105628sim-2of4successyes0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
105626sim-3of4successyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
105621sim-1of4successyes0:03:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.00000000000021
in-drivable-lane_median4.6000000000000405
driven_lanedir_consec_median8.028633794048897
deviation-center-line_median1.3314074244616243


other stats
deviation-center-line_max1.3314074244616243
deviation-center-line_mean1.3314074244616243
deviation-center-line_min1.3314074244616243
deviation-heading_max6.3095798301932104
deviation-heading_mean6.3095798301932104
deviation-heading_median6.3095798301932104
deviation-heading_min6.3095798301932104
distance-from-start_max1.9844359647654384
distance-from-start_mean1.9844359647654384
distance-from-start_median1.9844359647654384
distance-from-start_min1.9844359647654384
driven_any_max11.452120969372384
driven_any_mean11.452120969372384
driven_any_median11.452120969372384
driven_any_min11.452120969372384
driven_lanedir_consec_max8.028633794048897
driven_lanedir_consec_mean8.028633794048897
driven_lanedir_consec_min8.028633794048897
driven_lanedir_max8.481546894127764
driven_lanedir_mean8.481546894127764
driven_lanedir_median8.481546894127764
driven_lanedir_min8.481546894127764
in-drivable-lane_max4.6000000000000405
in-drivable-lane_mean4.6000000000000405
in-drivable-lane_min4.6000000000000405
per-episodes
details{"4way-000-ego0": {"driven_any": 11.452120969372384, "survival_time": 24.00000000000021, "driven_lanedir": 8.481546894127764, "in-drivable-lane": 4.6000000000000405, "deviation-heading": 6.3095798301932104, "distance-from-start": 1.9844359647654384, "deviation-center-line": 1.3314074244616243, "driven_lanedir_consec": 8.028633794048897}}
simulation-passed1
survival_time_max24.00000000000021
survival_time_mean24.00000000000021
survival_time_min24.00000000000021
No reset possible
105619sim-2of4successyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105618sim-3of4successyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105615sim-2of4successyes0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105614sim-0of4successyes0:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.650000000000002
in-drivable-lane_median0.6500000000000012
driven_lanedir_consec_median3.56965623471391
deviation-center-line_median0.6934903731934864


other stats
deviation-center-line_max0.6934903731934864
deviation-center-line_mean0.6934903731934864
deviation-center-line_min0.6934903731934864
deviation-heading_max2.9131687143898506
deviation-heading_mean2.9131687143898506
deviation-heading_median2.9131687143898506
deviation-heading_min2.9131687143898506
distance-from-start_max2.236801341376488
distance-from-start_mean2.236801341376488
distance-from-start_median2.236801341376488
distance-from-start_min2.236801341376488
driven_any_max4.095921894972191
driven_any_mean4.095921894972191
driven_any_median4.095921894972191
driven_any_min4.095921894972191
driven_lanedir_consec_max3.56965623471391
driven_lanedir_consec_mean3.56965623471391
driven_lanedir_consec_min3.56965623471391
driven_lanedir_max3.56965623471391
driven_lanedir_mean3.56965623471391
driven_lanedir_median3.56965623471391
driven_lanedir_min3.56965623471391
in-drivable-lane_max0.6500000000000012
in-drivable-lane_mean0.6500000000000012
in-drivable-lane_min0.6500000000000012
per-episodes
details{"udem1-000-ego0": {"driven_any": 4.095921894972191, "survival_time": 9.650000000000002, "driven_lanedir": 3.56965623471391, "in-drivable-lane": 0.6500000000000012, "deviation-heading": 2.9131687143898506, "distance-from-start": 2.236801341376488, "deviation-center-line": 0.6934903731934864, "driven_lanedir_consec": 3.56965623471391}}
simulation-passed1
survival_time_max9.650000000000002
survival_time_mean9.650000000000002
survival_time_min9.650000000000002
No reset possible
105613sim-3of4successyes0:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105610sim-1of4successyes0:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105608sim-2of4successyes0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105607sim-3of4successyes0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
105602sim-1of4successyes0:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100832sim-0of4failedno0:01:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100821sim-0of4host-errorno0:01:25
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100811sim-0of4host-errorno0:01:15
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100800sim-0of4failedno0:01:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100795sim-1of4failedno0:01:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100791sim-0of4failedno0:01:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100784sim-1of4host-errorno0:01:05
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100783sim-0of4host-errorno0:01:05
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100777sim-1of4host-errorno0:01:10
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100776sim-0of4failedno0:01:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100773sim-3of4successno0:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100766sim-2of4successno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100762sim-3of4successno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100755sim-2of4successno0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
100753sim-3of4successno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91724sim-2of4successno0:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91721sim-2of4successno0:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91716sim-0of4successno0:06:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91710sim-1of4successno0:04:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91707sim-3of4successno0:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91704sim-3of4successno0:02:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91702sim-3of4successno0:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91697sim-3of4successno0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91696sim-3of4successno0:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91692sim-3of4successno0:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91690sim-3of4successno0:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91686sim-3of4successno0:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
91682sim-3of4successno0:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74894sim-0of4successno0:02:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74884sim-0of4successno0:03:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74883sim-2of4successno0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74881sim-1of4successno0:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74880sim-3of4successno0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74875sim-2of4successno0:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74871sim-3of4successno0:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74870sim-2of4successno0:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74866sim-1of4successno0:03:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
74865sim-3of4successno0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible