Duckietown Challenges Home Challenges Submissions

Submission 15564

Submission15564
Competingyes
Challengeaido-LFI-sim-validation
UserAdriano Almeida
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 104785 sim-1of4: 104784 sim-2of4: 104768 sim-3of4: 104767
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

104785

Click the images to see detailed statistics about the episode.

udem1-000

104784

Click the images to see detailed statistics about the episode.

4way-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
104785sim-0of4successyes0:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.399999999999992
in-drivable-lane_median2.8499999999999934
driven_lanedir_consec_median0.3547099503080213
deviation-center-line_median0.11558779639181374


other stats
deviation-center-line_max0.11558779639181374
deviation-center-line_mean0.11558779639181374
deviation-center-line_min0.11558779639181374
deviation-heading_max1.1209455199435732
deviation-heading_mean1.1209455199435732
deviation-heading_median1.1209455199435732
deviation-heading_min1.1209455199435732
distance-from-start_max1.5090209118442732
distance-from-start_mean1.5090209118442732
distance-from-start_median1.5090209118442732
distance-from-start_min1.5090209118442732
driven_any_max1.5121601783539929
driven_any_mean1.5121601783539929
driven_any_median1.5121601783539929
driven_any_min1.5121601783539929
driven_lanedir_consec_max0.3547099503080213
driven_lanedir_consec_mean0.3547099503080213
driven_lanedir_consec_min0.3547099503080213
driven_lanedir_max0.3547099503080213
driven_lanedir_mean0.3547099503080213
driven_lanedir_median0.3547099503080213
driven_lanedir_min0.3547099503080213
in-drivable-lane_max2.8499999999999934
in-drivable-lane_mean2.8499999999999934
in-drivable-lane_min2.8499999999999934
per-episodes
details{"udem1-000-ego0": {"driven_any": 1.5121601783539929, "survival_time": 4.399999999999992, "driven_lanedir": 0.3547099503080213, "in-drivable-lane": 2.8499999999999934, "deviation-heading": 1.1209455199435732, "distance-from-start": 1.5090209118442732, "deviation-center-line": 0.11558779639181374, "driven_lanedir_consec": 0.3547099503080213}}
simulation-passed1
survival_time_max4.399999999999992
survival_time_mean4.399999999999992
survival_time_min4.399999999999992
No reset possible
104784sim-1of4successyes0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.950000000000001
in-drivable-lane_median1.0000000000000009
driven_lanedir_consec_median0.21552424021941508
deviation-center-line_median0.05641335745099811


other stats
deviation-center-line_max0.05641335745099811
deviation-center-line_mean0.05641335745099811
deviation-center-line_min0.05641335745099811
deviation-heading_max0.509801784039702
deviation-heading_mean0.509801784039702
deviation-heading_median0.509801784039702
deviation-heading_min0.509801784039702
distance-from-start_max0.38605748278694385
distance-from-start_mean0.38605748278694385
distance-from-start_median0.38605748278694385
distance-from-start_min0.38605748278694385
driven_any_max0.3866220460800693
driven_any_mean0.3866220460800693
driven_any_median0.3866220460800693
driven_any_min0.3866220460800693
driven_lanedir_consec_max0.21552424021941508
driven_lanedir_consec_mean0.21552424021941508
driven_lanedir_consec_min0.21552424021941508
driven_lanedir_max0.21552424021941508
driven_lanedir_mean0.21552424021941508
driven_lanedir_median0.21552424021941508
driven_lanedir_min0.21552424021941508
in-drivable-lane_max1.0000000000000009
in-drivable-lane_mean1.0000000000000009
in-drivable-lane_min1.0000000000000009
per-episodes
details{"4way-000-ego0": {"driven_any": 0.3866220460800693, "survival_time": 1.950000000000001, "driven_lanedir": 0.21552424021941508, "in-drivable-lane": 1.0000000000000009, "deviation-heading": 0.509801784039702, "distance-from-start": 0.38605748278694385, "deviation-center-line": 0.05641335745099811, "driven_lanedir_consec": 0.21552424021941508}}
simulation-passed1
survival_time_max1.950000000000001
survival_time_mean1.950000000000001
survival_time_min1.950000000000001
No reset possible
104783sim-1of4successyes0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104782sim-0of4successyes0:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104778sim-0of4successyes0:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104777sim-1of4successyes0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104771sim-1of4successyes0:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104770sim-0of4successyes0:01:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104768sim-2of4successyes0:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
104767sim-3of4successyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
104761sim-2of4successyes0:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104759sim-3of4successyes0:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104758sim-1of4successyes0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104757sim-0of4successyes0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104753sim-2of4successyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104748sim-3of4successyes0:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104744sim-2of4successyes0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104741sim-3of4successyes0:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99781sim-0of4failedno0:01:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99768sim-0of4failedno0:01:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99750sim-0of4failedno0:02:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99706sim-0of4host-errorno0:01:01
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99696sim-0of4host-errorno0:01:22
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99683sim-0of4failedno0:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99669sim-0of4host-errorno0:01:54
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99631sim-2of4successno0:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99627sim-1of4failedno0:01:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99626sim-0of4host-errorno0:01:05
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99625sim-3of4successno0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99622sim-2of4successno0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99617sim-0of4host-errorno0:01:03
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99616sim-1of4host-errorno0:01:02
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99615sim-3of4successno0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99611sim-2of4successno0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99608sim-0of4host-errorno0:01:06
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99606sim-1of4host-errorno0:01:04
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99605sim-3of4successno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
99601sim-2of4successno0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96832sim-3of4successno0:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96831sim-1of4successno0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96830sim-0of4successno0:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96828sim-2of4successno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96824sim-0of4successno0:01:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96821sim-1of4successno0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96820sim-2of4successno0:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96818sim-3of4successno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96815sim-2of4successno0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96814sim-3of4successno0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96809sim-1of4successno0:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
96808sim-0of4successno0:01:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible