Duckietown Challenges Home Challenges Submissions

Submission 17683

Submission17683
Competingyes
Challengeaido-LF-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 104188 sim-1of4: 104190 sim-2of4: 104189 sim-3of4: 104186
Next
User labelminimal-agent
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
104190sim-1of4successyes0:01:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.31048072934281246
survival_time_median11.60000000000003
deviation-center-line_median0.4653925586404334
in-drivable-lane_median7.549999999999989


other stats
deviation-center-line_max0.4653925586404334
deviation-center-line_mean0.4653925586404334
deviation-center-line_min0.4653925586404334
deviation-heading_max2.661550166530275
deviation-heading_mean2.661550166530275
deviation-heading_median2.661550166530275
deviation-heading_min2.661550166530275
distance-from-start_max1.7416408001353556
distance-from-start_mean1.7416408001353556
distance-from-start_median1.7416408001353556
distance-from-start_min1.7416408001353556
driven_any_max1.741750684261698
driven_any_mean1.741750684261698
driven_any_median1.741750684261698
driven_any_min1.741750684261698
driven_lanedir_consec_max0.31048072934281246
driven_lanedir_consec_mean0.31048072934281246
driven_lanedir_consec_min0.31048072934281246
driven_lanedir_max0.31048072934281246
driven_lanedir_mean0.31048072934281246
driven_lanedir_median0.31048072934281246
driven_lanedir_min0.31048072934281246
in-drivable-lane_max7.549999999999989
in-drivable-lane_mean7.549999999999989
in-drivable-lane_min7.549999999999989
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.741750684261698, "survival_time": 11.60000000000003, "driven_lanedir": 0.31048072934281246, "in-drivable-lane": 7.549999999999989, "deviation-heading": 2.661550166530275, "distance-from-start": 1.7416408001353556, "deviation-center-line": 0.4653925586404334, "driven_lanedir_consec": 0.31048072934281246}}
simulation-passed1
survival_time_max11.60000000000003
survival_time_mean11.60000000000003
survival_time_min11.60000000000003
No reset possible
104189sim-2of4successyes0:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13666552017194578
survival_time_median7.349999999999982
deviation-center-line_median0.10783809919009717
in-drivable-lane_median5.9499999999999815


other stats
deviation-center-line_max0.10783809919009717
deviation-center-line_mean0.10783809919009717
deviation-center-line_min0.10783809919009717
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max1.0431443246128234
distance-from-start_mean1.0431443246128234
distance-from-start_median1.0431443246128234
distance-from-start_min1.0431443246128234
driven_any_max1.0431971841733938
driven_any_mean1.0431971841733938
driven_any_median1.0431971841733938
driven_any_min1.0431971841733938
driven_lanedir_consec_max0.13666552017194578
driven_lanedir_consec_mean0.13666552017194578
driven_lanedir_consec_min0.13666552017194578
driven_lanedir_max0.13666552017194578
driven_lanedir_mean0.13666552017194578
driven_lanedir_median0.13666552017194578
driven_lanedir_min0.13666552017194578
in-drivable-lane_max5.9499999999999815
in-drivable-lane_mean5.9499999999999815
in-drivable-lane_min5.9499999999999815
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.0431971841733938, "survival_time": 7.349999999999982, "driven_lanedir": 0.13666552017194578, "in-drivable-lane": 5.9499999999999815, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.0431443246128234, "deviation-center-line": 0.10783809919009717, "driven_lanedir_consec": 0.13666552017194578}}
simulation-passed1
survival_time_max7.349999999999982
survival_time_mean7.349999999999982
survival_time_min7.349999999999982
No reset possible
104188sim-0of4successyes0:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.13666480491623578
survival_time_median10.85000000000002
deviation-center-line_median0.10783802485852027
in-drivable-lane_median9.45000000000002


other stats
deviation-center-line_max0.10783802485852027
deviation-center-line_mean0.10783802485852027
deviation-center-line_min0.10783802485852027
deviation-heading_max0.9508048428349386
deviation-heading_mean0.9508048428349386
deviation-heading_median0.9508048428349386
deviation-heading_min0.9508048428349386
distance-from-start_max1.6182798682575137
distance-from-start_mean1.6182798682575137
distance-from-start_median1.6182798682575137
distance-from-start_min1.6182798682575137
driven_any_max1.6183892771013906
driven_any_mean1.6183892771013906
driven_any_median1.6183892771013906
driven_any_min1.6183892771013906
driven_lanedir_consec_max0.13666480491623578
driven_lanedir_consec_mean0.13666480491623578
driven_lanedir_consec_min0.13666480491623578
driven_lanedir_max0.13666480491623578
driven_lanedir_mean0.13666480491623578
driven_lanedir_median0.13666480491623578
driven_lanedir_min0.13666480491623578
in-drivable-lane_max9.45000000000002
in-drivable-lane_mean9.45000000000002
in-drivable-lane_min9.45000000000002
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.6183892771013906, "survival_time": 10.85000000000002, "driven_lanedir": 0.13666480491623578, "in-drivable-lane": 9.45000000000002, "deviation-heading": 0.9508048428349386, "distance-from-start": 1.6182798682575137, "deviation-center-line": 0.10783802485852027, "driven_lanedir_consec": 0.13666480491623578}}
simulation-passed1
survival_time_max10.85000000000002
survival_time_mean10.85000000000002
survival_time_min10.85000000000002
No reset possible
104186sim-3of4successyes0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3090246034105215
survival_time_median10.550000000000017
deviation-center-line_median0.2686156888397356
in-drivable-lane_median7.45000000000002


other stats
deviation-center-line_max0.2686156888397356
deviation-center-line_mean0.2686156888397356
deviation-center-line_min0.2686156888397356
deviation-heading_max2.49953375601749
deviation-heading_mean2.49953375601749
deviation-heading_median2.49953375601749
deviation-heading_min2.49953375601749
distance-from-start_max1.5698915253905847
distance-from-start_mean1.5698915253905847
distance-from-start_median1.5698915253905847
distance-from-start_min1.5698915253905847
driven_any_max1.5700003368149933
driven_any_mean1.5700003368149933
driven_any_median1.5700003368149933
driven_any_min1.5700003368149933
driven_lanedir_consec_max0.3090246034105215
driven_lanedir_consec_mean0.3090246034105215
driven_lanedir_consec_min0.3090246034105215
driven_lanedir_max0.3090246034105215
driven_lanedir_mean0.3090246034105215
driven_lanedir_median0.3090246034105215
driven_lanedir_min0.3090246034105215
in-drivable-lane_max7.45000000000002
in-drivable-lane_mean7.45000000000002
in-drivable-lane_min7.45000000000002
per-episodes
details{"loop-000-ego0": {"driven_any": 1.5700003368149933, "survival_time": 10.550000000000017, "driven_lanedir": 0.3090246034105215, "in-drivable-lane": 7.45000000000002, "deviation-heading": 2.49953375601749, "distance-from-start": 1.5698915253905847, "deviation-center-line": 0.2686156888397356, "driven_lanedir_consec": 0.3090246034105215}}
simulation-passed1
survival_time_max10.550000000000017
survival_time_mean10.550000000000017
survival_time_min10.550000000000017
No reset possible
104185sim-1of4successyes0:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104184sim-0of4successyes0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104183sim-2of4successyes0:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104181sim-3of4successyes0:01:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104180sim-1of4successyes0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104179sim-0of4successyes0:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104178sim-2of4successyes0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104176sim-3of4successyes0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104175sim-1of4successyes0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104174sim-2of4successyes0:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104173sim-0of4successyes0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103875sim-0of4failedno0:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103874sim-1of4failedno0:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103869sim-2of4failedno0:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103868sim-3of4failedno0:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103867sim-0of4failedno0:00:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103866sim-1of4failedno0:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101627sim-1of4successno0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101623sim-2of4successno0:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101621sim-3of4successno0:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101620sim-0of4successno0:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101618sim-1of4successno0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101616sim-2of4successno0:01:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101612sim-0of4successno0:01:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101611sim-3of4successno0:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101608sim-1of4successno0:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101607sim-2of4successno0:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101606sim-0of4successno0:01:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101604sim-3of4successno0:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101602sim-1of4successno0:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101601sim-2of4successno0:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible