Duckietown Challenges Home Challenges Submissions

Submission 17531

Submission17531
Competingyes
Challengeaido-LF-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobssim-0of4: 121049 sim-1of4: 121036 sim-2of4: 121078 sim-3of4: 121079
Next
User labelbaseline-RL-sim-pytorch
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
121079sim-3of4successyes0:09:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-3.5732264610143485
survival_time_median59.99999999999873
deviation-center-line_median3.157216597683812
in-drivable-lane_median25.19999999999917


other stats
deviation-center-line_max3.157216597683812
deviation-center-line_mean3.157216597683812
deviation-center-line_min3.157216597683812
deviation-heading_max23.31036839413164
deviation-heading_mean23.31036839413164
deviation-heading_median23.31036839413164
deviation-heading_min23.31036839413164
distance-from-start_max0.2049761387353884
distance-from-start_mean0.2049761387353884
distance-from-start_median0.2049761387353884
distance-from-start_min0.2049761387353884
driven_any_max14.57545970189994
driven_any_mean14.57545970189994
driven_any_median14.57545970189994
driven_any_min14.57545970189994
driven_lanedir_consec_max-3.5732264610143485
driven_lanedir_consec_mean-3.5732264610143485
driven_lanedir_consec_min-3.5732264610143485
driven_lanedir_max-6.144787942802159
driven_lanedir_mean-6.144787942802159
driven_lanedir_median-6.144787942802159
driven_lanedir_min-6.144787942802159
in-drivable-lane_max25.19999999999917
in-drivable-lane_mean25.19999999999917
in-drivable-lane_min25.19999999999917
per-episodes
details{"zigzag-000-ego0": {"driven_any": 14.57545970189994, "survival_time": 59.99999999999873, "driven_lanedir": -6.144787942802159, "in-drivable-lane": 25.19999999999917, "deviation-heading": 23.31036839413164, "distance-from-start": 0.2049761387353884, "deviation-center-line": 3.157216597683812, "driven_lanedir_consec": -3.5732264610143485}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
121078sim-2of4successyes0:10:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-2.3513937746305267
survival_time_median59.99999999999873
deviation-center-line_median3.582785682664132
in-drivable-lane_median21.749999999999456


other stats
deviation-center-line_max3.582785682664132
deviation-center-line_mean3.582785682664132
deviation-center-line_min3.582785682664132
deviation-heading_max26.635372354993567
deviation-heading_mean26.635372354993567
deviation-heading_median26.635372354993567
deviation-heading_min26.635372354993567
distance-from-start_max0.14608498400983566
distance-from-start_mean0.14608498400983566
distance-from-start_median0.14608498400983566
distance-from-start_min0.14608498400983566
driven_any_max10.10339564701195
driven_any_mean10.10339564701195
driven_any_median10.10339564701195
driven_any_min10.10339564701195
driven_lanedir_consec_max-2.3513937746305267
driven_lanedir_consec_mean-2.3513937746305267
driven_lanedir_consec_min-2.3513937746305267
driven_lanedir_max-2.3513937746305267
driven_lanedir_mean-2.3513937746305267
driven_lanedir_median-2.3513937746305267
driven_lanedir_min-2.3513937746305267
in-drivable-lane_max21.749999999999456
in-drivable-lane_mean21.749999999999456
in-drivable-lane_min21.749999999999456
per-episodes
details{"loop-000-ego0": {"driven_any": 10.10339564701195, "survival_time": 59.99999999999873, "driven_lanedir": -2.3513937746305267, "in-drivable-lane": 21.749999999999456, "deviation-heading": 26.635372354993567, "distance-from-start": 0.14608498400983566, "deviation-center-line": 3.582785682664132, "driven_lanedir_consec": -2.3513937746305267}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
121049sim-0of4successyes0:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-3.1487454804520696
survival_time_median59.99999999999873
deviation-center-line_median2.966070280156876
in-drivable-lane_median25.24999999999935


other stats
deviation-center-line_max2.966070280156876
deviation-center-line_mean2.966070280156876
deviation-center-line_min2.966070280156876
deviation-heading_max28.459585789678833
deviation-heading_mean28.459585789678833
deviation-heading_median28.459585789678833
deviation-heading_min28.459585789678833
distance-from-start_max0.1273347170354393
distance-from-start_mean0.1273347170354393
distance-from-start_median0.1273347170354393
distance-from-start_min0.1273347170354393
driven_any_max11.494276843372251
driven_any_mean11.494276843372251
driven_any_median11.494276843372251
driven_any_min11.494276843372251
driven_lanedir_consec_max-3.1487454804520696
driven_lanedir_consec_mean-3.1487454804520696
driven_lanedir_consec_min-3.1487454804520696
driven_lanedir_max-3.1487454804520696
driven_lanedir_mean-3.1487454804520696
driven_lanedir_median-3.1487454804520696
driven_lanedir_min-3.1487454804520696
in-drivable-lane_max25.24999999999935
in-drivable-lane_mean25.24999999999935
in-drivable-lane_min25.24999999999935
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.494276843372251, "survival_time": 59.99999999999873, "driven_lanedir": -3.1487454804520696, "in-drivable-lane": 25.24999999999935, "deviation-heading": 28.459585789678833, "distance-from-start": 0.1273347170354393, "deviation-center-line": 2.966070280156876, "driven_lanedir_consec": -3.1487454804520696}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
121042sim-3of4abortedyes0:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
121036sim-1of4failedyes0:00:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
121031sim-0of4failedyes0:00:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
121025sim-0of4failedyes0:03:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107139sim-0of4abortedyes0:04:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107138sim-2of4abortedyes0:04:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107116sim-3of4abortedyes0:06:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
107114sim-1of4abortedyes0:06:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible