Duckietown Challenges Home Challenges Submissions

Submission 17680

Submission17680
Competingyes
Challengeaido-LFV-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 104370 sim-1of4: 104363 sim-2of4: 104367 sim-3of4: 104364
Next
User labelminimal-agent
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
104370sim-0of4successyes0:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.55
in-drivable-lane_median8.15
driven_lanedir_consec_median0.1366657585905522
deviation-center-line_median0.10783835333106088


other stats
deviation-center-line_max0.10783835333106088
deviation-center-line_mean0.10783835333106088
deviation-center-line_min0.10783835333106088
deviation-heading_max0.9508048428349394
deviation-heading_mean0.9508048428349394
deviation-heading_median0.9508048428349394
deviation-heading_min0.9508048428349394
distance-from-start_max1.4052228942345053
distance-from-start_mean1.4052228942345053
distance-from-start_median1.4052228942345053
distance-from-start_min1.4052228942345053
driven_any_max1.4053294634715037
driven_any_mean1.4053294634715037
driven_any_median1.4053294634715037
driven_any_min1.4053294634715037
driven_lanedir_consec_max0.1366657585905522
driven_lanedir_consec_mean0.1366657585905522
driven_lanedir_consec_min0.1366657585905522
driven_lanedir_max0.1366657585905522
driven_lanedir_mean0.1366657585905522
driven_lanedir_median0.1366657585905522
driven_lanedir_min0.1366657585905522
in-drivable-lane_max8.15
in-drivable-lane_mean8.15
in-drivable-lane_min8.15
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.4053294634715037, "survival_time": 9.55, "driven_lanedir": 0.1366657585905522, "in-drivable-lane": 8.15, "deviation-heading": 0.9508048428349394, "distance-from-start": 1.4052228942345053, "deviation-center-line": 0.10783835333106088, "driven_lanedir_consec": 0.1366657585905522}}
simulation-passed1
survival_time_max9.55
survival_time_mean9.55
survival_time_min9.55
No reset possible
104367sim-2of4successyes0:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.199999999999986
in-drivable-lane_median4.799999999999986
driven_lanedir_consec_median0.13666552017194578
deviation-center-line_median0.10783835333106152


other stats
deviation-center-line_max0.10783835333106152
deviation-center-line_mean0.10783835333106152
deviation-center-line_min0.10783835333106152
deviation-heading_max0.9508048428349394
deviation-heading_mean0.9508048428349394
deviation-heading_median0.9508048428349394
deviation-heading_min0.9508048428349394
distance-from-start_max0.8528594113978589
distance-from-start_mean0.8528594113978589
distance-from-start_median0.8528594113978589
distance-from-start_min0.8528594113978589
driven_any_max0.8528767649869702
driven_any_mean0.8528767649869702
driven_any_median0.8528767649869702
driven_any_min0.8528767649869702
driven_lanedir_consec_max0.13666552017194578
driven_lanedir_consec_mean0.13666552017194578
driven_lanedir_consec_min0.13666552017194578
driven_lanedir_max0.13666552017194578
driven_lanedir_mean0.13666552017194578
driven_lanedir_median0.13666552017194578
driven_lanedir_min0.13666552017194578
in-drivable-lane_max4.799999999999986
in-drivable-lane_mean4.799999999999986
in-drivable-lane_min4.799999999999986
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.8528767649869702, "survival_time": 6.199999999999986, "driven_lanedir": 0.13666552017194578, "in-drivable-lane": 4.799999999999986, "deviation-heading": 0.9508048428349394, "distance-from-start": 0.8528594113978589, "deviation-center-line": 0.10783835333106152, "driven_lanedir_consec": 0.13666552017194578}}
simulation-passed1
survival_time_max6.199999999999986
survival_time_mean6.199999999999986
survival_time_min6.199999999999986
No reset possible
104364sim-3of4successyes0:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.499999999999981
in-drivable-lane_median6.299999999999981
driven_lanedir_consec_median0.08715284181267591
deviation-center-line_median0.0853101739641597


other stats
deviation-center-line_max0.0853101739641597
deviation-center-line_mean0.0853101739641597
deviation-center-line_min0.0853101739641597
deviation-heading_max1.0211244921119549
deviation-heading_mean1.0211244921119549
deviation-heading_median1.0211244921119549
deviation-heading_min1.0211244921119549
distance-from-start_max1.0680700911320733
distance-from-start_mean1.0680700911320733
distance-from-start_median1.0680700911320733
distance-from-start_min1.0680700911320733
driven_any_max1.068124105945306
driven_any_mean1.068124105945306
driven_any_median1.068124105945306
driven_any_min1.068124105945306
driven_lanedir_consec_max0.08715284181267591
driven_lanedir_consec_mean0.08715284181267591
driven_lanedir_consec_min0.08715284181267591
driven_lanedir_max0.08715284181267591
driven_lanedir_mean0.08715284181267591
driven_lanedir_median0.08715284181267591
driven_lanedir_min0.08715284181267591
in-drivable-lane_max6.299999999999981
in-drivable-lane_mean6.299999999999981
in-drivable-lane_min6.299999999999981
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.068124105945306, "survival_time": 7.499999999999981, "driven_lanedir": 0.08715284181267591, "in-drivable-lane": 6.299999999999981, "deviation-heading": 1.0211244921119549, "distance-from-start": 1.0680700911320733, "deviation-center-line": 0.0853101739641597, "driven_lanedir_consec": 0.08715284181267591}}
simulation-passed1
survival_time_max7.499999999999981
survival_time_mean7.499999999999981
survival_time_min7.499999999999981
No reset possible
104363sim-1of4successyes0:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.199999999999986
in-drivable-lane_median4.799999999999986
driven_lanedir_consec_median0.13666552017194578
deviation-center-line_median0.10783835333106152


other stats
deviation-center-line_max0.10783835333106152
deviation-center-line_mean0.10783835333106152
deviation-center-line_min0.10783835333106152
deviation-heading_max0.9508048428349394
deviation-heading_mean0.9508048428349394
deviation-heading_median0.9508048428349394
deviation-heading_min0.9508048428349394
distance-from-start_max0.8528594113978589
distance-from-start_mean0.8528594113978589
distance-from-start_median0.8528594113978589
distance-from-start_min0.8528594113978589
driven_any_max0.8528767649869702
driven_any_mean0.8528767649869702
driven_any_median0.8528767649869702
driven_any_min0.8528767649869702
driven_lanedir_consec_max0.13666552017194578
driven_lanedir_consec_mean0.13666552017194578
driven_lanedir_consec_min0.13666552017194578
driven_lanedir_max0.13666552017194578
driven_lanedir_mean0.13666552017194578
driven_lanedir_median0.13666552017194578
driven_lanedir_min0.13666552017194578
in-drivable-lane_max4.799999999999986
in-drivable-lane_mean4.799999999999986
in-drivable-lane_min4.799999999999986
per-episodes
details{"autolab-000-ego0": {"driven_any": 0.8528767649869702, "survival_time": 6.199999999999986, "driven_lanedir": 0.13666552017194578, "in-drivable-lane": 4.799999999999986, "deviation-heading": 0.9508048428349394, "distance-from-start": 0.8528594113978589, "deviation-center-line": 0.10783835333106152, "driven_lanedir_consec": 0.13666552017194578}}
simulation-passed1
survival_time_max6.199999999999986
survival_time_mean6.199999999999986
survival_time_min6.199999999999986
No reset possible
104358sim-0of4successyes0:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104352sim-1of4successyes0:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104351sim-2of4successyes0:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104349sim-3of4successyes0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
104348sim-0of4successyes0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103873sim-1of4failedno0:01:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103872sim-3of4failedno0:01:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103871sim-2of4failedno0:00:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103870sim-0of4failedno0:01:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101656sim-0of4successno0:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101654sim-3of4successno0:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101653sim-2of4successno0:02:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101652sim-1of4successno0:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101641sim-0of4successno0:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101635sim-3of4successno0:02:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101634sim-2of4successno0:02:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
101633sim-1of4successno0:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible