Duckietown Challenges Home Challenges Submissions

Evaluator 5541

ID5541
evaluatoreval02
ownerAndrea Daniele 🇮🇹
machinedavinci
processeval02
version6.2.40
first heard
last heard
statusinactive
# evaluating
# success105 119840
# timeout1 121041
# failed47 119870
# error
# aborted36 119977
# host-error83 119849
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors79%
RAM total (MB)251.6 GB
RAM free (MB)243.8 GB
Disk (MB)444.3 GB
Disk available (MB)421.5 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
12104118368Sampsa RantaQuack² - Thanks for All the Fishaido-LFI-sim-validationsim-3of4timeoutyeseval02----No reset possible
12103818368Sampsa RantaQuack² - Thanks for All the Fishaido-LFI-sim-validationsim-3of4successyeseval020:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12103518368Sampsa RantaQuack² - Thanks for All the Fishaido-LFI-sim-validationsim-3of4successyeseval020:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12102918368Sampsa RantaQuack² - Thanks for All the Fishaido-LFI-sim-validationsim-0of4successyeseval020:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.150000000000095
in-drivable-lane_median5.65000000000008
driven_lanedir_consec_median0.9349579908917082
deviation-center-line_median0.6736304965296298


other stats
deviation-center-line_max0.6736304965296298
deviation-center-line_mean0.6736304965296298
deviation-center-line_min0.6736304965296298
deviation-heading_max3.902971627356023
deviation-heading_mean3.902971627356023
deviation-heading_median3.902971627356023
deviation-heading_min3.902971627356023
distance-from-start_max1.5455962796843734
distance-from-start_mean1.5455962796843734
distance-from-start_median1.5455962796843734
distance-from-start_min1.5455962796843734
driven_any_max1.5733704647387678
driven_any_mean1.5733704647387678
driven_any_median1.5733704647387678
driven_any_min1.5733704647387678
driven_lanedir_consec_max0.9349579908917082
driven_lanedir_consec_mean0.9349579908917082
driven_lanedir_consec_min0.9349579908917082
driven_lanedir_max0.949517291670894
driven_lanedir_mean0.949517291670894
driven_lanedir_median0.949517291670894
driven_lanedir_min0.949517291670894
in-drivable-lane_max5.65000000000008
in-drivable-lane_mean5.65000000000008
in-drivable-lane_min5.65000000000008
per-episodes
details{"4way-000-ego0": {"driven_any": 1.5733704647387678, "survival_time": 16.150000000000095, "driven_lanedir": 0.949517291670894, "in-drivable-lane": 5.65000000000008, "deviation-heading": 3.902971627356023, "distance-from-start": 1.5455962796843734, "deviation-center-line": 0.6736304965296298, "driven_lanedir_consec": 0.9349579908917082}}
simulation-passed1
survival_time_max16.150000000000095
survival_time_mean16.150000000000095
survival_time_min16.150000000000095
No reset possible
12102118369Sampsa RantaQuack² - Bluezaido-LFV-sim-validationsim-1of4successyeseval020:09:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median3.338884064821095
deviation-center-line_median1.466709580906392


other stats
deviation-center-line_max1.466709580906392
deviation-center-line_mean1.466709580906392
deviation-center-line_min1.466709580906392
deviation-heading_max2.579873390489138
deviation-heading_mean2.579873390489138
deviation-heading_median2.579873390489138
deviation-heading_min2.579873390489138
distance-from-start_max2.5458340908489174
distance-from-start_mean2.5458340908489174
distance-from-start_median2.5458340908489174
distance-from-start_min2.5458340908489174
driven_any_max3.370524519395722
driven_any_mean3.370524519395722
driven_any_median3.370524519395722
driven_any_min3.370524519395722
driven_lanedir_consec_max3.338884064821095
driven_lanedir_consec_mean3.338884064821095
driven_lanedir_consec_min3.338884064821095
driven_lanedir_max3.338884064821095
driven_lanedir_mean3.338884064821095
driven_lanedir_median3.338884064821095
driven_lanedir_min3.338884064821095
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 3.370524519395722, "survival_time": 59.99999999999873, "driven_lanedir": 3.338884064821095, "in-drivable-lane": 0.0, "deviation-heading": 2.579873390489138, "distance-from-start": 2.5458340908489174, "deviation-center-line": 1.466709580906392, "driven_lanedir_consec": 3.338884064821095}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12101818370Sampsa RantaQuack² - Interestingaido-LF-sim-validationsim-2of4successyeseval020:06:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median12.168413952041956
survival_time_median59.99999999999873
deviation-center-line_median2.0169376205709866
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.0169376205709866
deviation-center-line_mean2.0169376205709866
deviation-center-line_min2.0169376205709866
deviation-heading_max10.203973587704311
deviation-heading_mean10.203973587704311
deviation-heading_median10.203973587704311
deviation-heading_min10.203973587704311
distance-from-start_max1.031241274608293
distance-from-start_mean1.031241274608293
distance-from-start_median1.031241274608293
distance-from-start_min1.031241274608293
driven_any_max12.475372342808951
driven_any_mean12.475372342808951
driven_any_median12.475372342808951
driven_any_min12.475372342808951
driven_lanedir_consec_max12.168413952041956
driven_lanedir_consec_mean12.168413952041956
driven_lanedir_consec_min12.168413952041956
driven_lanedir_max12.168413952041956
driven_lanedir_mean12.168413952041956
driven_lanedir_median12.168413952041956
driven_lanedir_min12.168413952041956
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 12.475372342808951, "survival_time": 59.99999999999873, "driven_lanedir": 12.168413952041956, "in-drivable-lane": 0.0, "deviation-heading": 10.203973587704311, "distance-from-start": 1.031241274608293, "deviation-center-line": 2.0169376205709866, "driven_lanedir_consec": 12.168413952041956}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12100918362Sampsa RantaQuack² - Bluezaido-LFV-sim-validationsim-2of4failedyeseval020:02:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 720, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 360, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 416, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 589, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/submission_ws/src/agent/src/solution.py", line 81, in on_received_get_commands
              ||     raise Exception(msg)
              || Exception: I have been waiting for commands from the ROS part since 60 s
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12100518361Sampsa RantaQuack² - Thanks for All the Fishaido-LF-sim-validationsim-3of4successyeseval020:06:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.147400407090037
survival_time_median59.99999999999873
deviation-center-line_median1.7315692824645383
in-drivable-lane_median0.0


other stats
deviation-center-line_max1.7315692824645383
deviation-center-line_mean1.7315692824645383
deviation-center-line_min1.7315692824645383
deviation-heading_max7.412632690985869
deviation-heading_mean7.412632690985869
deviation-heading_median7.412632690985869
deviation-heading_min7.412632690985869
distance-from-start_max3.483571231761449
distance-from-start_mean3.483571231761449
distance-from-start_median3.483571231761449
distance-from-start_min3.483571231761449
driven_any_max6.237860661197732
driven_any_mean6.237860661197732
driven_any_median6.237860661197732
driven_any_min6.237860661197732
driven_lanedir_consec_max6.147400407090037
driven_lanedir_consec_mean6.147400407090037
driven_lanedir_consec_min6.147400407090037
driven_lanedir_max6.147400407090037
driven_lanedir_mean6.147400407090037
driven_lanedir_median6.147400407090037
driven_lanedir_min6.147400407090037
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.237860661197732, "survival_time": 59.99999999999873, "driven_lanedir": 6.147400407090037, "in-drivable-lane": 0.0, "deviation-heading": 7.412632690985869, "distance-from-start": 3.483571231761449, "deviation-center-line": 1.7315692824645383, "driven_lanedir_consec": 6.147400407090037}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12099218352Bence Haromi007-0.5aido-LFI-sim-testingsim-0of4failedyeseval020:01:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12099018352Bence Haromi007-0.5aido-LFI-sim-testingsim-0of4failedyeseval020:01:18
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12098718352Bence Haromi007-0.5aido-LFI-sim-testingsim-1of4failedyeseval020:01:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12098418352Bence Haromi007-0.5aido-LFI-sim-testingsim-1of4failedyeseval020:01:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12097818352Bence Haromi007-0.5aido-LFI-sim-testingsim-2of4successyeseval020:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12097518352Bence Haromi007-0.5aido-LFI-sim-testingsim-0of4failedyeseval020:01:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12097118340Bence Haromi005-0.8aido-LFI-sim-testingsim-3of4successyeseval020:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12096818340Bence Haromi005-0.8aido-LFI-sim-testingsim-3of4successyeseval020:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12096418340Bence Haromi005-0.8aido-LFI-sim-testingsim-3of4successyeseval020:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12096018340Bence Haromi005-0.8aido-LFI-sim-testingsim-3of4successyeseval020:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12095718340Bence Haromi005-0.8aido-LFI-sim-testingsim-3of4successyeseval020:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12095018354Bence Haromi007-0.5aido-LFV-sim-testingsim-3of4successyeseval020:05:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median17.050000000000107
in-drivable-lane_median0.0
driven_lanedir_consec_median3.9548146025423616
deviation-center-line_median0.44063028996316106


other stats
deviation-center-line_max0.44063028996316106
deviation-center-line_mean0.44063028996316106
deviation-center-line_min0.44063028996316106
deviation-heading_max2.0155256359101457
deviation-heading_mean2.0155256359101457
deviation-heading_median2.0155256359101457
deviation-heading_min2.0155256359101457
distance-from-start_max3.224478127990345
distance-from-start_mean3.224478127990345
distance-from-start_median3.224478127990345
distance-from-start_min3.224478127990345
driven_any_max3.990271013413557
driven_any_mean3.990271013413557
driven_any_median3.990271013413557
driven_any_min3.990271013413557
driven_lanedir_consec_max3.9548146025423616
driven_lanedir_consec_mean3.9548146025423616
driven_lanedir_consec_min3.9548146025423616
driven_lanedir_max3.9548146025423616
driven_lanedir_mean3.9548146025423616
driven_lanedir_median3.9548146025423616
driven_lanedir_min3.9548146025423616
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 3.990271013413557, "survival_time": 17.050000000000107, "driven_lanedir": 3.9548146025423616, "in-drivable-lane": 0.0, "deviation-heading": 2.0155256359101457, "distance-from-start": 3.224478127990345, "deviation-center-line": 0.44063028996316106, "driven_lanedir_consec": 3.9548146025423616}}
simulation-passed1
survival_time_max17.050000000000107
survival_time_mean17.050000000000107
survival_time_min17.050000000000107
No reset possible
12094818358András Kalapos 🇭🇺Ep. VI: Return of 3092 v0.6aido-LFI-sim-testingsim-0of4failedyeseval020:01:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12094518358András Kalapos 🇭🇺Ep. VI: Return of 3092 v0.6aido-LFI-sim-testingsim-0of4failedyeseval020:01:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12093618339Sampsa RantaQuack² - Hello Worldaido-LF-sim-validationsim-3of4successyeseval020:06:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.140952878121951
survival_time_median59.99999999999873
deviation-center-line_median1.9478543670472237
in-drivable-lane_median0.0


other stats
deviation-center-line_max1.9478543670472237
deviation-center-line_mean1.9478543670472237
deviation-center-line_min1.9478543670472237
deviation-heading_max7.862937803858489
deviation-heading_mean7.862937803858489
deviation-heading_median7.862937803858489
deviation-heading_min7.862937803858489
distance-from-start_max3.528731580592184
distance-from-start_mean3.528731580592184
distance-from-start_median3.528731580592184
distance-from-start_min3.528731580592184
driven_any_max6.243104994168058
driven_any_mean6.243104994168058
driven_any_median6.243104994168058
driven_any_min6.243104994168058
driven_lanedir_consec_max6.140952878121951
driven_lanedir_consec_mean6.140952878121951
driven_lanedir_consec_min6.140952878121951
driven_lanedir_max6.140952878121951
driven_lanedir_mean6.140952878121951
driven_lanedir_median6.140952878121951
driven_lanedir_min6.140952878121951
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.243104994168058, "survival_time": 59.99999999999873, "driven_lanedir": 6.140952878121951, "in-drivable-lane": 0.0, "deviation-heading": 7.862937803858489, "distance-from-start": 3.528731580592184, "deviation-center-line": 1.9478543670472237, "driven_lanedir_consec": 6.140952878121951}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12093118333Bence Haromi007-0.5aido-LFI-sim-validationsim-1of4successyeseval020:03:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median23.4500000000002
in-drivable-lane_median0.0
driven_lanedir_consec_median5.545972154695326
deviation-center-line_median0.9254605753033875


other stats
deviation-center-line_max0.9254605753033875
deviation-center-line_mean0.9254605753033875
deviation-center-line_min0.9254605753033875
deviation-heading_max3.7902241860487775
deviation-heading_mean3.7902241860487775
deviation-heading_median3.7902241860487775
deviation-heading_min3.7902241860487775
distance-from-start_max2.1979788989920115
distance-from-start_mean2.1979788989920115
distance-from-start_median2.1979788989920115
distance-from-start_min2.1979788989920115
driven_any_max5.655596930291899
driven_any_mean5.655596930291899
driven_any_median5.655596930291899
driven_any_min5.655596930291899
driven_lanedir_consec_max5.545972154695326
driven_lanedir_consec_mean5.545972154695326
driven_lanedir_consec_min5.545972154695326
driven_lanedir_max5.5571759591804355
driven_lanedir_mean5.5571759591804355
driven_lanedir_median5.5571759591804355
driven_lanedir_min5.5571759591804355
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-000-ego0": {"driven_any": 5.655596930291899, "survival_time": 23.4500000000002, "driven_lanedir": 5.5571759591804355, "in-drivable-lane": 0.0, "deviation-heading": 3.7902241860487775, "distance-from-start": 2.1979788989920115, "deviation-center-line": 0.9254605753033875, "driven_lanedir_consec": 5.545972154695326}}
simulation-passed1
survival_time_max23.4500000000002
survival_time_mean23.4500000000002
survival_time_min23.4500000000002
No reset possible
12092718358András Kalapos 🇭🇺Ep. VI: Return of 3092 v0.6aido-LFI-sim-testingsim-1of4host-erroryeseval020:01:16
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12092018344Bence Haromi005-0.8aido-LFV-sim-testingsim-1of4successyeseval020:02:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.599999999999981
in-drivable-lane_median0.0
driven_lanedir_consec_median2.551917729913193
deviation-center-line_median0.4782362271264052


other stats
deviation-center-line_max0.4782362271264052
deviation-center-line_mean0.4782362271264052
deviation-center-line_min0.4782362271264052
deviation-heading_max1.6092549801698075
deviation-heading_mean1.6092549801698075
deviation-heading_median1.6092549801698075
deviation-heading_min1.6092549801698075
distance-from-start_max1.839972516128214
distance-from-start_mean1.839972516128214
distance-from-start_median1.839972516128214
distance-from-start_min1.839972516128214
driven_any_max2.6271546266974526
driven_any_mean2.6271546266974526
driven_any_median2.6271546266974526
driven_any_min2.6271546266974526
driven_lanedir_consec_max2.551917729913193
driven_lanedir_consec_mean2.551917729913193
driven_lanedir_consec_min2.551917729913193
driven_lanedir_max2.551917729913193
driven_lanedir_mean2.551917729913193
driven_lanedir_median2.551917729913193
driven_lanedir_min2.551917729913193
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.6271546266974526, "survival_time": 7.599999999999981, "driven_lanedir": 2.551917729913193, "in-drivable-lane": 0.0, "deviation-heading": 1.6092549801698075, "distance-from-start": 1.839972516128214, "deviation-center-line": 0.4782362271264052, "driven_lanedir_consec": 2.551917729913193}}
simulation-passed1
survival_time_max7.599999999999981
survival_time_mean7.599999999999981
survival_time_min7.599999999999981
No reset possible
12091518344Bence Haromi005-0.8aido-LFV-sim-testingsim-1of4successyeseval020:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.499999999999981
in-drivable-lane_median0.0
driven_lanedir_consec_median2.542879338102871
deviation-center-line_median0.431991617498446


other stats
deviation-center-line_max0.431991617498446
deviation-center-line_mean0.431991617498446
deviation-center-line_min0.431991617498446
deviation-heading_max1.4216140583807078
deviation-heading_mean1.4216140583807078
deviation-heading_median1.4216140583807078
deviation-heading_min1.4216140583807078
distance-from-start_max1.8245474127063783
distance-from-start_mean1.8245474127063783
distance-from-start_median1.8245474127063783
distance-from-start_min1.8245474127063783
driven_any_max2.606944051221462
driven_any_mean2.606944051221462
driven_any_median2.606944051221462
driven_any_min2.606944051221462
driven_lanedir_consec_max2.542879338102871
driven_lanedir_consec_mean2.542879338102871
driven_lanedir_consec_min2.542879338102871
driven_lanedir_max2.542879338102871
driven_lanedir_mean2.542879338102871
driven_lanedir_median2.542879338102871
driven_lanedir_min2.542879338102871
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.606944051221462, "survival_time": 7.499999999999981, "driven_lanedir": 2.542879338102871, "in-drivable-lane": 0.0, "deviation-heading": 1.4216140583807078, "distance-from-start": 1.8245474127063783, "deviation-center-line": 0.431991617498446, "driven_lanedir_consec": 2.542879338102871}}
simulation-passed1
survival_time_max7.499999999999981
survival_time_mean7.499999999999981
survival_time_min7.499999999999981
No reset possible
12091218358András Kalapos 🇭🇺Ep. VI: Return of 3092 v0.6aido-LFI-sim-testingsim-3of4successyeseval020:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12090918358András Kalapos 🇭🇺Ep. VI: Return of 3092 v0.6aido-LFI-sim-testingsim-3of4successyeseval020:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12090418335Bence Haromi007-0.5aido-LFV-sim-validationsim-1of4successyeseval020:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.45
in-drivable-lane_median0.0
driven_lanedir_consec_median2.2193649004533347
deviation-center-line_median0.22519514515634392


other stats
deviation-center-line_max0.22519514515634392
deviation-center-line_mean0.22519514515634392
deviation-center-line_min0.22519514515634392
deviation-heading_max0.91251873635518
deviation-heading_mean0.91251873635518
deviation-heading_median0.91251873635518
deviation-heading_min0.91251873635518
distance-from-start_max1.630438987676335
distance-from-start_mean1.630438987676335
distance-from-start_median1.630438987676335
distance-from-start_min1.630438987676335
driven_any_max2.230424377087085
driven_any_mean2.230424377087085
driven_any_median2.230424377087085
driven_any_min2.230424377087085
driven_lanedir_consec_max2.2193649004533347
driven_lanedir_consec_mean2.2193649004533347
driven_lanedir_consec_min2.2193649004533347
driven_lanedir_max2.2193649004533347
driven_lanedir_mean2.2193649004533347
driven_lanedir_median2.2193649004533347
driven_lanedir_min2.2193649004533347
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.230424377087085, "survival_time": 9.45, "driven_lanedir": 2.2193649004533347, "in-drivable-lane": 0.0, "deviation-heading": 0.91251873635518, "distance-from-start": 1.630438987676335, "deviation-center-line": 0.22519514515634392, "driven_lanedir_consec": 2.2193649004533347}}
simulation-passed1
survival_time_max9.45
survival_time_mean9.45
survival_time_min9.45
No reset possible
12090118336Bence Haromi007-0.5aido-LFVI-sim-validationsim-3of4successyeseval020:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12089718336Bence Haromi007-0.5aido-LFVI-sim-validationsim-3of4successyeseval020:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12089618341Bence Haromi005-0.8aido-LFI-sim-validationsim-3of4successyeseval020:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12089218341Bence Haromi005-0.8aido-LFI-sim-validationsim-3of4successyeseval020:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12088818341Bence Haromi005-0.8aido-LFI-sim-validationsim-3of4successyeseval020:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12088418341Bence Haromi005-0.8aido-LFI-sim-validationsim-3of4successyeseval020:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12088118341Bence Haromi005-0.8aido-LFI-sim-validationsim-3of4successyeseval020:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12087718348Bence Haromi005-0.8aido-LFVI_multi-sim-testingsim-3of4successyeseval020:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12087318348Bence Haromi005-0.8aido-LFVI_multi-sim-testingsim-3of4successyeseval020:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12086918348Bence Haromi005-0.8aido-LFVI_multi-sim-testingsim-0of4failedyeseval020:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12086318359András Kalapos 🇭🇺Ep. VI: Return of 3092 v0.6aido-LFI-sim-validationsim-0of4successyeseval020:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.3499999999999925
in-drivable-lane_median0.0
driven_lanedir_consec_median0.7018819246954158
deviation-center-line_median0.29044496154698257


other stats
deviation-center-line_max0.29044496154698257
deviation-center-line_mean0.29044496154698257
deviation-center-line_min0.29044496154698257
deviation-heading_max2.108133704912972
deviation-heading_mean2.108133704912972
deviation-heading_median2.108133704912972
deviation-heading_min2.108133704912972
distance-from-start_max1.0018933786477042
distance-from-start_mean1.0018933786477042
distance-from-start_median1.0018933786477042
distance-from-start_min1.0018933786477042
driven_any_max1.0150077152450203
driven_any_mean1.0150077152450203
driven_any_median1.0150077152450203
driven_any_min1.0150077152450203
driven_lanedir_consec_max0.7018819246954158
driven_lanedir_consec_mean0.7018819246954158
driven_lanedir_consec_min0.7018819246954158
driven_lanedir_max0.9321551649112196
driven_lanedir_mean0.9321551649112196
driven_lanedir_median0.9321551649112196
driven_lanedir_min0.9321551649112196
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 1.0150077152450203, "survival_time": 4.3499999999999925, "driven_lanedir": 0.9321551649112196, "in-drivable-lane": 0.0, "deviation-heading": 2.108133704912972, "distance-from-start": 1.0018933786477042, "deviation-center-line": 0.29044496154698257, "driven_lanedir_consec": 0.7018819246954158}}
simulation-passed1
survival_time_max4.3499999999999925
survival_time_mean4.3499999999999925
survival_time_min4.3499999999999925
No reset possible
12086018359András Kalapos 🇭🇺Ep. VI: Return of 3092 v0.6aido-LFI-sim-validationsim-0of4successyeseval020:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.799999999999991
in-drivable-lane_median1.699999999999994
driven_lanedir_consec_median0.7143038558121206
deviation-center-line_median0.12056422695542084


other stats
deviation-center-line_max0.12056422695542084
deviation-center-line_mean0.12056422695542084
deviation-center-line_min0.12056422695542084
deviation-heading_max0.6663646160118463
deviation-heading_mean0.6663646160118463
deviation-heading_median0.6663646160118463
deviation-heading_min0.6663646160118463
distance-from-start_max1.0151795306568667
distance-from-start_mean1.0151795306568667
distance-from-start_median1.0151795306568667
distance-from-start_min1.0151795306568667
driven_any_max1.0964055171988196
driven_any_mean1.0964055171988196
driven_any_median1.0964055171988196
driven_any_min1.0964055171988196
driven_lanedir_consec_max0.7143038558121206
driven_lanedir_consec_mean0.7143038558121206
driven_lanedir_consec_min0.7143038558121206
driven_lanedir_max0.8341392893713948
driven_lanedir_mean0.8341392893713948
driven_lanedir_median0.8341392893713948
driven_lanedir_min0.8341392893713948
in-drivable-lane_max1.699999999999994
in-drivable-lane_mean1.699999999999994
in-drivable-lane_min1.699999999999994
per-episodes
details{"4way-000-ego0": {"driven_any": 1.0964055171988196, "survival_time": 4.799999999999991, "driven_lanedir": 0.8341392893713948, "in-drivable-lane": 1.699999999999994, "deviation-heading": 0.6663646160118463, "distance-from-start": 1.0151795306568667, "deviation-center-line": 0.12056422695542084, "driven_lanedir_consec": 0.7143038558121206}}
simulation-passed1
survival_time_max4.799999999999991
survival_time_mean4.799999999999991
survival_time_min4.799999999999991
No reset possible
12085518350Bence Haromi005-0.8aido-LFV_multi-sim-testingsim-1of4failedyeseval020:01:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12085118350Bence Haromi005-0.8aido-LFV_multi-sim-testingsim-3of4failedyeseval020:01:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12084618350Bence Haromi005-0.8aido-LFV_multi-sim-testingsim-0of4failedyeseval020:01:04
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12084018345Bence Haromi005-0.8aido-LFV-sim-validationsim-2of4successyeseval020:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.249999999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median1.0986470652739595
deviation-center-line_median0.35019177563058573


other stats
deviation-center-line_max0.35019177563058573
deviation-center-line_mean0.35019177563058573
deviation-center-line_min0.35019177563058573
deviation-heading_max1.5206019008278542
deviation-heading_mean1.5206019008278542
deviation-heading_median1.5206019008278542
deviation-heading_min1.5206019008278542
distance-from-start_max0.8261352017053782
distance-from-start_mean0.8261352017053782
distance-from-start_median0.8261352017053782
distance-from-start_min0.8261352017053782
driven_any_max1.2126034404211403
driven_any_mean1.2126034404211403
driven_any_median1.2126034404211403
driven_any_min1.2126034404211403
driven_lanedir_consec_max1.0986470652739595
driven_lanedir_consec_mean1.0986470652739595
driven_lanedir_consec_min1.0986470652739595
driven_lanedir_max1.0986470652739595
driven_lanedir_mean1.0986470652739595
driven_lanedir_median1.0986470652739595
driven_lanedir_min1.0986470652739595
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.2126034404211403, "survival_time": 4.249999999999993, "driven_lanedir": 1.0986470652739595, "in-drivable-lane": 0.0, "deviation-heading": 1.5206019008278542, "distance-from-start": 0.8261352017053782, "deviation-center-line": 0.35019177563058573, "driven_lanedir_consec": 1.0986470652739595}}
simulation-passed1
survival_time_max4.249999999999993
survival_time_mean4.249999999999993
survival_time_min4.249999999999993
No reset possible
12083618345Bence Haromi005-0.8aido-LFV-sim-validationsim-2of4successyeseval020:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8499999999999943
in-drivable-lane_median0.0
driven_lanedir_consec_median0.9782894245275048
deviation-center-line_median0.29248756967266215


other stats
deviation-center-line_max0.29248756967266215
deviation-center-line_mean0.29248756967266215
deviation-center-line_min0.29248756967266215
deviation-heading_max1.4681222470940436
deviation-heading_mean1.4681222470940436
deviation-heading_median1.4681222470940436
deviation-heading_min1.4681222470940436
distance-from-start_max0.7571258816976838
distance-from-start_mean0.7571258816976838
distance-from-start_median0.7571258816976838
distance-from-start_min0.7571258816976838
driven_any_max1.0728198734790912
driven_any_mean1.0728198734790912
driven_any_median1.0728198734790912
driven_any_min1.0728198734790912
driven_lanedir_consec_max0.9782894245275048
driven_lanedir_consec_mean0.9782894245275048
driven_lanedir_consec_min0.9782894245275048
driven_lanedir_max0.9782894245275048
driven_lanedir_mean0.9782894245275048
driven_lanedir_median0.9782894245275048
driven_lanedir_min0.9782894245275048
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.0728198734790912, "survival_time": 3.8499999999999943, "driven_lanedir": 0.9782894245275048, "in-drivable-lane": 0.0, "deviation-heading": 1.4681222470940436, "distance-from-start": 0.7571258816976838, "deviation-center-line": 0.29248756967266215, "driven_lanedir_consec": 0.9782894245275048}}
simulation-passed1
survival_time_max3.8499999999999943
survival_time_mean3.8499999999999943
survival_time_min3.8499999999999943
No reset possible
12083218345Bence Haromi005-0.8aido-LFV-sim-validationsim-2of4successyeseval020:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.199999999999993
in-drivable-lane_median0.0
driven_lanedir_consec_median1.0792729728856234
deviation-center-line_median0.35564203756150287


other stats
deviation-center-line_max0.35564203756150287
deviation-center-line_mean0.35564203756150287
deviation-center-line_min0.35564203756150287
deviation-heading_max1.5090345964086358
deviation-heading_mean1.5090345964086358
deviation-heading_median1.5090345964086358
deviation-heading_min1.5090345964086358
distance-from-start_max0.8295242010684549
distance-from-start_mean0.8295242010684549
distance-from-start_median0.8295242010684549
distance-from-start_min0.8295242010684549
driven_any_max1.1996869044019376
driven_any_mean1.1996869044019376
driven_any_median1.1996869044019376
driven_any_min1.1996869044019376
driven_lanedir_consec_max1.0792729728856234
driven_lanedir_consec_mean1.0792729728856234
driven_lanedir_consec_min1.0792729728856234
driven_lanedir_max1.0792729728856234
driven_lanedir_mean1.0792729728856234
driven_lanedir_median1.0792729728856234
driven_lanedir_min1.0792729728856234
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 1.1996869044019376, "survival_time": 4.199999999999993, "driven_lanedir": 1.0792729728856234, "in-drivable-lane": 0.0, "deviation-heading": 1.5090345964086358, "distance-from-start": 0.8295242010684549, "deviation-center-line": 0.35564203756150287, "driven_lanedir_consec": 1.0792729728856234}}
simulation-passed1
survival_time_max4.199999999999993
survival_time_mean4.199999999999993
survival_time_min4.199999999999993
No reset possible
12083018347Bence Haromi005-0.8aido-LFVI-sim-validationsim-2of4successyeseval020:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12082618347Bence Haromi005-0.8aido-LFVI-sim-validationsim-2of4successyeseval020:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12082318347Bence Haromi005-0.8aido-LFVI-sim-validationsim-2of4successyeseval020:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12081918347Bence Haromi005-0.8aido-LFVI-sim-validationsim-2of4successyeseval020:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12081418347Bence Haromi005-0.8aido-LFVI-sim-validationsim-0of4failedyeseval020:01:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12080918347Bence Haromi005-0.8aido-LFVI-sim-validationsim-0of4failedyeseval020:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12080518347Bence Haromi005-0.8aido-LFVI-sim-validationsim-0of4failedyeseval020:01:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12080018356Bence Haromi007-0.5aido-LFVI_multi-sim-testingsim-2of4successyeseval020:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12078118351Bence Haromi005-0.8aido-LFV_multi-sim-validationsim-0of4successyeseval020:24:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median2.499999999999938
driven_lanedir_consec_median21.302451367796756
deviation-center-line_median3.6539223044327582


other stats
deviation-center-line_max3.7811469819327375
deviation-center-line_mean2.7894325967699287
deviation-center-line_min0.06873879628145992
deviation-heading_max15.140032971473795
deviation-heading_mean10.756398381790971
deviation-heading_median13.751045215772391
deviation-heading_min0.38347012414530335
distance-from-start_max4.063962786080528
distance-from-start_mean2.9312908419343726
distance-from-start_median3.261707730789351
distance-from-start_min1.1377851200782607
driven_any_max23.34521550699338
driven_any_mean17.736335220450712
driven_any_median23.218633110530863
driven_any_min1.1628591537477424
driven_lanedir_consec_max21.60500072251436
driven_lanedir_consec_mean16.100278818708112
driven_lanedir_consec_min0.191211816724578
driven_lanedir_max21.60500072251436
driven_lanedir_mean16.100278818708112
driven_lanedir_median21.302451367796756
driven_lanedir_min0.191211816724578
in-drivable-lane_max59.19999999999872
in-drivable-lane_mean16.487499999999642
in-drivable-lane_min1.7499999999999654
per-episodes
details{"autolab-000-ego0": {"driven_any": 23.198357979885063, "survival_time": 59.99999999999873, "driven_lanedir": 21.60500072251436, "in-drivable-lane": 1.7499999999999654, "deviation-heading": 13.880586644999362, "distance-from-start": 4.063962786080528, "deviation-center-line": 3.6668676998953327, "driven_lanedir_consec": 21.60500072251436}, "autolab-000-ego1": {"driven_any": 1.1628591537477424, "survival_time": 59.99999999999873, "driven_lanedir": 0.191211816724578, "in-drivable-lane": 59.19999999999872, "deviation-heading": 0.38347012414530335, "distance-from-start": 1.1377851200782607, "deviation-center-line": 0.06873879628145992, "driven_lanedir_consec": 0.191211816724578}, "autolab-000-ego2": {"driven_any": 23.34521550699338, "survival_time": 59.99999999999873, "driven_lanedir": 21.56246427719345, "in-drivable-lane": 2.2999999999999474, "deviation-heading": 13.621503786545423, "distance-from-start": 2.806419086934095, "deviation-center-line": 3.6409769089701847, "driven_lanedir_consec": 21.56246427719345}, "autolab-000-ego3": {"driven_any": 23.238908241176663, "survival_time": 59.99999999999873, "driven_lanedir": 21.042438458400067, "in-drivable-lane": 2.699999999999928, "deviation-heading": 15.140032971473795, "distance-from-start": 3.7169963746446073, "deviation-center-line": 3.7811469819327375, "driven_lanedir_consec": 21.042438458400067}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12077618337Bence Haromi007-0.5aido-LFVI_multi-sim-validationsim-3of4successyeseval020:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12077218336Bence Haromi007-0.5aido-LFVI-sim-validationsim-2of4successyeseval020:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12076718337Bence Haromi007-0.5aido-LFVI_multi-sim-validationsim-3of4successyeseval020:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12076018337Bence Haromi007-0.5aido-LFVI_multi-sim-validationsim-0of4successyeseval020:06:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median19.850000000000147
in-drivable-lane_median0.0
driven_lanedir_consec_median0.8079875654767658
deviation-center-line_median1.3403255284640434


other stats
deviation-center-line_max2.081026057543971
deviation-center-line_mean1.3766355028647774
deviation-center-line_min0.7448648969870517
deviation-heading_max12.500914270519642
deviation-heading_mean7.992194870084416
deviation-heading_median8.236179640893397
deviation-heading_min2.9955059280312306
distance-from-start_max2.220001240215035
distance-from-start_mean1.0263650819667285
distance-from-start_median0.6987675477802161
distance-from-start_min0.48792399209144566
driven_any_max4.6902143645704735
driven_any_mean1.7212424028002822
driven_any_median0.8474530791663144
driven_any_min0.4998490882980258
driven_lanedir_consec_max4.5861933158931025
driven_lanedir_consec_mean1.6704416890863154
driven_lanedir_consec_min0.4795983094986278
driven_lanedir_max4.601942176028712
driven_lanedir_mean1.6743908618319057
driven_lanedir_median0.8079875654767658
driven_lanedir_min0.4796461403453791
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem-000-ego0": {"driven_any": 4.6902143645704735, "survival_time": 19.850000000000147, "driven_lanedir": 4.601942176028712, "in-drivable-lane": 0.0, "deviation-heading": 2.9955059280312306, "distance-from-start": 2.220001240215035, "deviation-center-line": 0.7814042194307284, "driven_lanedir_consec": 4.5861933158931025}, "udem-000-ego1": {"driven_any": 1.166993934822271, "survival_time": 19.850000000000147, "driven_lanedir": 1.127250929175901, "in-drivable-lane": 0.0, "deviation-heading": 4.854547123658792, "distance-from-start": 0.9048223771174332, "deviation-center-line": 0.7448648969870517, "driven_lanedir_consec": 1.127250929175901}, "udem-000-ego2": {"driven_any": 0.4998490882980258, "survival_time": 19.850000000000147, "driven_lanedir": 0.4796461403453791, "in-drivable-lane": 0.0, "deviation-heading": 11.617812158128004, "distance-from-start": 0.48792399209144566, "deviation-center-line": 1.8992468374973583, "driven_lanedir_consec": 0.4795983094986278}, "udem-000-ego3": {"driven_any": 0.5279122235103575, "survival_time": 19.850000000000147, "driven_lanedir": 0.48872420177763054, "in-drivable-lane": 0.0, "deviation-heading": 12.500914270519642, "distance-from-start": 0.4927127184429991, "deviation-center-line": 2.081026057543971, "driven_lanedir_consec": 0.48872420177763054}}
simulation-passed1
survival_time_max19.850000000000147
survival_time_mean19.850000000000147
survival_time_min19.850000000000147
No reset possible
12075518338Bence Haromi007-0.5aido-LFV_multi-sim-validationsim-1of4successyeseval020:17:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median16.203515715344956
deviation-center-line_median1.2153011731140753


other stats
deviation-center-line_max1.884306464209488
deviation-center-line_mean1.374205334690119
deviation-center-line_min1.181912528322837
deviation-heading_max4.747968241606541
deviation-heading_mean3.443223241978504
deviation-heading_median3.2666210335109716
deviation-heading_min2.4916826592855323
distance-from-start_max3.242283016763647
distance-from-start_mean2.762995695448721
distance-from-start_median2.893151859134758
distance-from-start_min2.023396046761719
driven_any_max16.51251383714238
driven_any_mean16.265243008955014
driven_any_median16.24886108330339
driven_any_min16.05073603207091
driven_lanedir_consec_max16.483614505409218
driven_lanedir_consec_mean16.21451993527371
driven_lanedir_consec_min15.967433804995707
driven_lanedir_max16.483614505409218
driven_lanedir_mean16.21451993527371
driven_lanedir_median16.203515715344956
driven_lanedir_min15.967433804995707
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 16.05073603207091, "survival_time": 59.99999999999873, "driven_lanedir": 15.967433804995707, "in-drivable-lane": 0.0, "deviation-heading": 4.747968241606541, "distance-from-start": 2.023396046761719, "deviation-center-line": 1.884306464209488, "driven_lanedir_consec": 15.967433804995707}, "loop-000-ego1": {"driven_any": 16.185559591061285, "survival_time": 59.99999999999873, "driven_lanedir": 16.13827952692362, "in-drivable-lane": 0.0, "deviation-heading": 3.3391469873300768, "distance-from-start": 3.239666500036515, "deviation-center-line": 1.2031036641205173, "driven_lanedir_consec": 16.13827952692362}, "loop-000-ego2": {"driven_any": 16.51251383714238, "survival_time": 59.99999999999873, "driven_lanedir": 16.483614505409218, "in-drivable-lane": 0.0, "deviation-heading": 2.4916826592855323, "distance-from-start": 3.242283016763647, "deviation-center-line": 1.181912528322837, "driven_lanedir_consec": 16.483614505409218}, "loop-000-ego3": {"driven_any": 16.31216257554549, "survival_time": 59.99999999999873, "driven_lanedir": 16.268751903766297, "in-drivable-lane": 0.0, "deviation-heading": 3.194095079691867, "distance-from-start": 2.546637218233001, "deviation-center-line": 1.2274986821076332, "driven_lanedir_consec": 16.268751903766297}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12074918334Bence Haromi007-0.5aido-LFP-sim-validationsim-3of4successyeseval020:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.850000000000048
in-drivable-lane_median0.0
driven_lanedir_consec_median2.7825961232815852
deviation-center-line_median0.45313222905376493


other stats
deviation-center-line_max0.45313222905376493
deviation-center-line_mean0.45313222905376493
deviation-center-line_min0.45313222905376493
deviation-heading_max2.1291623858042854
deviation-heading_mean2.1291623858042854
deviation-heading_median2.1291623858042854
deviation-heading_min2.1291623858042854
distance-from-start_max2.4169462261199515
distance-from-start_mean2.4169462261199515
distance-from-start_median2.4169462261199515
distance-from-start_min2.4169462261199515
driven_any_max2.8375003674126185
driven_any_mean2.8375003674126185
driven_any_median2.8375003674126185
driven_any_min2.8375003674126185
driven_lanedir_consec_max2.7825961232815852
driven_lanedir_consec_mean2.7825961232815852
driven_lanedir_consec_min2.7825961232815852
driven_lanedir_max2.7825961232815852
driven_lanedir_mean2.7825961232815852
driven_lanedir_median2.7825961232815852
driven_lanedir_min2.7825961232815852
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 2.8375003674126185, "survival_time": 12.850000000000048, "driven_lanedir": 2.7825961232815852, "in-drivable-lane": 0.0, "deviation-heading": 2.1291623858042854, "distance-from-start": 2.4169462261199515, "deviation-center-line": 0.45313222905376493, "driven_lanedir_consec": 2.7825961232815852}}
simulation-passed1
survival_time_max12.850000000000048
survival_time_mean12.850000000000048
survival_time_min12.850000000000048
No reset possible
12074718332Sampsa RantaQuack² - Hello Worldaido-LF-sim-validationsim-2of4successyeseval020:06:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.961760695372714
survival_time_median59.99999999999873
deviation-center-line_median2.783566169579293
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.783566169579293
deviation-center-line_mean2.783566169579293
deviation-center-line_min2.783566169579293
deviation-heading_max13.856393880865134
deviation-heading_mean13.856393880865134
deviation-heading_median13.856393880865134
deviation-heading_min13.856393880865134
distance-from-start_max0.9908203389363786
distance-from-start_mean0.9908203389363786
distance-from-start_median0.9908203389363786
distance-from-start_min0.9908203389363786
driven_any_max6.243084959153576
driven_any_mean6.243084959153576
driven_any_median6.243084959153576
driven_any_min6.243084959153576
driven_lanedir_consec_max5.961760695372714
driven_lanedir_consec_mean5.961760695372714
driven_lanedir_consec_min5.961760695372714
driven_lanedir_max5.961760695372714
driven_lanedir_mean5.961760695372714
driven_lanedir_median5.961760695372714
driven_lanedir_min5.961760695372714
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.243084959153576, "survival_time": 59.99999999999873, "driven_lanedir": 5.961760695372714, "in-drivable-lane": 0.0, "deviation-heading": 13.856393880865134, "distance-from-start": 0.9908203389363786, "deviation-center-line": 2.783566169579293, "driven_lanedir_consec": 5.961760695372714}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12074118332Sampsa RantaQuack² - Hello Worldaido-LF-sim-validationsim-2of4successyeseval020:06:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.955019803256439
survival_time_median59.99999999999873
deviation-center-line_median2.777564616685765
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.777564616685765
deviation-center-line_mean2.777564616685765
deviation-center-line_min2.777564616685765
deviation-heading_max13.961608776822777
deviation-heading_mean13.961608776822777
deviation-heading_median13.961608776822777
deviation-heading_min13.961608776822777
distance-from-start_max0.991452913457446
distance-from-start_mean0.991452913457446
distance-from-start_median0.991452913457446
distance-from-start_min0.991452913457446
driven_any_max6.237845333761331
driven_any_mean6.237845333761331
driven_any_median6.237845333761331
driven_any_min6.237845333761331
driven_lanedir_consec_max5.955019803256439
driven_lanedir_consec_mean5.955019803256439
driven_lanedir_consec_min5.955019803256439
driven_lanedir_max5.955019803256439
driven_lanedir_mean5.955019803256439
driven_lanedir_median5.955019803256439
driven_lanedir_min5.955019803256439
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.237845333761331, "survival_time": 59.99999999999873, "driven_lanedir": 5.955019803256439, "in-drivable-lane": 0.0, "deviation-heading": 13.961608776822777, "distance-from-start": 0.991452913457446, "deviation-center-line": 2.777564616685765, "driven_lanedir_consec": 5.955019803256439}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12073918331Sampsa RantaQuack² - Hello Worldaido-LF-sim-validationsim-0of4successyeseval020:05:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.209675723693849
survival_time_median59.99999999999873
deviation-center-line_median1.1149900651483875
in-drivable-lane_median0.0


other stats
deviation-center-line_max1.1149900651483875
deviation-center-line_mean1.1149900651483875
deviation-center-line_min1.1149900651483875
deviation-heading_max3.949609596987437
deviation-heading_mean3.949609596987437
deviation-heading_median3.949609596987437
deviation-heading_min3.949609596987437
distance-from-start_max2.5483865171015463
distance-from-start_mean2.5483865171015463
distance-from-start_median2.5483865171015463
distance-from-start_min2.5483865171015463
driven_any_max6.237927320990144
driven_any_mean6.237927320990144
driven_any_median6.237927320990144
driven_any_min6.237927320990144
driven_lanedir_consec_max6.209675723693849
driven_lanedir_consec_mean6.209675723693849
driven_lanedir_consec_min6.209675723693849
driven_lanedir_max6.209675723693849
driven_lanedir_mean6.209675723693849
driven_lanedir_median6.209675723693849
driven_lanedir_min6.209675723693849
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.237927320990144, "survival_time": 59.99999999999873, "driven_lanedir": 6.209675723693849, "in-drivable-lane": 0.0, "deviation-heading": 3.949609596987437, "distance-from-start": 2.5483865171015463, "deviation-center-line": 1.1149900651483875, "driven_lanedir_consec": 6.209675723693849}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12073518331Sampsa RantaQuack² - Hello Worldaido-LF-sim-validationsim-1of4successyeseval020:06:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.07738510388311
survival_time_median59.99999999999873
deviation-center-line_median2.102661221480062
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.102661221480062
deviation-center-line_mean2.102661221480062
deviation-center-line_min2.102661221480062
deviation-heading_max8.464842798356301
deviation-heading_mean8.464842798356301
deviation-heading_median8.464842798356301
deviation-heading_min8.464842798356301
distance-from-start_max2.48816704742224
distance-from-start_mean2.48816704742224
distance-from-start_median2.48816704742224
distance-from-start_min2.48816704742224
driven_any_max6.237886494501111
driven_any_mean6.237886494501111
driven_any_median6.237886494501111
driven_any_min6.237886494501111
driven_lanedir_consec_max6.07738510388311
driven_lanedir_consec_mean6.07738510388311
driven_lanedir_consec_min6.07738510388311
driven_lanedir_max6.07738510388311
driven_lanedir_mean6.07738510388311
driven_lanedir_median6.07738510388311
driven_lanedir_min6.07738510388311
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 6.237886494501111, "survival_time": 59.99999999999873, "driven_lanedir": 6.07738510388311, "in-drivable-lane": 0.0, "deviation-heading": 8.464842798356301, "distance-from-start": 2.48816704742224, "deviation-center-line": 2.102661221480062, "driven_lanedir_consec": 6.07738510388311}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12072718330Sampsa RantaQuack² - Hello Worldaido-LF-sim-validationsim-2of4successyeseval020:05:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.9000101243102785
survival_time_median59.99999999999873
deviation-center-line_median4.131573460570111
in-drivable-lane_median0.0


other stats
deviation-center-line_max4.131573460570111
deviation-center-line_mean4.131573460570111
deviation-center-line_min4.131573460570111
deviation-heading_max14.686946834012591
deviation-heading_mean14.686946834012591
deviation-heading_median14.686946834012591
deviation-heading_min14.686946834012591
distance-from-start_max0.9764127438959244
distance-from-start_mean0.9764127438959244
distance-from-start_median0.9764127438959244
distance-from-start_min0.9764127438959244
driven_any_max6.237816873835532
driven_any_mean6.237816873835532
driven_any_median6.237816873835532
driven_any_min6.237816873835532
driven_lanedir_consec_max5.9000101243102785
driven_lanedir_consec_mean5.9000101243102785
driven_lanedir_consec_min5.9000101243102785
driven_lanedir_max5.9000101243102785
driven_lanedir_mean5.9000101243102785
driven_lanedir_median5.9000101243102785
driven_lanedir_min5.9000101243102785
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.237816873835532, "survival_time": 59.99999999999873, "driven_lanedir": 5.9000101243102785, "in-drivable-lane": 0.0, "deviation-heading": 14.686946834012591, "distance-from-start": 0.9764127438959244, "deviation-center-line": 4.131573460570111, "driven_lanedir_consec": 5.9000101243102785}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12072418320Andras BeresI work in reality! (full state feedback)aido-LF-sim-validationsim-2of4failedyeseval020:00:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12072118303Bence Haromi007-0.8aido-LF-sim-testingsim-1of4successyeseval020:03:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.47466252092458
survival_time_median29.550000000000285
deviation-center-line_median1.261530012903168
in-drivable-lane_median2.2000000000000286


other stats
deviation-center-line_max1.261530012903168
deviation-center-line_mean1.261530012903168
deviation-center-line_min1.261530012903168
deviation-heading_max6.401842777523746
deviation-heading_mean6.401842777523746
deviation-heading_median6.401842777523746
deviation-heading_min6.401842777523746
distance-from-start_max2.540765765106741
distance-from-start_mean2.540765765106741
distance-from-start_median2.540765765106741
distance-from-start_min2.540765765106741
driven_any_max10.379395237845316
driven_any_mean10.379395237845316
driven_any_median10.379395237845316
driven_any_min10.379395237845316
driven_lanedir_consec_max9.47466252092458
driven_lanedir_consec_mean9.47466252092458
driven_lanedir_consec_min9.47466252092458
driven_lanedir_max9.47466252092458
driven_lanedir_mean9.47466252092458
driven_lanedir_median9.47466252092458
driven_lanedir_min9.47466252092458
in-drivable-lane_max2.2000000000000286
in-drivable-lane_mean2.2000000000000286
in-drivable-lane_min2.2000000000000286
per-episodes
details{"loop-000-ego0": {"driven_any": 10.379395237845316, "survival_time": 29.550000000000285, "driven_lanedir": 9.47466252092458, "in-drivable-lane": 2.2000000000000286, "deviation-heading": 6.401842777523746, "distance-from-start": 2.540765765106741, "deviation-center-line": 1.261530012903168, "driven_lanedir_consec": 9.47466252092458}}
simulation-passed1
survival_time_max29.550000000000285
survival_time_mean29.550000000000285
survival_time_min29.550000000000285
No reset possible
12071618312Bence Haromi007-0.5aido-LF-sim-testingsim-2of4successyeseval020:05:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median15.395486367940478
survival_time_median59.99999999999873
deviation-center-line_median2.1968385629374323
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.1968385629374323
deviation-center-line_mean2.1968385629374323
deviation-center-line_min2.1968385629374323
deviation-heading_max7.090826689818586
deviation-heading_mean7.090826689818586
deviation-heading_median7.090826689818586
deviation-heading_min7.090826689818586
distance-from-start_max1.0476574060926152
distance-from-start_mean1.0476574060926152
distance-from-start_median1.0476574060926152
distance-from-start_min1.0476574060926152
driven_any_max15.540575790622228
driven_any_mean15.540575790622228
driven_any_median15.540575790622228
driven_any_min15.540575790622228
driven_lanedir_consec_max15.395486367940478
driven_lanedir_consec_mean15.395486367940478
driven_lanedir_consec_min15.395486367940478
driven_lanedir_max15.395486367940478
driven_lanedir_mean15.395486367940478
driven_lanedir_median15.395486367940478
driven_lanedir_min15.395486367940478
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 15.540575790622228, "survival_time": 59.99999999999873, "driven_lanedir": 15.395486367940478, "in-drivable-lane": 0.0, "deviation-heading": 7.090826689818586, "distance-from-start": 1.0476574060926152, "deviation-center-line": 2.1968385629374323, "driven_lanedir_consec": 15.395486367940478}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12071218312Bence Haromi007-0.5aido-LF-sim-testingsim-2of4successyeseval020:05:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median15.403266482046655
survival_time_median59.99999999999873
deviation-center-line_median2.2454026766130015
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.2454026766130015
deviation-center-line_mean2.2454026766130015
deviation-center-line_min2.2454026766130015
deviation-heading_max6.993035318406521
deviation-heading_mean6.993035318406521
deviation-heading_median6.993035318406521
deviation-heading_min6.993035318406521
distance-from-start_max1.0484760015810437
distance-from-start_mean1.0484760015810437
distance-from-start_median1.0484760015810437
distance-from-start_min1.0484760015810437
driven_any_max15.544783297161263
driven_any_mean15.544783297161263
driven_any_median15.544783297161263
driven_any_min15.544783297161263
driven_lanedir_consec_max15.403266482046655
driven_lanedir_consec_mean15.403266482046655
driven_lanedir_consec_min15.403266482046655
driven_lanedir_max15.403266482046655
driven_lanedir_mean15.403266482046655
driven_lanedir_median15.403266482046655
driven_lanedir_min15.403266482046655
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 15.544783297161263, "survival_time": 59.99999999999873, "driven_lanedir": 15.403266482046655, "in-drivable-lane": 0.0, "deviation-heading": 6.993035318406521, "distance-from-start": 1.0484760015810437, "deviation-center-line": 2.2454026766130015, "driven_lanedir_consec": 15.403266482046655}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12070818323Bence Haromi005-0.8aido-LF-sim-testingsim-0of4successyeseval020:06:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median22.962726797962063
survival_time_median59.99999999999873
deviation-center-line_median3.336406566367714
in-drivable-lane_median0.05000000000000071


other stats
deviation-center-line_max3.336406566367714
deviation-center-line_mean3.336406566367714
deviation-center-line_min3.336406566367714
deviation-heading_max12.069916533006555
deviation-heading_mean12.069916533006555
deviation-heading_median12.069916533006555
deviation-heading_min12.069916533006555
distance-from-start_max3.9921430498902497
distance-from-start_mean3.9921430498902497
distance-from-start_median3.9921430498902497
distance-from-start_min3.9921430498902497
driven_any_max23.701506426425205
driven_any_mean23.701506426425205
driven_any_median23.701506426425205
driven_any_min23.701506426425205
driven_lanedir_consec_max22.962726797962063
driven_lanedir_consec_mean22.962726797962063
driven_lanedir_consec_min22.962726797962063
driven_lanedir_max22.962726797962063
driven_lanedir_mean22.962726797962063
driven_lanedir_median22.962726797962063
driven_lanedir_min22.962726797962063
in-drivable-lane_max0.05000000000000071
in-drivable-lane_mean0.05000000000000071
in-drivable-lane_min0.05000000000000071
per-episodes
details{"autolab-000-ego0": {"driven_any": 23.701506426425205, "survival_time": 59.99999999999873, "driven_lanedir": 22.962726797962063, "in-drivable-lane": 0.05000000000000071, "deviation-heading": 12.069916533006555, "distance-from-start": 3.9921430498902497, "deviation-center-line": 3.336406566367714, "driven_lanedir_consec": 22.962726797962063}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12070318323Bence Haromi005-0.8aido-LF-sim-testingsim-0of4successyeseval020:06:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median22.77513637466218
survival_time_median59.99999999999873
deviation-center-line_median3.34169343945677
in-drivable-lane_median0.699999999999978


other stats
deviation-center-line_max3.34169343945677
deviation-center-line_mean3.34169343945677
deviation-center-line_min3.34169343945677
deviation-heading_max12.200556691598695
deviation-heading_mean12.200556691598695
deviation-heading_median12.200556691598695
deviation-heading_min12.200556691598695
distance-from-start_max3.9950778255734978
distance-from-start_mean3.9950778255734978
distance-from-start_median3.9950778255734978
distance-from-start_min3.9950778255734978
driven_any_max23.788713022494985
driven_any_mean23.788713022494985
driven_any_median23.788713022494985
driven_any_min23.788713022494985
driven_lanedir_consec_max22.77513637466218
driven_lanedir_consec_mean22.77513637466218
driven_lanedir_consec_min22.77513637466218
driven_lanedir_max22.77513637466218
driven_lanedir_mean22.77513637466218
driven_lanedir_median22.77513637466218
driven_lanedir_min22.77513637466218
in-drivable-lane_max0.699999999999978
in-drivable-lane_mean0.699999999999978
in-drivable-lane_min0.699999999999978
per-episodes
details{"autolab-000-ego0": {"driven_any": 23.788713022494985, "survival_time": 59.99999999999873, "driven_lanedir": 22.77513637466218, "in-drivable-lane": 0.699999999999978, "deviation-heading": 12.200556691598695, "distance-from-start": 3.9950778255734978, "deviation-center-line": 3.34169343945677, "driven_lanedir_consec": 22.77513637466218}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12070018327Bence Haromi005-1.0aido-LF-sim-testingsim-1of4successyeseval020:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7664778295002534
survival_time_median9.850000000000003
deviation-center-line_median0.4879023838535611
in-drivable-lane_median3.40000000000002


other stats
deviation-center-line_max0.4879023838535611
deviation-center-line_mean0.4879023838535611
deviation-center-line_min0.4879023838535611
deviation-heading_max2.2094589226658745
deviation-heading_mean2.2094589226658745
deviation-heading_median2.2094589226658745
deviation-heading_min2.2094589226658745
distance-from-start_max2.0999730172509854
distance-from-start_mean2.0999730172509854
distance-from-start_median2.0999730172509854
distance-from-start_min2.0999730172509854
driven_any_max4.443283773492971
driven_any_mean4.443283773492971
driven_any_median4.443283773492971
driven_any_min4.443283773492971
driven_lanedir_consec_max2.7664778295002534
driven_lanedir_consec_mean2.7664778295002534
driven_lanedir_consec_min2.7664778295002534
driven_lanedir_max2.7664778295002534
driven_lanedir_mean2.7664778295002534
driven_lanedir_median2.7664778295002534
driven_lanedir_min2.7664778295002534
in-drivable-lane_max3.40000000000002
in-drivable-lane_mean3.40000000000002
in-drivable-lane_min3.40000000000002
per-episodes
details{"loop-000-ego0": {"driven_any": 4.443283773492971, "survival_time": 9.850000000000003, "driven_lanedir": 2.7664778295002534, "in-drivable-lane": 3.40000000000002, "deviation-heading": 2.2094589226658745, "distance-from-start": 2.0999730172509854, "deviation-center-line": 0.4879023838535611, "driven_lanedir_consec": 2.7664778295002534}}
simulation-passed1
survival_time_max9.850000000000003
survival_time_mean9.850000000000003
survival_time_min9.850000000000003
No reset possible
12069618327Bence Haromi005-1.0aido-LF-sim-testingsim-1of4successyeseval020:01:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8123128840592275
survival_time_median9.800000000000004
deviation-center-line_median0.4834168446081732
in-drivable-lane_median3.350000000000019


other stats
deviation-center-line_max0.4834168446081732
deviation-center-line_mean0.4834168446081732
deviation-center-line_min0.4834168446081732
deviation-heading_max2.1327081046767034
deviation-heading_mean2.1327081046767034
deviation-heading_median2.1327081046767034
deviation-heading_min2.1327081046767034
distance-from-start_max2.2099566679486693
distance-from-start_mean2.2099566679486693
distance-from-start_median2.2099566679486693
distance-from-start_min2.2099566679486693
driven_any_max4.442258158383761
driven_any_mean4.442258158383761
driven_any_median4.442258158383761
driven_any_min4.442258158383761
driven_lanedir_consec_max2.8123128840592275
driven_lanedir_consec_mean2.8123128840592275
driven_lanedir_consec_min2.8123128840592275
driven_lanedir_max2.8123128840592275
driven_lanedir_mean2.8123128840592275
driven_lanedir_median2.8123128840592275
driven_lanedir_min2.8123128840592275
in-drivable-lane_max3.350000000000019
in-drivable-lane_mean3.350000000000019
in-drivable-lane_min3.350000000000019
per-episodes
details{"loop-000-ego0": {"driven_any": 4.442258158383761, "survival_time": 9.800000000000004, "driven_lanedir": 2.8123128840592275, "in-drivable-lane": 3.350000000000019, "deviation-heading": 2.1327081046767034, "distance-from-start": 2.2099566679486693, "deviation-center-line": 0.4834168446081732, "driven_lanedir_consec": 2.8123128840592275}}
simulation-passed1
survival_time_max9.800000000000004
survival_time_mean9.800000000000004
survival_time_min9.800000000000004
No reset possible
12069118327Bence Haromi005-1.0aido-LF-sim-testingsim-1of4successyeseval020:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7527853304379084
survival_time_median8.79999999999999
deviation-center-line_median0.469638717743454
in-drivable-lane_median2.4500000000000046


other stats
deviation-center-line_max0.469638717743454
deviation-center-line_mean0.469638717743454
deviation-center-line_min0.469638717743454
deviation-heading_max2.1128204808697575
deviation-heading_mean2.1128204808697575
deviation-heading_median2.1128204808697575
deviation-heading_min2.1128204808697575
distance-from-start_max1.9769922578361985
distance-from-start_mean1.9769922578361985
distance-from-start_median1.9769922578361985
distance-from-start_min1.9769922578361985
driven_any_max3.8534211958525866
driven_any_mean3.8534211958525866
driven_any_median3.8534211958525866
driven_any_min3.8534211958525866
driven_lanedir_consec_max2.7527853304379084
driven_lanedir_consec_mean2.7527853304379084
driven_lanedir_consec_min2.7527853304379084
driven_lanedir_max2.7527853304379084
driven_lanedir_mean2.7527853304379084
driven_lanedir_median2.7527853304379084
driven_lanedir_min2.7527853304379084
in-drivable-lane_max2.4500000000000046
in-drivable-lane_mean2.4500000000000046
in-drivable-lane_min2.4500000000000046
per-episodes
details{"loop-000-ego0": {"driven_any": 3.8534211958525866, "survival_time": 8.79999999999999, "driven_lanedir": 2.7527853304379084, "in-drivable-lane": 2.4500000000000046, "deviation-heading": 2.1128204808697575, "distance-from-start": 1.9769922578361985, "deviation-center-line": 0.469638717743454, "driven_lanedir_consec": 2.7527853304379084}}
simulation-passed1
survival_time_max8.79999999999999
survival_time_mean8.79999999999999
survival_time_min8.79999999999999
No reset possible
12068818327Bence Haromi005-1.0aido-LF-sim-testingsim-1of4successyeseval020:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.767674555827446
survival_time_median8.74999999999999
deviation-center-line_median0.47312489848572986
in-drivable-lane_median2.400000000000004


other stats
deviation-center-line_max0.47312489848572986
deviation-center-line_mean0.47312489848572986
deviation-center-line_min0.47312489848572986
deviation-heading_max2.1216496153516116
deviation-heading_mean2.1216496153516116
deviation-heading_median2.1216496153516116
deviation-heading_min2.1216496153516116
distance-from-start_max1.9720337441305933
distance-from-start_mean1.9720337441305933
distance-from-start_median1.9720337441305933
distance-from-start_min1.9720337441305933
driven_any_max3.847114471686474
driven_any_mean3.847114471686474
driven_any_median3.847114471686474
driven_any_min3.847114471686474
driven_lanedir_consec_max2.767674555827446
driven_lanedir_consec_mean2.767674555827446
driven_lanedir_consec_min2.767674555827446
driven_lanedir_max2.767674555827446
driven_lanedir_mean2.767674555827446
driven_lanedir_median2.767674555827446
driven_lanedir_min2.767674555827446
in-drivable-lane_max2.400000000000004
in-drivable-lane_mean2.400000000000004
in-drivable-lane_min2.400000000000004
per-episodes
details{"loop-000-ego0": {"driven_any": 3.847114471686474, "survival_time": 8.74999999999999, "driven_lanedir": 2.767674555827446, "in-drivable-lane": 2.400000000000004, "deviation-heading": 2.1216496153516116, "distance-from-start": 1.9720337441305933, "deviation-center-line": 0.47312489848572986, "driven_lanedir_consec": 2.767674555827446}}
simulation-passed1
survival_time_max8.74999999999999
survival_time_mean8.74999999999999
survival_time_min8.74999999999999
No reset possible
12068418315Bence Haromi005-0.5aido-LF-sim-testingsim-3of4successyeseval020:06:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median15.188859375663815
survival_time_median59.99999999999873
deviation-center-line_median2.6402339349892294
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.6402339349892294
deviation-center-line_mean2.6402339349892294
deviation-center-line_min2.6402339349892294
deviation-heading_max8.492269918052962
deviation-heading_mean8.492269918052962
deviation-heading_median8.492269918052962
deviation-heading_min8.492269918052962
distance-from-start_max3.293887475153743
distance-from-start_mean3.293887475153743
distance-from-start_median3.293887475153743
distance-from-start_min3.293887475153743
driven_any_max15.3802185884729
driven_any_mean15.3802185884729
driven_any_median15.3802185884729
driven_any_min15.3802185884729
driven_lanedir_consec_max15.188859375663815
driven_lanedir_consec_mean15.188859375663815
driven_lanedir_consec_min15.188859375663815
driven_lanedir_max15.188859375663815
driven_lanedir_mean15.188859375663815
driven_lanedir_median15.188859375663815
driven_lanedir_min15.188859375663815
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.3802185884729, "survival_time": 59.99999999999873, "driven_lanedir": 15.188859375663815, "in-drivable-lane": 0.0, "deviation-heading": 8.492269918052962, "distance-from-start": 3.293887475153743, "deviation-center-line": 2.6402339349892294, "driven_lanedir_consec": 15.188859375663815}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12068118325Bence Haromi005-0.9aido-LF-sim-testingsim-0of4successyeseval020:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.227469244268077
survival_time_median13.100000000000051
deviation-center-line_median0.7606077073556005
in-drivable-lane_median2.8000000000000345


other stats
deviation-center-line_max0.7606077073556005
deviation-center-line_mean0.7606077073556005
deviation-center-line_min0.7606077073556005
deviation-heading_max2.9907637697610028
deviation-heading_mean2.9907637697610028
deviation-heading_median2.9907637697610028
deviation-heading_min2.9907637697610028
distance-from-start_max4.26513620033681
distance-from-start_mean4.26513620033681
distance-from-start_median4.26513620033681
distance-from-start_min4.26513620033681
driven_any_max5.486949693766773
driven_any_mean5.486949693766773
driven_any_median5.486949693766773
driven_any_min5.486949693766773
driven_lanedir_consec_max4.227469244268077
driven_lanedir_consec_mean4.227469244268077
driven_lanedir_consec_min4.227469244268077
driven_lanedir_max4.227469244268077
driven_lanedir_mean4.227469244268077
driven_lanedir_median4.227469244268077
driven_lanedir_min4.227469244268077
in-drivable-lane_max2.8000000000000345
in-drivable-lane_mean2.8000000000000345
in-drivable-lane_min2.8000000000000345
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.486949693766773, "survival_time": 13.100000000000051, "driven_lanedir": 4.227469244268077, "in-drivable-lane": 2.8000000000000345, "deviation-heading": 2.9907637697610028, "distance-from-start": 4.26513620033681, "deviation-center-line": 0.7606077073556005, "driven_lanedir_consec": 4.227469244268077}}
simulation-passed1
survival_time_max13.100000000000051
survival_time_mean13.100000000000051
survival_time_min13.100000000000051
No reset possible
12068018325Bence Haromi005-0.9aido-LF-sim-testingsim-0of4successyeseval020:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.959341006058216
survival_time_median12.750000000000046
deviation-center-line_median0.7014825226462534
in-drivable-lane_median2.850000000000035


other stats
deviation-center-line_max0.7014825226462534
deviation-center-line_mean0.7014825226462534
deviation-center-line_min0.7014825226462534
deviation-heading_max3.3229913059280483
deviation-heading_mean3.3229913059280483
deviation-heading_median3.3229913059280483
deviation-heading_min3.3229913059280483
distance-from-start_max4.0196771951881685
distance-from-start_mean4.0196771951881685
distance-from-start_median4.0196771951881685
distance-from-start_min4.0196771951881685
driven_any_max5.217039951462002
driven_any_mean5.217039951462002
driven_any_median5.217039951462002
driven_any_min5.217039951462002
driven_lanedir_consec_max3.959341006058216
driven_lanedir_consec_mean3.959341006058216
driven_lanedir_consec_min3.959341006058216
driven_lanedir_max3.959341006058216
driven_lanedir_mean3.959341006058216
driven_lanedir_median3.959341006058216
driven_lanedir_min3.959341006058216
in-drivable-lane_max2.850000000000035
in-drivable-lane_mean2.850000000000035
in-drivable-lane_min2.850000000000035
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.217039951462002, "survival_time": 12.750000000000046, "driven_lanedir": 3.959341006058216, "in-drivable-lane": 2.850000000000035, "deviation-heading": 3.3229913059280483, "distance-from-start": 4.0196771951881685, "deviation-center-line": 0.7014825226462534, "driven_lanedir_consec": 3.959341006058216}}
simulation-passed1
survival_time_max12.750000000000046
survival_time_mean12.750000000000046
survival_time_min12.750000000000046
No reset possible
12067718325Bence Haromi005-0.9aido-LF-sim-testingsim-0of4successyeseval020:02:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.32416765778707
survival_time_median13.200000000000053
deviation-center-line_median0.7629323362134653
in-drivable-lane_median2.7500000000000338


other stats
deviation-center-line_max0.7629323362134653
deviation-center-line_mean0.7629323362134653
deviation-center-line_min0.7629323362134653
deviation-heading_max2.963908982351117
deviation-heading_mean2.963908982351117
deviation-heading_median2.963908982351117
deviation-heading_min2.963908982351117
distance-from-start_max4.30708200412223
distance-from-start_mean4.30708200412223
distance-from-start_median4.30708200412223
distance-from-start_min4.30708200412223
driven_any_max5.5551735616171305
driven_any_mean5.5551735616171305
driven_any_median5.5551735616171305
driven_any_min5.5551735616171305
driven_lanedir_consec_max4.32416765778707
driven_lanedir_consec_mean4.32416765778707
driven_lanedir_consec_min4.32416765778707
driven_lanedir_max4.32416765778707
driven_lanedir_mean4.32416765778707
driven_lanedir_median4.32416765778707
driven_lanedir_min4.32416765778707
in-drivable-lane_max2.7500000000000338
in-drivable-lane_mean2.7500000000000338
in-drivable-lane_min2.7500000000000338
per-episodes
details{"autolab-000-ego0": {"driven_any": 5.5551735616171305, "survival_time": 13.200000000000053, "driven_lanedir": 4.32416765778707, "in-drivable-lane": 2.7500000000000338, "deviation-heading": 2.963908982351117, "distance-from-start": 4.30708200412223, "deviation-center-line": 0.7629323362134653, "driven_lanedir_consec": 4.32416765778707}}
simulation-passed1
survival_time_max13.200000000000053
survival_time_mean13.200000000000053
survival_time_min13.200000000000053
No reset possible
12067318325Bence Haromi005-0.9aido-LF-sim-testingsim-3of4successyeseval020:03:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.58689544807216
survival_time_median20.00000000000015
deviation-center-line_median1.3065541695104428
in-drivable-lane_median5.100000000000062


other stats
deviation-center-line_max1.3065541695104428
deviation-center-line_mean1.3065541695104428
deviation-center-line_min1.3065541695104428
deviation-heading_max5.106534151427532
deviation-heading_mean5.106534151427532
deviation-heading_median5.106534151427532
deviation-heading_min5.106534151427532
distance-from-start_max2.5497162361985657
distance-from-start_mean2.5497162361985657
distance-from-start_median2.5497162361985657
distance-from-start_min2.5497162361985657
driven_any_max8.02522565053417
driven_any_mean8.02522565053417
driven_any_median8.02522565053417
driven_any_min8.02522565053417
driven_lanedir_consec_max5.58689544807216
driven_lanedir_consec_mean5.58689544807216
driven_lanedir_consec_min5.58689544807216
driven_lanedir_max5.58689544807216
driven_lanedir_mean5.58689544807216
driven_lanedir_median5.58689544807216
driven_lanedir_min5.58689544807216
in-drivable-lane_max5.100000000000062
in-drivable-lane_mean5.100000000000062
in-drivable-lane_min5.100000000000062
per-episodes
details{"zigzag-000-ego0": {"driven_any": 8.02522565053417, "survival_time": 20.00000000000015, "driven_lanedir": 5.58689544807216, "in-drivable-lane": 5.100000000000062, "deviation-heading": 5.106534151427532, "distance-from-start": 2.5497162361985657, "deviation-center-line": 1.3065541695104428, "driven_lanedir_consec": 5.58689544807216}}
simulation-passed1
survival_time_max20.00000000000015
survival_time_mean20.00000000000015
survival_time_min20.00000000000015
No reset possible
12066918317Bence Haromi005-0.6aido-LF-sim-testingsim-1of4successyeseval020:05:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median19.447085245717183
survival_time_median59.99999999999873
deviation-center-line_median2.0348560413772065
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.0348560413772065
deviation-center-line_mean2.0348560413772065
deviation-center-line_min2.0348560413772065
deviation-heading_max5.032156758031105
deviation-heading_mean5.032156758031105
deviation-heading_median5.032156758031105
deviation-heading_min5.032156758031105
distance-from-start_max2.576853590141385
distance-from-start_mean2.576853590141385
distance-from-start_median2.576853590141385
distance-from-start_min2.576853590141385
driven_any_max19.58217487636809
driven_any_mean19.58217487636809
driven_any_median19.58217487636809
driven_any_min19.58217487636809
driven_lanedir_consec_max19.447085245717183
driven_lanedir_consec_mean19.447085245717183
driven_lanedir_consec_min19.447085245717183
driven_lanedir_max19.447085245717183
driven_lanedir_mean19.447085245717183
driven_lanedir_median19.447085245717183
driven_lanedir_min19.447085245717183
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 19.58217487636809, "survival_time": 59.99999999999873, "driven_lanedir": 19.447085245717183, "in-drivable-lane": 0.0, "deviation-heading": 5.032156758031105, "distance-from-start": 2.576853590141385, "deviation-center-line": 2.0348560413772065, "driven_lanedir_consec": 19.447085245717183}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12066518322Bence Haromi005-0.8aido-LF-sim-validationsim-0of4successyeseval020:06:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median23.388633857605843
survival_time_median59.99999999999873
deviation-center-line_median2.9581349283437937
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.9581349283437937
deviation-center-line_mean2.9581349283437937
deviation-center-line_min2.9581349283437937
deviation-heading_max10.684409376394964
deviation-heading_mean10.684409376394964
deviation-heading_median10.684409376394964
deviation-heading_min10.684409376394964
distance-from-start_max3.2444851013912928
distance-from-start_mean3.2444851013912928
distance-from-start_median3.2444851013912928
distance-from-start_min3.2444851013912928
driven_any_max23.97936747182979
driven_any_mean23.97936747182979
driven_any_median23.97936747182979
driven_any_min23.97936747182979
driven_lanedir_consec_max23.388633857605843
driven_lanedir_consec_mean23.388633857605843
driven_lanedir_consec_min23.388633857605843
driven_lanedir_max23.388633857605843
driven_lanedir_mean23.388633857605843
driven_lanedir_median23.388633857605843
driven_lanedir_min23.388633857605843
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 23.97936747182979, "survival_time": 59.99999999999873, "driven_lanedir": 23.388633857605843, "in-drivable-lane": 0.0, "deviation-heading": 10.684409376394964, "distance-from-start": 3.2444851013912928, "deviation-center-line": 2.9581349283437937, "driven_lanedir_consec": 23.388633857605843}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12066018326Bence Haromi005-1.0aido-LF-sim-validationsim-1of4successyeseval020:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.733617981126618
survival_time_median13.950000000000063
deviation-center-line_median0.5043266831904193
in-drivable-lane_median6.000000000000048


other stats
deviation-center-line_max0.5043266831904193
deviation-center-line_mean0.5043266831904193
deviation-center-line_min0.5043266831904193
deviation-heading_max2.483908626047139
deviation-heading_mean2.483908626047139
deviation-heading_median2.483908626047139
deviation-heading_min2.483908626047139
distance-from-start_max2.43512397135583
distance-from-start_mean2.43512397135583
distance-from-start_median2.43512397135583
distance-from-start_min2.43512397135583
driven_any_max6.50225487409567
driven_any_mean6.50225487409567
driven_any_median6.50225487409567
driven_any_min6.50225487409567
driven_lanedir_consec_max2.733617981126618
driven_lanedir_consec_mean2.733617981126618
driven_lanedir_consec_min2.733617981126618
driven_lanedir_max3.5183439182118605
driven_lanedir_mean3.5183439182118605
driven_lanedir_median3.5183439182118605
driven_lanedir_min3.5183439182118605
in-drivable-lane_max6.000000000000048
in-drivable-lane_mean6.000000000000048
in-drivable-lane_min6.000000000000048
per-episodes
details{"loop-000-ego0": {"driven_any": 6.50225487409567, "survival_time": 13.950000000000063, "driven_lanedir": 3.5183439182118605, "in-drivable-lane": 6.000000000000048, "deviation-heading": 2.483908626047139, "distance-from-start": 2.43512397135583, "deviation-center-line": 0.5043266831904193, "driven_lanedir_consec": 2.733617981126618}}
simulation-passed1
survival_time_max13.950000000000063
survival_time_mean13.950000000000063
survival_time_min13.950000000000063
No reset possible
12065518326Bence Haromi005-1.0aido-LF-sim-validationsim-0of4successyeseval020:03:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.090414254530058
survival_time_median22.75000000000019
deviation-center-line_median1.216278047666474
in-drivable-lane_median5.1000000000000725


other stats
deviation-center-line_max1.216278047666474
deviation-center-line_mean1.216278047666474
deviation-center-line_min1.216278047666474
deviation-heading_max4.818065001149504
deviation-heading_mean4.818065001149504
deviation-heading_median4.818065001149504
deviation-heading_min4.818065001149504
distance-from-start_max3.2204400456128175
distance-from-start_mean3.2204400456128175
distance-from-start_median3.2204400456128175
distance-from-start_min3.2204400456128175
driven_any_max10.750575280126457
driven_any_mean10.750575280126457
driven_any_median10.750575280126457
driven_any_min10.750575280126457
driven_lanedir_consec_max8.090414254530058
driven_lanedir_consec_mean8.090414254530058
driven_lanedir_consec_min8.090414254530058
driven_lanedir_max8.090414254530058
driven_lanedir_mean8.090414254530058
driven_lanedir_median8.090414254530058
driven_lanedir_min8.090414254530058
in-drivable-lane_max5.1000000000000725
in-drivable-lane_mean5.1000000000000725
in-drivable-lane_min5.1000000000000725
per-episodes
details{"autolab-000-ego0": {"driven_any": 10.750575280126457, "survival_time": 22.75000000000019, "driven_lanedir": 8.090414254530058, "in-drivable-lane": 5.1000000000000725, "deviation-heading": 4.818065001149504, "distance-from-start": 3.2204400456128175, "deviation-center-line": 1.216278047666474, "driven_lanedir_consec": 8.090414254530058}}
simulation-passed1
survival_time_max22.75000000000019
survival_time_mean22.75000000000019
survival_time_min22.75000000000019
No reset possible
12065218326Bence Haromi005-1.0aido-LF-sim-validationsim-2of4successyeseval020:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.84039863743738
survival_time_median7.599999999999981
deviation-center-line_median0.38583110896055256
in-drivable-lane_median2.799999999999991


other stats
deviation-center-line_max0.38583110896055256
deviation-center-line_mean0.38583110896055256
deviation-center-line_min0.38583110896055256
deviation-heading_max2.3031083429348724
deviation-heading_mean2.3031083429348724
deviation-heading_median2.3031083429348724
deviation-heading_min2.3031083429348724
distance-from-start_max1.0028636988025392
distance-from-start_mean1.0028636988025392
distance-from-start_median1.0028636988025392
distance-from-start_min1.0028636988025392
driven_any_max3.147350685108158
driven_any_mean3.147350685108158
driven_any_median3.147350685108158
driven_any_min3.147350685108158
driven_lanedir_consec_max1.84039863743738
driven_lanedir_consec_mean1.84039863743738
driven_lanedir_consec_min1.84039863743738
driven_lanedir_max1.84039863743738
driven_lanedir_mean1.84039863743738
driven_lanedir_median1.84039863743738
driven_lanedir_min1.84039863743738
in-drivable-lane_max2.799999999999991
in-drivable-lane_mean2.799999999999991
in-drivable-lane_min2.799999999999991
per-episodes
details{"loop2-000-ego0": {"driven_any": 3.147350685108158, "survival_time": 7.599999999999981, "driven_lanedir": 1.84039863743738, "in-drivable-lane": 2.799999999999991, "deviation-heading": 2.3031083429348724, "distance-from-start": 1.0028636988025392, "deviation-center-line": 0.38583110896055256, "driven_lanedir_consec": 1.84039863743738}}
simulation-passed1
survival_time_max7.599999999999981
survival_time_mean7.599999999999981
survival_time_min7.599999999999981
No reset possible
12064518324Bence Haromi005-0.9aido-LF-sim-validationsim-2of4successyeseval020:05:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median15.973332427874148
survival_time_median59.99999999999873
deviation-center-line_median3.7906535241775514
in-drivable-lane_median16.249999999999684


other stats
deviation-center-line_max3.7906535241775514
deviation-center-line_mean3.7906535241775514
deviation-center-line_min3.7906535241775514
deviation-heading_max19.58247469610453
deviation-heading_mean19.58247469610453
deviation-heading_median19.58247469610453
deviation-heading_min19.58247469610453
distance-from-start_max1.2087500647865128
distance-from-start_mean1.2087500647865128
distance-from-start_median1.2087500647865128
distance-from-start_min1.2087500647865128
driven_any_max25.150397022634777
driven_any_mean25.150397022634777
driven_any_median25.150397022634777
driven_any_min25.150397022634777
driven_lanedir_consec_max15.973332427874148
driven_lanedir_consec_mean15.973332427874148
driven_lanedir_consec_min15.973332427874148
driven_lanedir_max15.973332427874148
driven_lanedir_mean15.973332427874148
driven_lanedir_median15.973332427874148
driven_lanedir_min15.973332427874148
in-drivable-lane_max16.249999999999684
in-drivable-lane_mean16.249999999999684
in-drivable-lane_min16.249999999999684
per-episodes
details{"loop2-000-ego0": {"driven_any": 25.150397022634777, "survival_time": 59.99999999999873, "driven_lanedir": 15.973332427874148, "in-drivable-lane": 16.249999999999684, "deviation-heading": 19.58247469610453, "distance-from-start": 1.2087500647865128, "deviation-center-line": 3.7906535241775514, "driven_lanedir_consec": 15.973332427874148}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12064218320Andras BeresI work in reality! (full state feedback)aido-LF-sim-validationsim-1of4failedyeseval020:00:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12063718320Andras BeresI work in reality! (full state feedback)aido-LF-sim-validationsim-1of4failedyeseval020:00:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12063318320Andras BeresI work in reality! (full state feedback)aido-LF-sim-validationsim-2of4failedyeseval020:00:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol