Duckietown Challenges Home Challenges Submissions

Evaluator 5542

ID5542
evaluatoreval03
ownerAndrea Daniele 🇮🇹
machinedavinci
processeval03
version6.2.40
first heard
last heard
statusinactive
# evaluating
# success90 119841
# timeout1 121032
# failed45 119872
# error
# aborted39 119907
# host-error90 119850
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors96%
RAM total (MB)251.6 GB
RAM free (MB)237.5 GB
Disk (MB)444.3 GB
Disk available (MB)421.5 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
12103218368Sampsa RantaQuack² - Thanks for All the Fishaido-LFI-sim-validationsim-1of4timeoutyeseval03----No reset possible
12102418365Sampsa RantaQuack² - Thanks for All the Fishaido-LF-sim-testingsim-2of4successyeseval030:06:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.104412937842799
survival_time_median59.99999999999873
deviation-center-line_median1.683657138496471
in-drivable-lane_median0.0


other stats
deviation-center-line_max1.683657138496471
deviation-center-line_mean1.683657138496471
deviation-center-line_min1.683657138496471
deviation-heading_max8.995833534115672
deviation-heading_mean8.995833534115672
deviation-heading_median8.995833534115672
deviation-heading_min8.995833534115672
distance-from-start_max1.0313051546277152
distance-from-start_mean1.0313051546277152
distance-from-start_median1.0313051546277152
distance-from-start_min1.0313051546277152
driven_any_max6.237822681173658
driven_any_mean6.237822681173658
driven_any_median6.237822681173658
driven_any_min6.237822681173658
driven_lanedir_consec_max6.104412937842799
driven_lanedir_consec_mean6.104412937842799
driven_lanedir_consec_min6.104412937842799
driven_lanedir_max6.104412937842799
driven_lanedir_mean6.104412937842799
driven_lanedir_median6.104412937842799
driven_lanedir_min6.104412937842799
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 6.237822681173658, "survival_time": 59.99999999999873, "driven_lanedir": 6.104412937842799, "in-drivable-lane": 0.0, "deviation-heading": 8.995833534115672, "distance-from-start": 1.0313051546277152, "deviation-center-line": 1.683657138496471, "driven_lanedir_consec": 6.104412937842799}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12101518369Sampsa RantaQuack² - Bluezaido-LFV-sim-validationsim-3of4successyeseval030:13:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median6.17525383590517
deviation-center-line_median1.6165066280596805


other stats
deviation-center-line_max1.6165066280596805
deviation-center-line_mean1.6165066280596805
deviation-center-line_min1.6165066280596805
deviation-heading_max6.862652796813862
deviation-heading_mean6.862652796813862
deviation-heading_median6.862652796813862
deviation-heading_min6.862652796813862
distance-from-start_max4.132643034706207
distance-from-start_mean4.132643034706207
distance-from-start_median4.132643034706207
distance-from-start_min4.132643034706207
driven_any_max6.243115368258494
driven_any_mean6.243115368258494
driven_any_median6.243115368258494
driven_any_min6.243115368258494
driven_lanedir_consec_max6.17525383590517
driven_lanedir_consec_mean6.17525383590517
driven_lanedir_consec_min6.17525383590517
driven_lanedir_max6.17525383590517
driven_lanedir_mean6.17525383590517
driven_lanedir_median6.17525383590517
driven_lanedir_min6.17525383590517
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.243115368258494, "survival_time": 59.99999999999873, "driven_lanedir": 6.17525383590517, "in-drivable-lane": 0.0, "deviation-heading": 6.862652796813862, "distance-from-start": 4.132643034706207, "deviation-center-line": 1.6165066280596805, "driven_lanedir_consec": 6.17525383590517}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12101118362Sampsa RantaQuack² - Bluezaido-LFV-sim-validationsim-2of4failedyeseval030:02:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 720, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 360, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 416, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 589, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/submission_ws/src/agent/src/solution.py", line 81, in on_received_get_commands
              ||     raise Exception(msg)
              || Exception: I have been waiting for commands from the ROS part since 60 s
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12101018362Sampsa RantaQuack² - Bluezaido-LFV-sim-validationsim-1of4failedyeseval030:02:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 720, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 360, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 416, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 589, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/submission_ws/src/agent/src/solution.py", line 81, in on_received_get_commands
              ||     raise Exception(msg)
              || Exception: I have been waiting for commands from the ROS part since 60 s
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12100418361Sampsa RantaQuack² - Thanks for All the Fishaido-LF-sim-validationsim-1of4successyeseval030:06:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.17126667268583
survival_time_median59.99999999999873
deviation-center-line_median1.1690744288665764
in-drivable-lane_median0.0


other stats
deviation-center-line_max1.1690744288665764
deviation-center-line_mean1.1690744288665764
deviation-center-line_min1.1690744288665764
deviation-heading_max5.601940782033284
deviation-heading_mean5.601940782033284
deviation-heading_median5.601940782033284
deviation-heading_min5.601940782033284
distance-from-start_max2.526668214614154
distance-from-start_mean2.526668214614154
distance-from-start_median2.526668214614154
distance-from-start_min2.526668214614154
driven_any_max6.237880086181424
driven_any_mean6.237880086181424
driven_any_median6.237880086181424
driven_any_min6.237880086181424
driven_lanedir_consec_max6.17126667268583
driven_lanedir_consec_mean6.17126667268583
driven_lanedir_consec_min6.17126667268583
driven_lanedir_max6.17126667268583
driven_lanedir_mean6.17126667268583
driven_lanedir_median6.17126667268583
driven_lanedir_min6.17126667268583
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 6.237880086181424, "survival_time": 59.99999999999873, "driven_lanedir": 6.17126667268583, "in-drivable-lane": 0.0, "deviation-heading": 5.601940782033284, "distance-from-start": 2.526668214614154, "deviation-center-line": 1.1690744288665764, "driven_lanedir_consec": 6.17126667268583}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12099818360Sampsa RantaQuack² - Hello Worldaido-LF-sim-validationsim-3of4successyeseval030:06:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.151295587691564
survival_time_median59.99999999999873
deviation-center-line_median1.8135621292161004
in-drivable-lane_median0.0


other stats
deviation-center-line_max1.8135621292161004
deviation-center-line_mean1.8135621292161004
deviation-center-line_min1.8135621292161004
deviation-heading_max7.317643279144402
deviation-heading_mean7.317643279144402
deviation-heading_median7.317643279144402
deviation-heading_min7.317643279144402
distance-from-start_max3.494732788692328
distance-from-start_mean3.494732788692328
distance-from-start_median3.494732788692328
distance-from-start_min3.494732788692328
driven_any_max6.2378624436225
driven_any_mean6.2378624436225
driven_any_median6.2378624436225
driven_any_min6.2378624436225
driven_lanedir_consec_max6.151295587691564
driven_lanedir_consec_mean6.151295587691564
driven_lanedir_consec_min6.151295587691564
driven_lanedir_max6.151295587691564
driven_lanedir_mean6.151295587691564
driven_lanedir_median6.151295587691564
driven_lanedir_min6.151295587691564
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.2378624436225, "survival_time": 59.99999999999873, "driven_lanedir": 6.151295587691564, "in-drivable-lane": 0.0, "deviation-heading": 7.317643279144402, "distance-from-start": 3.494732788692328, "deviation-center-line": 1.8135621292161004, "driven_lanedir_consec": 6.151295587691564}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12098918352Bence Haromi007-0.5aido-LFI-sim-testingsim-0of4host-erroryeseval030:01:07
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12098218352Bence Haromi007-0.5aido-LFI-sim-testingsim-2of4successyeseval030:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12097718352Bence Haromi007-0.5aido-LFI-sim-testingsim-1of4failedyeseval030:01:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12096618340Bence Haromi005-0.8aido-LFI-sim-testingsim-2of4successyeseval030:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12096218340Bence Haromi005-0.8aido-LFI-sim-testingsim-1of4failedyeseval030:01:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12095918340Bence Haromi005-0.8aido-LFI-sim-testingsim-2of4successyeseval030:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12095418354Bence Haromi007-0.5aido-LFV-sim-testingsim-1of4successyeseval030:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.500000000000014
in-drivable-lane_median0.0
driven_lanedir_consec_median2.55589307455216
deviation-center-line_median0.33344291755865


other stats
deviation-center-line_max0.33344291755865
deviation-center-line_mean0.33344291755865
deviation-center-line_min0.33344291755865
deviation-heading_max0.9367274607283742
deviation-heading_mean0.9367274607283742
deviation-heading_median0.9367274607283742
deviation-heading_min0.9367274607283742
distance-from-start_max1.8501168963715928
distance-from-start_mean1.8501168963715928
distance-from-start_median1.8501168963715928
distance-from-start_min1.8501168963715928
driven_any_max2.570117421892754
driven_any_mean2.570117421892754
driven_any_median2.570117421892754
driven_any_min2.570117421892754
driven_lanedir_consec_max2.55589307455216
driven_lanedir_consec_mean2.55589307455216
driven_lanedir_consec_min2.55589307455216
driven_lanedir_max2.55589307455216
driven_lanedir_mean2.55589307455216
driven_lanedir_median2.55589307455216
driven_lanedir_min2.55589307455216
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.570117421892754, "survival_time": 10.500000000000014, "driven_lanedir": 2.55589307455216, "in-drivable-lane": 0.0, "deviation-heading": 0.9367274607283742, "distance-from-start": 1.8501168963715928, "deviation-center-line": 0.33344291755865, "driven_lanedir_consec": 2.55589307455216}}
simulation-passed1
survival_time_max10.500000000000014
survival_time_mean10.500000000000014
survival_time_min10.500000000000014
No reset possible
12095118354Bence Haromi007-0.5aido-LFV-sim-testingsim-1of4successyeseval030:03:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.500000000000014
in-drivable-lane_median0.0
driven_lanedir_consec_median2.5564733260420356
deviation-center-line_median0.3333737415941119


other stats
deviation-center-line_max0.3333737415941119
deviation-center-line_mean0.3333737415941119
deviation-center-line_min0.3333737415941119
deviation-heading_max0.9220563212584704
deviation-heading_mean0.9220563212584704
deviation-heading_median0.9220563212584704
deviation-heading_min0.9220563212584704
distance-from-start_max1.850949637930052
distance-from-start_mean1.850949637930052
distance-from-start_median1.850949637930052
distance-from-start_min1.850949637930052
driven_any_max2.569976168631283
driven_any_mean2.569976168631283
driven_any_median2.569976168631283
driven_any_min2.569976168631283
driven_lanedir_consec_max2.5564733260420356
driven_lanedir_consec_mean2.5564733260420356
driven_lanedir_consec_min2.5564733260420356
driven_lanedir_max2.5564733260420356
driven_lanedir_mean2.5564733260420356
driven_lanedir_median2.5564733260420356
driven_lanedir_min2.5564733260420356
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop-000-ego0": {"driven_any": 2.569976168631283, "survival_time": 10.500000000000014, "driven_lanedir": 2.5564733260420356, "in-drivable-lane": 0.0, "deviation-heading": 0.9220563212584704, "distance-from-start": 1.850949637930052, "deviation-center-line": 0.3333737415941119, "driven_lanedir_consec": 2.5564733260420356}}
simulation-passed1
survival_time_max10.500000000000014
survival_time_mean10.500000000000014
survival_time_min10.500000000000014
No reset possible
12093918344Bence Haromi005-0.8aido-LFV-sim-testingsim-0of4successyeseval030:07:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.20000000000021
in-drivable-lane_median1.7000000000000242
driven_lanedir_consec_median7.967839051113955
deviation-center-line_median1.6164209024705012


other stats
deviation-center-line_max1.6164209024705012
deviation-center-line_mean1.6164209024705012
deviation-center-line_min1.6164209024705012
deviation-heading_max5.635821587227216
deviation-heading_mean5.635821587227216
deviation-heading_median5.635821587227216
deviation-heading_min5.635821587227216
distance-from-start_max3.338880338020095
distance-from-start_mean3.338880338020095
distance-from-start_median3.338880338020095
distance-from-start_min3.338880338020095
driven_any_max8.737797965577096
driven_any_mean8.737797965577096
driven_any_median8.737797965577096
driven_any_min8.737797965577096
driven_lanedir_consec_max7.967839051113955
driven_lanedir_consec_mean7.967839051113955
driven_lanedir_consec_min7.967839051113955
driven_lanedir_max7.967839051113955
driven_lanedir_mean7.967839051113955
driven_lanedir_median7.967839051113955
driven_lanedir_min7.967839051113955
in-drivable-lane_max1.7000000000000242
in-drivable-lane_mean1.7000000000000242
in-drivable-lane_min1.7000000000000242
per-episodes
details{"autolab-000-ego0": {"driven_any": 8.737797965577096, "survival_time": 24.20000000000021, "driven_lanedir": 7.967839051113955, "in-drivable-lane": 1.7000000000000242, "deviation-heading": 5.635821587227216, "distance-from-start": 3.338880338020095, "deviation-center-line": 1.6164209024705012, "driven_lanedir_consec": 7.967839051113955}}
simulation-passed1
survival_time_max24.20000000000021
survival_time_mean24.20000000000021
survival_time_min24.20000000000021
No reset possible
12093718333Bence Haromi007-0.5aido-LFI-sim-validationsim-2of4successyeseval030:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12093318333Bence Haromi007-0.5aido-LFI-sim-validationsim-2of4successyeseval030:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12092518344Bence Haromi005-0.8aido-LFV-sim-testingsim-3of4successyeseval030:04:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.400000000000029
in-drivable-lane_median6.20000000000004
driven_lanedir_consec_median1.7017569041556049
deviation-center-line_median0.4981232661169967


other stats
deviation-center-line_max0.4981232661169967
deviation-center-line_mean0.4981232661169967
deviation-center-line_min0.4981232661169967
deviation-heading_max1.795961812989992
deviation-heading_mean1.795961812989992
deviation-heading_median1.795961812989992
deviation-heading_min1.795961812989992
distance-from-start_max2.959747792313619
distance-from-start_mean2.959747792313619
distance-from-start_median2.959747792313619
distance-from-start_min2.959747792313619
driven_any_max4.15188748177135
driven_any_mean4.15188748177135
driven_any_median4.15188748177135
driven_any_min4.15188748177135
driven_lanedir_consec_max1.7017569041556049
driven_lanedir_consec_mean1.7017569041556049
driven_lanedir_consec_min1.7017569041556049
driven_lanedir_max1.7017569041556049
driven_lanedir_mean1.7017569041556049
driven_lanedir_median1.7017569041556049
driven_lanedir_min1.7017569041556049
in-drivable-lane_max6.20000000000004
in-drivable-lane_mean6.20000000000004
in-drivable-lane_min6.20000000000004
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.15188748177135, "survival_time": 11.400000000000029, "driven_lanedir": 1.7017569041556049, "in-drivable-lane": 6.20000000000004, "deviation-heading": 1.795961812989992, "distance-from-start": 2.959747792313619, "deviation-center-line": 0.4981232661169967, "driven_lanedir_consec": 1.7017569041556049}}
simulation-passed1
survival_time_max11.400000000000029
survival_time_mean11.400000000000029
survival_time_min11.400000000000029
No reset possible
12091718344Bence Haromi005-0.8aido-LFV-sim-testingsim-3of4successyeseval030:04:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.250000000000052
in-drivable-lane_median0.30000000000000027
driven_lanedir_consec_median4.28806824293648
deviation-center-line_median0.8665614677342858


other stats
deviation-center-line_max0.8665614677342858
deviation-center-line_mean0.8665614677342858
deviation-center-line_min0.8665614677342858
deviation-heading_max3.2377855935173496
deviation-heading_mean3.2377855935173496
deviation-heading_median3.2377855935173496
deviation-heading_min3.2377855935173496
distance-from-start_max3.2615601818796196
distance-from-start_mean3.2615601818796196
distance-from-start_median3.2615601818796196
distance-from-start_min3.2615601818796196
driven_any_max4.5604972154354195
driven_any_mean4.5604972154354195
driven_any_median4.5604972154354195
driven_any_min4.5604972154354195
driven_lanedir_consec_max4.28806824293648
driven_lanedir_consec_mean4.28806824293648
driven_lanedir_consec_min4.28806824293648
driven_lanedir_max4.28806824293648
driven_lanedir_mean4.28806824293648
driven_lanedir_median4.28806824293648
driven_lanedir_min4.28806824293648
in-drivable-lane_max0.30000000000000027
in-drivable-lane_mean0.30000000000000027
in-drivable-lane_min0.30000000000000027
per-episodes
details{"zigzag-000-ego0": {"driven_any": 4.5604972154354195, "survival_time": 13.250000000000052, "driven_lanedir": 4.28806824293648, "in-drivable-lane": 0.30000000000000027, "deviation-heading": 3.2377855935173496, "distance-from-start": 3.2615601818796196, "deviation-center-line": 0.8665614677342858, "driven_lanedir_consec": 4.28806824293648}}
simulation-passed1
survival_time_max13.250000000000052
survival_time_mean13.250000000000052
survival_time_min13.250000000000052
No reset possible
12091418358András Kalapos 🇭🇺Ep. VI: Return of 3092 v0.6aido-LFI-sim-testingsim-1of4host-erroryeseval030:01:07
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12091018358András Kalapos 🇭🇺Ep. VI: Return of 3092 v0.6aido-LFI-sim-testingsim-1of4host-erroryeseval030:01:07
The container "simul [...]
The container "simulator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12090718358András Kalapos 🇭🇺Ep. VI: Return of 3092 v0.6aido-LFI-sim-testingsim-1of4failedyeseval030:01:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12090218333Bence Haromi007-0.5aido-LFI-sim-validationsim-0of4successyeseval030:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.449999999999985
in-drivable-lane_median0.0
driven_lanedir_consec_median1.2202631680949203
deviation-center-line_median0.2757441766478585


other stats
deviation-center-line_max0.2757441766478585
deviation-center-line_mean0.2757441766478585
deviation-center-line_min0.2757441766478585
deviation-heading_max2.027917370470256
deviation-heading_mean2.027917370470256
deviation-heading_median2.027917370470256
deviation-heading_min2.027917370470256
distance-from-start_max0.954142735385548
distance-from-start_mean0.954142735385548
distance-from-start_median0.954142735385548
distance-from-start_min0.954142735385548
driven_any_max1.2859935721493343
driven_any_mean1.2859935721493343
driven_any_median1.2859935721493343
driven_any_min1.2859935721493343
driven_lanedir_consec_max1.2202631680949203
driven_lanedir_consec_mean1.2202631680949203
driven_lanedir_consec_min1.2202631680949203
driven_lanedir_max1.2202633757459245
driven_lanedir_mean1.2202633757459245
driven_lanedir_median1.2202633757459245
driven_lanedir_min1.2202633757459245
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"4way-000-ego0": {"driven_any": 1.2859935721493343, "survival_time": 6.449999999999985, "driven_lanedir": 1.2202633757459245, "in-drivable-lane": 0.0, "deviation-heading": 2.027917370470256, "distance-from-start": 0.954142735385548, "deviation-center-line": 0.2757441766478585, "driven_lanedir_consec": 1.2202631680949203}}
simulation-passed1
survival_time_max6.449999999999985
survival_time_mean6.449999999999985
survival_time_min6.449999999999985
No reset possible
12089918341Bence Haromi005-0.8aido-LFI-sim-validationsim-1of4successyeseval030:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.900000000000048
in-drivable-lane_median0.6500000000000092
driven_lanedir_consec_median3.8396529481834256
deviation-center-line_median0.9907722867608164


other stats
deviation-center-line_max0.9907722867608164
deviation-center-line_mean0.9907722867608164
deviation-center-line_min0.9907722867608164
deviation-heading_max4.902942017315086
deviation-heading_mean4.902942017315086
deviation-heading_median4.902942017315086
deviation-heading_min4.902942017315086
distance-from-start_max2.3084751540544124
distance-from-start_mean2.3084751540544124
distance-from-start_median2.3084751540544124
distance-from-start_min2.3084751540544124
driven_any_max4.583255764657249
driven_any_mean4.583255764657249
driven_any_median4.583255764657249
driven_any_min4.583255764657249
driven_lanedir_consec_max3.8396529481834256
driven_lanedir_consec_mean3.8396529481834256
driven_lanedir_consec_min3.8396529481834256
driven_lanedir_max4.005398048586582
driven_lanedir_mean4.005398048586582
driven_lanedir_median4.005398048586582
driven_lanedir_min4.005398048586582
in-drivable-lane_max0.6500000000000092
in-drivable-lane_mean0.6500000000000092
in-drivable-lane_min0.6500000000000092
per-episodes
details{"udem1-000-ego0": {"driven_any": 4.583255764657249, "survival_time": 12.900000000000048, "driven_lanedir": 4.005398048586582, "in-drivable-lane": 0.6500000000000092, "deviation-heading": 4.902942017315086, "distance-from-start": 2.3084751540544124, "deviation-center-line": 0.9907722867608164, "driven_lanedir_consec": 3.8396529481834256}}
simulation-passed1
survival_time_max12.900000000000048
survival_time_mean12.900000000000048
survival_time_min12.900000000000048
No reset possible
12089518336Bence Haromi007-0.5aido-LFVI-sim-validationsim-3of4successyeseval030:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12089018336Bence Haromi007-0.5aido-LFVI-sim-validationsim-3of4successyeseval030:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12088718336Bence Haromi007-0.5aido-LFVI-sim-validationsim-3of4successyeseval030:01:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12088318336Bence Haromi007-0.5aido-LFVI-sim-validationsim-3of4successyeseval030:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12087918350Bence Haromi005-0.8aido-LFV_multi-sim-testingsim-1of4failedyeseval030:00:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12087418348Bence Haromi005-0.8aido-LFVI_multi-sim-testingsim-2of4successyeseval030:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12087118348Bence Haromi005-0.8aido-LFVI_multi-sim-testingsim-2of4successyeseval030:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12086718348Bence Haromi005-0.8aido-LFVI_multi-sim-testingsim-2of4successyeseval030:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12086518348Bence Haromi005-0.8aido-LFVI_multi-sim-testingsim-1of4failedyeseval030:01:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12086118359András Kalapos 🇭🇺Ep. VI: Return of 3092 v0.6aido-LFI-sim-validationsim-3of4successyeseval030:01:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12085718359András Kalapos 🇭🇺Ep. VI: Return of 3092 v0.6aido-LFI-sim-validationsim-3of4successyeseval030:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12085318350Bence Haromi005-0.8aido-LFV_multi-sim-testingsim-3of4failedyeseval030:00:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12085018350Bence Haromi005-0.8aido-LFV_multi-sim-testingsim-1of4failedyeseval030:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12084418350Bence Haromi005-0.8aido-LFV_multi-sim-testingsim-3of4failedyeseval030:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12084218341Bence Haromi005-0.8aido-LFI-sim-validationsim-2of4successyeseval030:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12083818343Bence Haromi005-0.8aido-LFP-sim-validationsim-0of4successyeseval030:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.150000000000023
in-drivable-lane_median2.350000000000022
driven_lanedir_consec_median2.8261697330878652
deviation-center-line_median0.7334580661892276


other stats
deviation-center-line_max0.7334580661892276
deviation-center-line_mean0.7334580661892276
deviation-center-line_min0.7334580661892276
deviation-heading_max2.8082731286650353
deviation-heading_mean2.8082731286650353
deviation-heading_median2.8082731286650353
deviation-heading_min2.8082731286650353
distance-from-start_max3.273556851438998
distance-from-start_mean3.273556851438998
distance-from-start_median3.273556851438998
distance-from-start_min3.273556851438998
driven_any_max3.9690895386231753
driven_any_mean3.9690895386231753
driven_any_median3.9690895386231753
driven_any_min3.9690895386231753
driven_lanedir_consec_max2.8261697330878652
driven_lanedir_consec_mean2.8261697330878652
driven_lanedir_consec_min2.8261697330878652
driven_lanedir_max2.8261697330878652
driven_lanedir_mean2.8261697330878652
driven_lanedir_median2.8261697330878652
driven_lanedir_min2.8261697330878652
in-drivable-lane_max2.350000000000022
in-drivable-lane_mean2.350000000000022
in-drivable-lane_min2.350000000000022
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.9690895386231753, "survival_time": 11.150000000000023, "driven_lanedir": 2.8261697330878652, "in-drivable-lane": 2.350000000000022, "deviation-heading": 2.8082731286650353, "distance-from-start": 3.273556851438998, "deviation-center-line": 0.7334580661892276, "driven_lanedir_consec": 2.8261697330878652}}
simulation-passed1
survival_time_max11.150000000000023
survival_time_mean11.150000000000023
survival_time_min11.150000000000023
No reset possible
12083318343Bence Haromi005-0.8aido-LFP-sim-validationsim-0of4successyeseval030:01:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.249999999999989
in-drivable-lane_median0.0
driven_lanedir_consec_median1.5458154020539232
deviation-center-line_median0.31201092452210955


other stats
deviation-center-line_max0.31201092452210955
deviation-center-line_mean0.31201092452210955
deviation-center-line_min0.31201092452210955
deviation-heading_max1.5027003444643712
deviation-heading_mean1.5027003444643712
deviation-heading_median1.5027003444643712
deviation-heading_min1.5027003444643712
distance-from-start_max1.2484898614508773
distance-from-start_mean1.2484898614508773
distance-from-start_median1.2484898614508773
distance-from-start_min1.2484898614508773
driven_any_max1.614835525681631
driven_any_mean1.614835525681631
driven_any_median1.614835525681631
driven_any_min1.614835525681631
driven_lanedir_consec_max1.5458154020539232
driven_lanedir_consec_mean1.5458154020539232
driven_lanedir_consec_min1.5458154020539232
driven_lanedir_max1.5458154020539232
driven_lanedir_mean1.5458154020539232
driven_lanedir_median1.5458154020539232
driven_lanedir_min1.5458154020539232
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 1.614835525681631, "survival_time": 5.249999999999989, "driven_lanedir": 1.5458154020539232, "in-drivable-lane": 0.0, "deviation-heading": 1.5027003444643712, "distance-from-start": 1.2484898614508773, "deviation-center-line": 0.31201092452210955, "driven_lanedir_consec": 1.5458154020539232}}
simulation-passed1
survival_time_max5.249999999999989
survival_time_mean5.249999999999989
survival_time_min5.249999999999989
No reset possible
12082018345Bence Haromi005-0.8aido-LFV-sim-validationsim-0of4successyeseval030:05:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median19.45000000000014
in-drivable-lane_median0.0
driven_lanedir_consec_median7.079317868612827
deviation-center-line_median1.2910650267621877


other stats
deviation-center-line_max1.2910650267621877
deviation-center-line_mean1.2910650267621877
deviation-center-line_min1.2910650267621877
deviation-heading_max3.958294574441231
deviation-heading_mean3.958294574441231
deviation-heading_median3.958294574441231
deviation-heading_min3.958294574441231
distance-from-start_max2.7353129740149194
distance-from-start_mean2.7353129740149194
distance-from-start_median2.7353129740149194
distance-from-start_min2.7353129740149194
driven_any_max7.281824609422092
driven_any_mean7.281824609422092
driven_any_median7.281824609422092
driven_any_min7.281824609422092
driven_lanedir_consec_max7.079317868612827
driven_lanedir_consec_mean7.079317868612827
driven_lanedir_consec_min7.079317868612827
driven_lanedir_max7.079317868612827
driven_lanedir_mean7.079317868612827
driven_lanedir_median7.079317868612827
driven_lanedir_min7.079317868612827
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.281824609422092, "survival_time": 19.45000000000014, "driven_lanedir": 7.079317868612827, "in-drivable-lane": 0.0, "deviation-heading": 3.958294574441231, "distance-from-start": 2.7353129740149194, "deviation-center-line": 1.2910650267621877, "driven_lanedir_consec": 7.079317868612827}}
simulation-passed1
survival_time_max19.45000000000014
survival_time_mean19.45000000000014
survival_time_min19.45000000000014
No reset possible
12081518357Bence Haromi007-0.5aido-LFV_multi-sim-testingsim-3of4failedyeseval030:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12081318357Bence Haromi007-0.5aido-LFV_multi-sim-testingsim-3of4failedyeseval030:00:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12080618357Bence Haromi007-0.5aido-LFV_multi-sim-testingsim-3of4failedyeseval030:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12080118357Bence Haromi007-0.5aido-LFV_multi-sim-testingsim-0of4failedyeseval030:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12079818357Bence Haromi007-0.5aido-LFV_multi-sim-testingsim-3of4failedyeseval030:01:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12077818351Bence Haromi005-0.8aido-LFV_multi-sim-validationsim-3of4successyeseval030:23:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median18.87499999999926
driven_lanedir_consec_median15.187698619494777
deviation-center-line_median2.5998780846470373


other stats
deviation-center-line_max3.731932736057228
deviation-center-line_mean2.2514938923792593
deviation-center-line_min0.0742866641657341
deviation-heading_max12.09820036683571
deviation-heading_mean7.48315679753634
deviation-heading_median8.684928851295993
deviation-heading_min0.4645691207176648
distance-from-start_max4.5431843479911
distance-from-start_mean3.092600973313793
distance-from-start_median3.5650222210355187
distance-from-start_min0.6971751031930339
driven_any_max23.589328974844225
driven_any_mean14.780632045303909
driven_any_median17.413670319464988
driven_any_min0.7058585674414335
driven_lanedir_consec_max22.722931213026826
driven_lanedir_consec_mean13.347894160353295
driven_lanedir_consec_min0.29324818939680064
driven_lanedir_max22.722931213026826
driven_lanedir_mean13.347894160353295
driven_lanedir_median15.187698619494777
driven_lanedir_min0.29324818939680064
in-drivable-lane_max58.94999999999872
in-drivable-lane_mean24.17499999999931
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 0.7058585674414335, "survival_time": 59.99999999999873, "driven_lanedir": 0.29324818939680064, "in-drivable-lane": 58.94999999999872, "deviation-heading": 0.4645691207176648, "distance-from-start": 0.6971751031930339, "deviation-center-line": 0.0742866641657341, "driven_lanedir_consec": 0.29324818939680064}, "zigzag-000-ego1": {"driven_any": 22.91585590687574, "survival_time": 59.99999999999873, "driven_lanedir": 22.27610104563083, "in-drivable-lane": 0.0, "deviation-heading": 11.971400477904435, "distance-from-start": 3.3270250100282226, "deviation-center-line": 3.731932736057228, "driven_lanedir_consec": 22.27610104563083}, "zigzag-000-ego2": {"driven_any": 23.589328974844225, "survival_time": 59.99999999999873, "driven_lanedir": 22.722931213026826, "in-drivable-lane": 0.3499999999999801, "deviation-heading": 12.09820036683571, "distance-from-start": 3.8030194320428152, "deviation-center-line": 3.537923177943846, "driven_lanedir_consec": 22.722931213026826}, "zigzag-000-ego3": {"driven_any": 11.911484732054236, "survival_time": 59.99999999999873, "driven_lanedir": 8.099296193358722, "in-drivable-lane": 37.39999999999854, "deviation-heading": 5.398457224687551, "distance-from-start": 4.5431843479911, "deviation-center-line": 1.6618329913502283, "driven_lanedir_consec": 8.099296193358722}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12077518336Bence Haromi007-0.5aido-LFVI-sim-validationsim-2of4successyeseval030:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12077018336Bence Haromi007-0.5aido-LFVI-sim-validationsim-0of4failedyeseval030:01:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12076818336Bence Haromi007-0.5aido-LFVI-sim-validationsim-2of4successyeseval030:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12076518337Bence Haromi007-0.5aido-LFVI_multi-sim-validationsim-3of4successyeseval030:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
12075418338Bence Haromi007-0.5aido-LFV_multi-sim-validationsim-3of4successyeseval030:23:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median15.35268036670497
deviation-center-line_median1.446050190528413


other stats
deviation-center-line_max1.6406418062027173
deviation-center-line_mean1.455455012508193
deviation-center-line_min1.2890778627732289
deviation-heading_max5.9970001278690015
deviation-heading_mean5.4104221947694136
deviation-heading_median5.434438010026479
deviation-heading_min4.7758126311556905
distance-from-start_max4.464159071100733
distance-from-start_mean3.8156273684196225
distance-from-start_median3.7680187221893218
distance-from-start_min3.2623129581991153
driven_any_max15.523834252005642
driven_any_mean15.427502247370237
driven_any_median15.451655736860893
driven_any_min15.282863263753514
driven_lanedir_consec_max15.444569232174258
driven_lanedir_consec_mean15.330262434498476
driven_lanedir_consec_min15.1711197724097
driven_lanedir_max15.444569232174258
driven_lanedir_mean15.330262434498476
driven_lanedir_median15.35268036670497
driven_lanedir_min15.1711197724097
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 15.47750954887352, "survival_time": 59.99999999999873, "driven_lanedir": 15.395767355196618, "in-drivable-lane": 0.0, "deviation-heading": 4.940501774373231, "distance-from-start": 3.7784170040742624, "deviation-center-line": 1.2890778627732289, "driven_lanedir_consec": 15.395767355196618}, "zigzag-000-ego1": {"driven_any": 15.425801924848267, "survival_time": 59.99999999999873, "driven_lanedir": 15.30959337821332, "in-drivable-lane": 0.0, "deviation-heading": 5.9970001278690015, "distance-from-start": 3.2623129581991153, "deviation-center-line": 1.5980658492922024, "driven_lanedir_consec": 15.30959337821332}, "zigzag-000-ego2": {"driven_any": 15.523834252005642, "survival_time": 59.99999999999873, "driven_lanedir": 15.444569232174258, "in-drivable-lane": 0.0, "deviation-heading": 4.7758126311556905, "distance-from-start": 3.75762044030438, "deviation-center-line": 1.2940345317646242, "driven_lanedir_consec": 15.444569232174258}, "zigzag-000-ego3": {"driven_any": 15.282863263753514, "survival_time": 59.99999999999873, "driven_lanedir": 15.1711197724097, "in-drivable-lane": 0.0, "deviation-heading": 5.928374245679729, "distance-from-start": 4.464159071100733, "deviation-center-line": 1.6406418062027173, "driven_lanedir_consec": 15.1711197724097}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12075018334Bence Haromi007-0.5aido-LFP-sim-validationsim-2of4successyeseval030:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.200000000000024
in-drivable-lane_median0.0
driven_lanedir_consec_median2.539636457026094
deviation-center-line_median0.32366527265935197


other stats
deviation-center-line_max0.32366527265935197
deviation-center-line_mean0.32366527265935197
deviation-center-line_min0.32366527265935197
deviation-heading_max1.4034768840963665
deviation-heading_mean1.4034768840963665
deviation-heading_median1.4034768840963665
deviation-heading_min1.4034768840963665
distance-from-start_max1.043886081201375
distance-from-start_mean1.043886081201375
distance-from-start_median1.043886081201375
distance-from-start_min1.043886081201375
driven_any_max2.5639145478066947
driven_any_mean2.5639145478066947
driven_any_median2.5639145478066947
driven_any_min2.5639145478066947
driven_lanedir_consec_max2.539636457026094
driven_lanedir_consec_mean2.539636457026094
driven_lanedir_consec_min2.539636457026094
driven_lanedir_max2.539636457026094
driven_lanedir_mean2.539636457026094
driven_lanedir_median2.539636457026094
driven_lanedir_min2.539636457026094
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 2.5639145478066947, "survival_time": 11.200000000000024, "driven_lanedir": 2.539636457026094, "in-drivable-lane": 0.0, "deviation-heading": 1.4034768840963665, "distance-from-start": 1.043886081201375, "deviation-center-line": 0.32366527265935197, "driven_lanedir_consec": 2.539636457026094}}
simulation-passed1
survival_time_max11.200000000000024
survival_time_mean11.200000000000024
survival_time_min11.200000000000024
No reset possible
12074818332Sampsa RantaQuack² - Hello Worldaido-LF-sim-validationsim-3of4successyeseval030:06:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.082657308360545
survival_time_median59.99999999999873
deviation-center-line_median2.4674335088032695
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.4674335088032695
deviation-center-line_mean2.4674335088032695
deviation-center-line_min2.4674335088032695
deviation-heading_max9.85005878232334
deviation-heading_mean9.85005878232334
deviation-heading_median9.85005878232334
deviation-heading_min9.85005878232334
distance-from-start_max3.618688977544461
distance-from-start_mean3.618688977544461
distance-from-start_median3.618688977544461
distance-from-start_min3.618688977544461
driven_any_max6.243115214110524
driven_any_mean6.243115214110524
driven_any_median6.243115214110524
driven_any_min6.243115214110524
driven_lanedir_consec_max6.082657308360545
driven_lanedir_consec_mean6.082657308360545
driven_lanedir_consec_min6.082657308360545
driven_lanedir_max6.082657308360545
driven_lanedir_mean6.082657308360545
driven_lanedir_median6.082657308360545
driven_lanedir_min6.082657308360545
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.243115214110524, "survival_time": 59.99999999999873, "driven_lanedir": 6.082657308360545, "in-drivable-lane": 0.0, "deviation-heading": 9.85005878232334, "distance-from-start": 3.618688977544461, "deviation-center-line": 2.4674335088032695, "driven_lanedir_consec": 6.082657308360545}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12074318332Sampsa RantaQuack² - Hello Worldaido-LF-sim-validationsim-3of4successyeseval030:06:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.071681106863965
survival_time_median59.99999999999873
deviation-center-line_median2.4864646905099965
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.4864646905099965
deviation-center-line_mean2.4864646905099965
deviation-center-line_min2.4864646905099965
deviation-heading_max10.022798120345398
deviation-heading_mean10.022798120345398
deviation-heading_median10.022798120345398
deviation-heading_min10.022798120345398
distance-from-start_max3.6170627479918793
distance-from-start_mean3.6170627479918793
distance-from-start_median3.6170627479918793
distance-from-start_min3.6170627479918793
driven_any_max6.237872641319936
driven_any_mean6.237872641319936
driven_any_median6.237872641319936
driven_any_min6.237872641319936
driven_lanedir_consec_max6.071681106863965
driven_lanedir_consec_mean6.071681106863965
driven_lanedir_consec_min6.071681106863965
driven_lanedir_max6.071681106863965
driven_lanedir_mean6.071681106863965
driven_lanedir_median6.071681106863965
driven_lanedir_min6.071681106863965
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.237872641319936, "survival_time": 59.99999999999873, "driven_lanedir": 6.071681106863965, "in-drivable-lane": 0.0, "deviation-heading": 10.022798120345398, "distance-from-start": 3.6170627479918793, "deviation-center-line": 2.4864646905099965, "driven_lanedir_consec": 6.071681106863965}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12073718331Sampsa RantaQuack² - Hello Worldaido-LF-sim-validationsim-3of4successyeseval030:05:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.056000085488584
survival_time_median59.99999999999873
deviation-center-line_median2.8314744229008126
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.8314744229008126
deviation-center-line_mean2.8314744229008126
deviation-center-line_min2.8314744229008126
deviation-heading_max10.528668982245966
deviation-heading_mean10.528668982245966
deviation-heading_median10.528668982245966
deviation-heading_min10.528668982245966
distance-from-start_max3.642512564640195
distance-from-start_mean3.642512564640195
distance-from-start_median3.642512564640195
distance-from-start_min3.642512564640195
driven_any_max6.243104886655275
driven_any_mean6.243104886655275
driven_any_median6.243104886655275
driven_any_min6.243104886655275
driven_lanedir_consec_max6.056000085488584
driven_lanedir_consec_mean6.056000085488584
driven_lanedir_consec_min6.056000085488584
driven_lanedir_max6.056000085488584
driven_lanedir_mean6.056000085488584
driven_lanedir_median6.056000085488584
driven_lanedir_min6.056000085488584
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.243104886655275, "survival_time": 59.99999999999873, "driven_lanedir": 6.056000085488584, "in-drivable-lane": 0.0, "deviation-heading": 10.528668982245966, "distance-from-start": 3.642512564640195, "deviation-center-line": 2.8314744229008126, "driven_lanedir_consec": 6.056000085488584}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12073318331Sampsa RantaQuack² - Hello Worldaido-LF-sim-validationsim-3of4successyeseval030:05:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.060008351234069
survival_time_median59.99999999999873
deviation-center-line_median2.815748234193231
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.815748234193231
deviation-center-line_mean2.815748234193231
deviation-center-line_min2.815748234193231
deviation-heading_max10.441994631581192
deviation-heading_mean10.441994631581192
deviation-heading_median10.441994631581192
deviation-heading_min10.441994631581192
distance-from-start_max3.642113337998656
distance-from-start_mean3.642113337998656
distance-from-start_median3.642113337998656
distance-from-start_min3.642113337998656
driven_any_max6.243105530204672
driven_any_mean6.243105530204672
driven_any_median6.243105530204672
driven_any_min6.243105530204672
driven_lanedir_consec_max6.060008351234069
driven_lanedir_consec_mean6.060008351234069
driven_lanedir_consec_min6.060008351234069
driven_lanedir_max6.060008351234069
driven_lanedir_mean6.060008351234069
driven_lanedir_median6.060008351234069
driven_lanedir_min6.060008351234069
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"zigzag-000-ego0": {"driven_any": 6.243105530204672, "survival_time": 59.99999999999873, "driven_lanedir": 6.060008351234069, "in-drivable-lane": 0.0, "deviation-heading": 10.441994631581192, "distance-from-start": 3.642113337998656, "deviation-center-line": 2.815748234193231, "driven_lanedir_consec": 6.060008351234069}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12073118320Andras BeresI work in reality! (full state feedback)aido-LF-sim-validationsim-2of4failedyeseval030:00:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12072818330Sampsa RantaQuack² - Hello Worldaido-LF-sim-validationsim-0of4successyeseval030:05:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.214807602872161
survival_time_median59.99999999999873
deviation-center-line_median1.1207219282867504
in-drivable-lane_median0.0


other stats
deviation-center-line_max1.1207219282867504
deviation-center-line_mean1.1207219282867504
deviation-center-line_min1.1207219282867504
deviation-heading_max3.9459792120572574
deviation-heading_mean3.9459792120572574
deviation-heading_median3.9459792120572574
deviation-heading_min3.9459792120572574
distance-from-start_max2.54889522532609
distance-from-start_mean2.54889522532609
distance-from-start_median2.54889522532609
distance-from-start_min2.54889522532609
driven_any_max6.243168257529151
driven_any_mean6.243168257529151
driven_any_median6.243168257529151
driven_any_min6.243168257529151
driven_lanedir_consec_max6.214807602872161
driven_lanedir_consec_mean6.214807602872161
driven_lanedir_consec_min6.214807602872161
driven_lanedir_max6.214807602872161
driven_lanedir_mean6.214807602872161
driven_lanedir_median6.214807602872161
driven_lanedir_min6.214807602872161
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 6.243168257529151, "survival_time": 59.99999999999873, "driven_lanedir": 6.214807602872161, "in-drivable-lane": 0.0, "deviation-heading": 3.9459792120572574, "distance-from-start": 2.54889522532609, "deviation-center-line": 1.1207219282867504, "driven_lanedir_consec": 6.214807602872161}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12072218320Andras BeresI work in reality! (full state feedback)aido-LF-sim-validationsim-2of4failedyeseval030:00:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12071818306Bence Haromi007-0.7aido-LF-sim-testingsim-2of4successyeseval030:05:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median20.418330007814006
survival_time_median59.99999999999873
deviation-center-line_median1.68274715461081
in-drivable-lane_median0.09999999999999964


other stats
deviation-center-line_max1.68274715461081
deviation-center-line_mean1.68274715461081
deviation-center-line_min1.68274715461081
deviation-heading_max5.623062005155012
deviation-heading_mean5.623062005155012
deviation-heading_median5.623062005155012
deviation-heading_min5.623062005155012
distance-from-start_max1.0616941060611171
distance-from-start_mean1.0616941060611171
distance-from-start_median1.0616941060611171
distance-from-start_min1.0616941060611171
driven_any_max20.62560892364699
driven_any_mean20.62560892364699
driven_any_median20.62560892364699
driven_any_min20.62560892364699
driven_lanedir_consec_max20.418330007814006
driven_lanedir_consec_mean20.418330007814006
driven_lanedir_consec_min20.418330007814006
driven_lanedir_max20.418330007814006
driven_lanedir_mean20.418330007814006
driven_lanedir_median20.418330007814006
driven_lanedir_min20.418330007814006
in-drivable-lane_max0.09999999999999964
in-drivable-lane_mean0.09999999999999964
in-drivable-lane_min0.09999999999999964
per-episodes
details{"loop2-000-ego0": {"driven_any": 20.62560892364699, "survival_time": 59.99999999999873, "driven_lanedir": 20.418330007814006, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 5.623062005155012, "distance-from-start": 1.0616941060611171, "deviation-center-line": 1.68274715461081, "driven_lanedir_consec": 20.418330007814006}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12071418306Bence Haromi007-0.7aido-LF-sim-testingsim-0of4successyeseval030:06:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median19.516212296536583
survival_time_median59.99999999999873
deviation-center-line_median2.0542291853140133
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.0542291853140133
deviation-center-line_mean2.0542291853140133
deviation-center-line_min2.0542291853140133
deviation-heading_max8.972637368901024
deviation-heading_mean8.972637368901024
deviation-heading_median8.972637368901024
deviation-heading_min8.972637368901024
distance-from-start_max3.960240300096253
distance-from-start_mean3.960240300096253
distance-from-start_median3.960240300096253
distance-from-start_min3.960240300096253
driven_any_max19.883578409281142
driven_any_mean19.883578409281142
driven_any_median19.883578409281142
driven_any_min19.883578409281142
driven_lanedir_consec_max19.516212296536583
driven_lanedir_consec_mean19.516212296536583
driven_lanedir_consec_min19.516212296536583
driven_lanedir_max19.516212296536583
driven_lanedir_mean19.516212296536583
driven_lanedir_median19.516212296536583
driven_lanedir_min19.516212296536583
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 19.883578409281142, "survival_time": 59.99999999999873, "driven_lanedir": 19.516212296536583, "in-drivable-lane": 0.0, "deviation-heading": 8.972637368901024, "distance-from-start": 3.960240300096253, "deviation-center-line": 2.0542291853140133, "driven_lanedir_consec": 19.516212296536583}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12070918315Bence Haromi005-0.5aido-LF-sim-testingsim-2of4successyeseval030:05:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median15.335028587455804
survival_time_median59.99999999999873
deviation-center-line_median2.683739067348231
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.683739067348231
deviation-center-line_mean2.683739067348231
deviation-center-line_min2.683739067348231
deviation-heading_max7.922720653576944
deviation-heading_mean7.922720653576944
deviation-heading_median7.922720653576944
deviation-heading_min7.922720653576944
distance-from-start_max1.0757070288050454
distance-from-start_mean1.0757070288050454
distance-from-start_median1.0757070288050454
distance-from-start_min1.0757070288050454
driven_any_max15.494037834890737
driven_any_mean15.494037834890737
driven_any_median15.494037834890737
driven_any_min15.494037834890737
driven_lanedir_consec_max15.335028587455804
driven_lanedir_consec_mean15.335028587455804
driven_lanedir_consec_min15.335028587455804
driven_lanedir_max15.335028587455804
driven_lanedir_mean15.335028587455804
driven_lanedir_median15.335028587455804
driven_lanedir_min15.335028587455804
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 15.494037834890737, "survival_time": 59.99999999999873, "driven_lanedir": 15.335028587455804, "in-drivable-lane": 0.0, "deviation-heading": 7.922720653576944, "distance-from-start": 1.0757070288050454, "deviation-center-line": 2.683739067348231, "driven_lanedir_consec": 15.335028587455804}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12070518323Bence Haromi005-0.8aido-LF-sim-testingsim-2of4successyeseval030:06:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median21.450081609736905
survival_time_median59.99999999999873
deviation-center-line_median3.932505197338749
in-drivable-lane_median0.0


other stats
deviation-center-line_max3.932505197338749
deviation-center-line_mean3.932505197338749
deviation-center-line_min3.932505197338749
deviation-heading_max12.708328093382248
deviation-heading_mean12.708328093382248
deviation-heading_median12.708328093382248
deviation-heading_min12.708328093382248
distance-from-start_max1.1279720724569944
distance-from-start_mean1.1279720724569944
distance-from-start_median1.1279720724569944
distance-from-start_min1.1279720724569944
driven_any_max22.147506210913836
driven_any_mean22.147506210913836
driven_any_median22.147506210913836
driven_any_min22.147506210913836
driven_lanedir_consec_max21.450081609736905
driven_lanedir_consec_mean21.450081609736905
driven_lanedir_consec_min21.450081609736905
driven_lanedir_max21.450081609736905
driven_lanedir_mean21.450081609736905
driven_lanedir_median21.450081609736905
driven_lanedir_min21.450081609736905
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"loop2-000-ego0": {"driven_any": 22.147506210913836, "survival_time": 59.99999999999873, "driven_lanedir": 21.450081609736905, "in-drivable-lane": 0.0, "deviation-heading": 12.708328093382248, "distance-from-start": 1.1279720724569944, "deviation-center-line": 3.932505197338749, "driven_lanedir_consec": 21.450081609736905}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12070218323Bence Haromi005-0.8aido-LF-sim-testingsim-2of4successyeseval030:06:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median20.31634610745462
survival_time_median59.99999999999873
deviation-center-line_median4.349857144254672
in-drivable-lane_median1.8499999999999768


other stats
deviation-center-line_max4.349857144254672
deviation-center-line_mean4.349857144254672
deviation-center-line_min4.349857144254672
deviation-heading_max15.913717055976216
deviation-heading_mean15.913717055976216
deviation-heading_median15.913717055976216
deviation-heading_min15.913717055976216
distance-from-start_max1.1502885864019097
distance-from-start_mean1.1502885864019097
distance-from-start_median1.1502885864019097
distance-from-start_min1.1502885864019097
driven_any_max22.10350790945864
driven_any_mean22.10350790945864
driven_any_median22.10350790945864
driven_any_min22.10350790945864
driven_lanedir_consec_max20.31634610745462
driven_lanedir_consec_mean20.31634610745462
driven_lanedir_consec_min20.31634610745462
driven_lanedir_max20.31634610745462
driven_lanedir_mean20.31634610745462
driven_lanedir_median20.31634610745462
driven_lanedir_min20.31634610745462
in-drivable-lane_max1.8499999999999768
in-drivable-lane_mean1.8499999999999768
in-drivable-lane_min1.8499999999999768
per-episodes
details{"loop2-000-ego0": {"driven_any": 22.10350790945864, "survival_time": 59.99999999999873, "driven_lanedir": 20.31634610745462, "in-drivable-lane": 1.8499999999999768, "deviation-heading": 15.913717055976216, "distance-from-start": 1.1502885864019097, "deviation-center-line": 4.349857144254672, "driven_lanedir_consec": 20.31634610745462}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12069818327Bence Haromi005-1.0aido-LF-sim-testingsim-0of4successyeseval030:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6693898865979717
survival_time_median8.899999999999991
deviation-center-line_median0.4370219073127194
in-drivable-lane_median2.800000000000005


other stats
deviation-center-line_max0.4370219073127194
deviation-center-line_mean0.4370219073127194
deviation-center-line_min0.4370219073127194
deviation-heading_max2.064315989791759
deviation-heading_mean2.064315989791759
deviation-heading_median2.064315989791759
deviation-heading_min2.064315989791759
distance-from-start_max3.0504233152798887
distance-from-start_mean3.0504233152798887
distance-from-start_median3.0504233152798887
distance-from-start_min3.0504233152798887
driven_any_max3.884795758663562
driven_any_mean3.884795758663562
driven_any_median3.884795758663562
driven_any_min3.884795758663562
driven_lanedir_consec_max2.6693898865979717
driven_lanedir_consec_mean2.6693898865979717
driven_lanedir_consec_min2.6693898865979717
driven_lanedir_max2.6693898865979717
driven_lanedir_mean2.6693898865979717
driven_lanedir_median2.6693898865979717
driven_lanedir_min2.6693898865979717
in-drivable-lane_max2.800000000000005
in-drivable-lane_mean2.800000000000005
in-drivable-lane_min2.800000000000005
per-episodes
details{"autolab-000-ego0": {"driven_any": 3.884795758663562, "survival_time": 8.899999999999991, "driven_lanedir": 2.6693898865979717, "in-drivable-lane": 2.800000000000005, "deviation-heading": 2.064315989791759, "distance-from-start": 3.0504233152798887, "deviation-center-line": 0.4370219073127194, "driven_lanedir_consec": 2.6693898865979717}}
simulation-passed1
survival_time_max8.899999999999991
survival_time_mean8.899999999999991
survival_time_min8.899999999999991
No reset possible
12069418327Bence Haromi005-1.0aido-LF-sim-testingsim-3of4successyeseval030:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.46920172003402527
survival_time_median4.849999999999991
deviation-center-line_median0.14789940880793978
in-drivable-lane_median3.1499999999999897


other stats
deviation-center-line_max0.14789940880793978
deviation-center-line_mean0.14789940880793978
deviation-center-line_min0.14789940880793978
deviation-heading_max0.9546394820060886
deviation-heading_mean0.9546394820060886
deviation-heading_median0.9546394820060886
deviation-heading_min0.9546394820060886
distance-from-start_max1.671234326533182
distance-from-start_mean1.671234326533182
distance-from-start_median1.671234326533182
distance-from-start_min1.671234326533182
driven_any_max1.8168216618974429
driven_any_mean1.8168216618974429
driven_any_median1.8168216618974429
driven_any_min1.8168216618974429
driven_lanedir_consec_max0.46920172003402527
driven_lanedir_consec_mean0.46920172003402527
driven_lanedir_consec_min0.46920172003402527
driven_lanedir_max0.46920172003402527
driven_lanedir_mean0.46920172003402527
driven_lanedir_median0.46920172003402527
driven_lanedir_min0.46920172003402527
in-drivable-lane_max3.1499999999999897
in-drivable-lane_mean3.1499999999999897
in-drivable-lane_min3.1499999999999897
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.8168216618974429, "survival_time": 4.849999999999991, "driven_lanedir": 0.46920172003402527, "in-drivable-lane": 3.1499999999999897, "deviation-heading": 0.9546394820060886, "distance-from-start": 1.671234326533182, "deviation-center-line": 0.14789940880793978, "driven_lanedir_consec": 0.46920172003402527}}
simulation-passed1
survival_time_max4.849999999999991
survival_time_mean4.849999999999991
survival_time_min4.849999999999991
No reset possible
12069018327Bence Haromi005-1.0aido-LF-sim-testingsim-3of4successyeseval030:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.43966783513217367
survival_time_median5.09999999999999
deviation-center-line_median0.13705899961211926
in-drivable-lane_median3.449999999999989


other stats
deviation-center-line_max0.13705899961211926
deviation-center-line_mean0.13705899961211926
deviation-center-line_min0.13705899961211926
deviation-heading_max0.9349976232759066
deviation-heading_mean0.9349976232759066
deviation-heading_median0.9349976232759066
deviation-heading_min0.9349976232759066
distance-from-start_max1.6439260449733306
distance-from-start_mean1.6439260449733306
distance-from-start_median1.6439260449733306
distance-from-start_min1.6439260449733306
driven_any_max1.8633553413895236
driven_any_mean1.8633553413895236
driven_any_median1.8633553413895236
driven_any_min1.8633553413895236
driven_lanedir_consec_max0.43966783513217367
driven_lanedir_consec_mean0.43966783513217367
driven_lanedir_consec_min0.43966783513217367
driven_lanedir_max0.43966783513217367
driven_lanedir_mean0.43966783513217367
driven_lanedir_median0.43966783513217367
driven_lanedir_min0.43966783513217367
in-drivable-lane_max3.449999999999989
in-drivable-lane_mean3.449999999999989
in-drivable-lane_min3.449999999999989
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.8633553413895236, "survival_time": 5.09999999999999, "driven_lanedir": 0.43966783513217367, "in-drivable-lane": 3.449999999999989, "deviation-heading": 0.9349976232759066, "distance-from-start": 1.6439260449733306, "deviation-center-line": 0.13705899961211926, "driven_lanedir_consec": 0.43966783513217367}}
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean5.09999999999999
survival_time_min5.09999999999999
No reset possible
12068918327Bence Haromi005-1.0aido-LF-sim-testingsim-3of4successyeseval030:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4401697227614106
survival_time_median4.99999999999999
deviation-center-line_median0.13761423373615203
in-drivable-lane_median3.3499999999999894


other stats
deviation-center-line_max0.13761423373615203
deviation-center-line_mean0.13761423373615203
deviation-center-line_min0.13761423373615203
deviation-heading_max0.9346494316149496
deviation-heading_mean0.9346494316149496
deviation-heading_median0.9346494316149496
deviation-heading_min0.9346494316149496
distance-from-start_max1.6527650114551984
distance-from-start_mean1.6527650114551984
distance-from-start_median1.6527650114551984
distance-from-start_min1.6527650114551984
driven_any_max1.8358255881438403
driven_any_mean1.8358255881438403
driven_any_median1.8358255881438403
driven_any_min1.8358255881438403
driven_lanedir_consec_max0.4401697227614106
driven_lanedir_consec_mean0.4401697227614106
driven_lanedir_consec_min0.4401697227614106
driven_lanedir_max0.4401697227614106
driven_lanedir_mean0.4401697227614106
driven_lanedir_median0.4401697227614106
driven_lanedir_min0.4401697227614106
in-drivable-lane_max3.3499999999999894
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min3.3499999999999894
per-episodes
details{"zigzag-000-ego0": {"driven_any": 1.8358255881438403, "survival_time": 4.99999999999999, "driven_lanedir": 0.4401697227614106, "in-drivable-lane": 3.3499999999999894, "deviation-heading": 0.9346494316149496, "distance-from-start": 1.6527650114551984, "deviation-center-line": 0.13761423373615203, "driven_lanedir_consec": 0.4401697227614106}}
simulation-passed1
survival_time_max4.99999999999999
survival_time_mean4.99999999999999
survival_time_min4.99999999999999
No reset possible
12068318319Bence Haromi005-0.7aido-LF-sim-testingsim-3of4successyeseval030:07:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median19.79782581196372
survival_time_median59.99999999999873
deviation-center-line_median3.1661835356553207
in-drivable-lane_median0.10000000000000142


other stats
deviation-center-line_max3.1661835356553207
deviation-center-line_mean3.1661835356553207
deviation-center-line_min3.1661835356553207
deviation-heading_max10.8899002812844
deviation-heading_mean10.8899002812844
deviation-heading_median10.8899002812844
deviation-heading_min10.8899002812844
distance-from-start_max3.3327801711901084
distance-from-start_mean3.3327801711901084
distance-from-start_median3.3327801711901084
distance-from-start_min3.3327801711901084
driven_any_max20.324624482134546
driven_any_mean20.324624482134546
driven_any_median20.324624482134546
driven_any_min20.324624482134546
driven_lanedir_consec_max19.79782581196372
driven_lanedir_consec_mean19.79782581196372
driven_lanedir_consec_min19.79782581196372
driven_lanedir_max19.79782581196372
driven_lanedir_mean19.79782581196372
driven_lanedir_median19.79782581196372
driven_lanedir_min19.79782581196372
in-drivable-lane_max0.10000000000000142
in-drivable-lane_mean0.10000000000000142
in-drivable-lane_min0.10000000000000142
per-episodes
details{"zigzag-000-ego0": {"driven_any": 20.324624482134546, "survival_time": 59.99999999999873, "driven_lanedir": 19.79782581196372, "in-drivable-lane": 0.10000000000000142, "deviation-heading": 10.8899002812844, "distance-from-start": 3.3327801711901084, "deviation-center-line": 3.1661835356553207, "driven_lanedir_consec": 19.79782581196372}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12067818319Bence Haromi005-0.7aido-LF-sim-testingsim-0of4successyeseval030:06:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median21.179627242542573
survival_time_median59.99999999999873
deviation-center-line_median2.5328411555812935
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.5328411555812935
deviation-center-line_mean2.5328411555812935
deviation-center-line_min2.5328411555812935
deviation-heading_max8.495172470999933
deviation-heading_mean8.495172470999933
deviation-heading_median8.495172470999933
deviation-heading_min8.495172470999933
distance-from-start_max4.0040447042777885
distance-from-start_mean4.0040447042777885
distance-from-start_median4.0040447042777885
distance-from-start_min4.0040447042777885
driven_any_max21.523000343509302
driven_any_mean21.523000343509302
driven_any_median21.523000343509302
driven_any_min21.523000343509302
driven_lanedir_consec_max21.179627242542573
driven_lanedir_consec_mean21.179627242542573
driven_lanedir_consec_min21.179627242542573
driven_lanedir_max21.179627242542573
driven_lanedir_mean21.179627242542573
driven_lanedir_median21.179627242542573
driven_lanedir_min21.179627242542573
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"autolab-000-ego0": {"driven_any": 21.523000343509302, "survival_time": 59.99999999999873, "driven_lanedir": 21.179627242542573, "in-drivable-lane": 0.0, "deviation-heading": 8.495172470999933, "distance-from-start": 4.0040447042777885, "deviation-center-line": 2.5328411555812935, "driven_lanedir_consec": 21.179627242542573}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12067418325Bence Haromi005-0.9aido-LF-sim-testingsim-1of4successyeseval030:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.419155639530198
survival_time_median26.55000000000024
deviation-center-line_median1.5763778264320794
in-drivable-lane_median3.500000000000046


other stats
deviation-center-line_max1.5763778264320794
deviation-center-line_mean1.5763778264320794
deviation-center-line_min1.5763778264320794
deviation-heading_max6.152142331161876
deviation-heading_mean6.152142331161876
deviation-heading_median6.152142331161876
deviation-heading_min6.152142331161876
distance-from-start_max2.574491820492299
distance-from-start_mean2.574491820492299
distance-from-start_median2.574491820492299
distance-from-start_min2.574491820492299
driven_any_max11.26279116387606
driven_any_mean11.26279116387606
driven_any_median11.26279116387606
driven_any_min11.26279116387606
driven_lanedir_consec_max9.419155639530198
driven_lanedir_consec_mean9.419155639530198
driven_lanedir_consec_min9.419155639530198
driven_lanedir_max9.419155639530198
driven_lanedir_mean9.419155639530198
driven_lanedir_median9.419155639530198
driven_lanedir_min9.419155639530198
in-drivable-lane_max3.500000000000046
in-drivable-lane_mean3.500000000000046
in-drivable-lane_min3.500000000000046
per-episodes
details{"loop-000-ego0": {"driven_any": 11.26279116387606, "survival_time": 26.55000000000024, "driven_lanedir": 9.419155639530198, "in-drivable-lane": 3.500000000000046, "deviation-heading": 6.152142331161876, "distance-from-start": 2.574491820492299, "deviation-center-line": 1.5763778264320794, "driven_lanedir_consec": 9.419155639530198}}
simulation-passed1
survival_time_max26.55000000000024
survival_time_mean26.55000000000024
survival_time_min26.55000000000024
No reset possible
12067118325Bence Haromi005-0.9aido-LF-sim-testingsim-1of4successyeseval030:03:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.62423038235905
survival_time_median25.10000000000022
deviation-center-line_median1.5245754263831244
in-drivable-lane_median2.3000000000000327


other stats
deviation-center-line_max1.5245754263831244
deviation-center-line_mean1.5245754263831244
deviation-center-line_min1.5245754263831244
deviation-heading_max5.7536059452294745
deviation-heading_mean5.7536059452294745
deviation-heading_median5.7536059452294745
deviation-heading_min5.7536059452294745
distance-from-start_max2.5875131401755143
distance-from-start_mean2.5875131401755143
distance-from-start_median2.5875131401755143
distance-from-start_min2.5875131401755143
driven_any_max10.743724026436766
driven_any_mean10.743724026436766
driven_any_median10.743724026436766
driven_any_min10.743724026436766
driven_lanedir_consec_max9.62423038235905
driven_lanedir_consec_mean9.62423038235905
driven_lanedir_consec_min9.62423038235905
driven_lanedir_max9.62423038235905
driven_lanedir_mean<