Duckietown Challenges Home Challenges Submissions

Evaluator 4920

ID4920
evaluatornogpu-prod-08
ownerI don't have one 😀
machinenogpu-prod_00a1f415cc0e
processnogpu-prod-08_00a1f415cc0e
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success21 58154
# timeout
# failed6 58419
# error
# aborted4 58252
# host-error12 59135
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6014611012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6014311012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:27
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6013811010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:28
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6013511010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6013110933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6012510933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:34
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6012310933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6000411772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5995311425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-erroryesnogpu-prod-080:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5994811425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-erroryesnogpu-prod-080:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5992712671Bea Baselines 🐤baseline-duckietownaido5-LFP-sim-validationLFP-simhost-erroryesnogpu-prod-080:01:58
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5913510357Liam Paull 🇨🇦exercise_ros_templateaido5-LF-sanitysanity-checkhost-erroryesnogpu-prod-081:02:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [e848bc0b768482dc073e839482f2bf9f55bc35c0a536f0e5977c1b5cf729f2bc,
│                 5129649a6980f4a62cf17abbcf0b5f957aff28955d05c17c3425fabb8b4839da,
│                 f8ffc2b1da601a0aa149f57817da0c85da9d1904ca5536e2f96a863d9481fb1e]
│      services: dict[4]
│                │ solution:
│                │ dict[6]
│                │ │ image: docker.io/liampaull/aido-submissions@sha256:0e6149fb63f05b53e2772095f6186214ca66a9ff55fade22eb7d8d822a931cf8
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10357
│                │ │ │ submitter_name: Liam Paull
│                │ │ │ SUBMISSION_CONTAINER: docker.io/liampaull/aido-submissions:2020_10_03_21_36_43@sha256:0e6149fb63f05b53e2772095f6186214ca66a9ff55fade22eb7d8d822a931cf8
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-08_00a1f415cc0e}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_54-19644/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ evaluator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:9f8c352de4d76e7de198d4dea8278469907949f1ca0595b4e2e12c509be34491
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 0.5
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |
│                │ │ │ |port: 10123 # visualization port
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10357
│                │ │ │ submitter_name: Liam Paull
│                │ │ │ SUBMISSION_CONTAINER: docker.io/liampaull/aido-submissions:2020_10_03_21_36_43@sha256:0e6149fb63f05b53e2772095f6186214ca66a9ff55fade22eb7d8d822a931cf8
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-08_00a1f415cc0e}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_54-19644/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:af0283a494930b4d3448453526d9c22469233f65218cb6c37753c3aae5162cbb
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10357
│                │ │ │ submitter_name: Liam Paull
│                │ │ │ SUBMISSION_CONTAINER: docker.io/liampaull/aido-submissions:2020_10_03_21_36_43@sha256:0e6149fb63f05b53e2772095f6186214ca66a9ff55fade22eb7d8d822a931cf8
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-08_00a1f415cc0e}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_54-19644/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ scenario_maker:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:e980f12a61e1e1b37982b6b2a5bc22ef89144f627bf1e6ebaeeac554e4bfb877
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |maps:
│                │ │ │ |- udem1
│                │ │ │ |scenarios_per_map: 1
│                │ │ │ |robots_npcs: []
│                │ │ │ |robots_pcs: [ego]
│                │ │ │ |robots_parked: [parked]
│                │ │ │ |nduckies: 1
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/scenario_maker-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10357
│                │ │ │ submitter_name: Liam Paull
│                │ │ │ SUBMISSION_CONTAINER: docker.io/liampaull/aido-submissions:2020_10_03_21_36_43@sha256:0e6149fb63f05b53e2772095f6186214ca66a9ff55fade22eb7d8d822a931cf8
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-08_00a1f415cc0e}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_54-19644/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[3]
│                │ evaluator: e848bc0b768482dc073e839482f2bf9f55bc35c0a536f0e5977c1b5cf729f2bc
│                │ simulator: 5129649a6980f4a62cf17abbcf0b5f957aff28955d05c17c3425fabb8b4839da
│                │ solution: f8ffc2b1da601a0aa149f57817da0c85da9d1904ca5536e2f96a863d9481fb1e
│         names: dict[3]
│                │ e848bc0b768482dc073e839482f2bf9f55bc35c0a536f0e5977c1b5cf729f2bc: nogpu-prod-08_00a1f415cc0e-job59135-528013_evaluator_1
│                │ 5129649a6980f4a62cf17abbcf0b5f957aff28955d05c17c3425fabb8b4839da: nogpu-prod-08_00a1f415cc0e-job59135-528013_simulator_1
│                │ f8ffc2b1da601a0aa149f57817da0c85da9d1904ca5536e2f96a863d9481fb1e: nogpu-prod-08_00a1f415cc0e-job59135-528013_solution_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |e848bc0b768482dc073e839482f2bf9f55bc35c0a536f0e5977c1b5cf729f2bc
│         |5129649a6980f4a62cf17abbcf0b5f957aff28955d05c17c3425fabb8b4839da
│         |f8ffc2b1da601a0aa149f57817da0c85da9d1904ca5536e2f96a863d9481fb1e
│         |
│  names: dict[3]
│         │ e848bc0b768482dc073e839482f2bf9f55bc35c0a536f0e5977c1b5cf729f2bc: nogpu-prod-08_00a1f415cc0e-job59135-528013_evaluator_1
│         │ 5129649a6980f4a62cf17abbcf0b5f957aff28955d05c17c3425fabb8b4839da: nogpu-prod-08_00a1f415cc0e-job59135-528013_simulator_1
│         │ f8ffc2b1da601a0aa149f57817da0c85da9d1904ca5536e2f96a863d9481fb1e: nogpu-prod-08_00a1f415cc0e-job59135-528013_solution_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5910912890Robert Moni 🇭🇺speedRLaido5-LFI-sim-validationLFVIv-simsuccessyesnogpu-prod-080:22:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median17.593795965957504
survival_time_median59.99999999999873
deviation-center-line_median2.171310815072931
in-drivable-lane_median0.900000000000003


other stats
agent_compute-ego0_max0.02544409984553684
agent_compute-ego0_mean0.024934060865397456
agent_compute-ego0_median0.024934060865397456
agent_compute-ego0_min0.024424021885258072
complete-iteration_max0.24580511919763265
complete-iteration_mean0.2437615863091741
complete-iteration_median0.2437615863091741
complete-iteration_min0.2417180534207156
deviation-center-line_max2.315201812251505
deviation-center-line_mean2.171310815072931
deviation-center-line_min2.027419817894357
deviation-heading_max7.358879207793444
deviation-heading_mean7.230623024595653
deviation-heading_median7.230623024595653
deviation-heading_min7.1023668413978625
driven_any_max19.042290082112377
driven_any_mean18.79994074809764
driven_any_median18.79994074809764
driven_any_min18.557591414082907
driven_lanedir_consec_max18.61401489607207
driven_lanedir_consec_mean17.593795965957504
driven_lanedir_consec_min16.573577035842934
driven_lanedir_max18.85602369132867
driven_lanedir_mean18.326709778572717
driven_lanedir_median18.326709778572717
driven_lanedir_min17.797395865816764
get_duckie_state_max1.2570078625071554e-06
get_duckie_state_mean1.2378509991571965e-06
get_duckie_state_median1.2378509991571965e-06
get_duckie_state_min1.2186941358072375e-06
get_robot_state_max0.0036889966778910033
get_robot_state_mean0.0035754872003661703
get_robot_state_median0.0035754872003661703
get_robot_state_min0.0034619777228413373
get_state_dump_max0.004563005242518441
get_state_dump_mean0.00447859752188118
get_state_dump_median0.00447859752188118
get_state_dump_min0.004394189801243918
get_ui_image_max0.03754155145497445
get_ui_image_mean0.03703268461680036
get_ui_image_median0.03703268461680036
get_ui_image_min0.036523817778626254
in-drivable-lane_max1.800000000000006
in-drivable-lane_mean0.900000000000003
in-drivable-lane_min0.0
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 18.557591414082907, "get_ui_image": 0.036523817778626254, "step_physics": 0.15334233217294965, "survival_time": 59.99999999999873, "driven_lanedir": 17.797395865816764, "get_state_dump": 0.004394189801243918, "get_robot_state": 0.0034619777228413373, "sim_render-ego0": 0.0036847021657163952, "get_duckie_state": 1.2570078625071554e-06, "in-drivable-lane": 1.800000000000006, "deviation-heading": 7.358879207793444, "agent_compute-ego0": 0.024424021885258072, "complete-iteration": 0.2417180534207156, "set_robot_commands": 0.0020606746085974495, "deviation-center-line": 2.027419817894357, "driven_lanedir_consec": 16.573577035842934, "sim_compute_sim_state": 0.011854696234100367, "sim_compute_performance-ego0": 0.0018905594783659085}, "LFI-norm-udem1-000-ego0": {"driven_any": 19.042290082112377, "get_ui_image": 0.03754155145497445, "step_physics": 0.15352883724050656, "survival_time": 59.99999999999873, "driven_lanedir": 18.85602369132867, "get_state_dump": 0.004563005242518441, "get_robot_state": 0.0036889966778910033, "sim_render-ego0": 0.0038984574247260175, "get_duckie_state": 1.2186941358072375e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.1023668413978625, "agent_compute-ego0": 0.02544409984553684, "complete-iteration": 0.24580511919763265, "set_robot_commands": 0.0022186806160246304, "deviation-center-line": 2.315201812251505, "driven_lanedir_consec": 18.61401489607207, "sim_compute_sim_state": 0.012790800828322284, "sim_compute_performance-ego0": 0.002045424752787289}}
set_robot_commands_max0.0022186806160246304
set_robot_commands_mean0.00213967761231104
set_robot_commands_median0.00213967761231104
set_robot_commands_min0.0020606746085974495
sim_compute_performance-ego0_max0.002045424752787289
sim_compute_performance-ego0_mean0.001967992115576598
sim_compute_performance-ego0_median0.001967992115576598
sim_compute_performance-ego0_min0.0018905594783659085
sim_compute_sim_state_max0.012790800828322284
sim_compute_sim_state_mean0.012322748531211326
sim_compute_sim_state_median0.012322748531211326
sim_compute_sim_state_min0.011854696234100367
sim_render-ego0_max0.0038984574247260175
sim_render-ego0_mean0.0037915797952212064
sim_render-ego0_median0.0037915797952212064
sim_render-ego0_min0.0036847021657163952
simulation-passed1
step_physics_max0.15352883724050656
step_physics_mean0.1534355847067281
step_physics_median0.1534355847067281
step_physics_min0.15334233217294965
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5908412891Robert Moni 🇭🇺speedRLaido5-LFV-sim-validationLFVv-simsuccessyesnogpu-prod-080:33:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.491301137317526
survival_time_median12.600000000000044
deviation-center-line_median0.395833475492908
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.027903964803537303
agent_compute-ego0_mean0.027243209525040127
agent_compute-ego0_median0.02717724178129209
agent_compute-ego0_min0.026714389734039026
agent_compute-npc0_max0.027492057909524387
agent_compute-npc0_mean0.02336680093181987
agent_compute-npc0_median0.022043171575972353
agent_compute-npc0_min0.0218888026658104
agent_compute-npc1_max0.032701634327857505
agent_compute-npc1_mean0.030705730826100026
agent_compute-npc1_median0.029811896611509365
agent_compute-npc1_min0.02960366153893321
agent_compute-npc2_max0.0380444879566289
agent_compute-npc2_mean0.03085665674912752
agent_compute-npc2_median0.027303076936224698
agent_compute-npc2_min0.027222405354528967
agent_compute-npc3_max0.043105441930512675
agent_compute-npc3_mean0.03778672861378782
agent_compute-npc3_median0.03778672861378782
agent_compute-npc3_min0.032468015297062953
complete-iteration_max1.3005478330054137
complete-iteration_mean1.017411023908863
complete-iteration_median1.1741790075536698
complete-iteration_min0.4207382475226986
deviation-center-line_max0.7023422350010549
deviation-center-line_mean0.44831814934872866
deviation-center-line_min0.2992634114080437
deviation-heading_max3.399581443165017
deviation-heading_mean1.9030759839681035
deviation-heading_median1.521345094452877
deviation-heading_min1.1700323038016436
driven_any_max7.920105151011589
driven_any_mean4.511588178277194
driven_any_median3.5282144585958504
driven_any_min3.069818644905483
driven_lanedir_consec_max7.821314842532765
driven_lanedir_consec_mean4.459651514770321
driven_lanedir_consec_min3.0346889419134664
driven_lanedir_max7.821314842532765
driven_lanedir_mean4.459651514770321
driven_lanedir_median3.491301137317526
driven_lanedir_min3.0346889419134664
get_duckie_state_max1.8221376604982232e-06
get_duckie_state_mean1.6308334598106068e-06
get_duckie_state_median1.6505717326708182e-06
get_duckie_state_min1.4000527134025677e-06
get_robot_state_max0.018356491905112453
get_robot_state_mean0.01504060559595549
get_robot_state_median0.016932629480624576
get_robot_state_min0.007940671517460357
get_state_dump_max0.011486470959592597
get_state_dump_mean0.009920160554954554
get_state_dump_median0.010734601714859453
get_state_dump_min0.006724967830506716
get_ui_image_max0.0557430676303377
get_ui_image_mean0.048417181628684365
get_ui_image_median0.051677454099179614
get_ui_image_min0.034570750686040534
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 3.8304443698299537, "get_ui_image": 0.04942804467376819, "step_physics": 0.7988235649219059, "survival_time": 13.80000000000006, "driven_lanedir": 3.782719866554227, "get_state_dump": 0.010229772609063437, "get_robot_state": 0.01555122967661503, "sim_render-ego0": 0.004174553530310896, "sim_render-npc0": 0.004198307595098062, "sim_render-npc1": 0.004190280549362678, "sim_render-npc2": 0.004311007282794168, "get_duckie_state": 1.8221376604982232e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.8037055376703832, "agent_compute-ego0": 0.027903964803537303, "agent_compute-npc0": 0.022134922902076252, "agent_compute-npc1": 0.032701634327857505, "agent_compute-npc2": 0.0380444879566289, "complete-iteration": 1.0582660681934564, "set_robot_commands": 0.0025828512997403473, "deviation-center-line": 0.4242111266333478, "driven_lanedir_consec": 3.782719866554227, "sim_compute_sim_state": 0.027313421779591257, "sim_compute_performance-ego0": 0.0023109301763321087, "sim_compute_performance-npc0": 0.0021949416893914287, "sim_compute_performance-npc1": 0.0021616112884631656, "sim_compute_performance-npc2": 0.0022279424357500317}, "LFV-norm-zigzag-000-ego0": {"driven_any": 7.920105151011589, "get_ui_image": 0.0557430676303377, "step_physics": 0.96312721291223, "survival_time": 27.00000000000025, "driven_lanedir": 7.821314842532765, "get_state_dump": 0.01123943082065547, "get_robot_state": 0.018314029284634124, "sim_render-ego0": 0.004032784601236227, "sim_render-npc0": 0.00398321909737014, "sim_render-npc1": 0.004092686277660997, "sim_render-npc2": 0.004069309798714855, "sim_render-npc3": 0.004007742717834585, "get_duckie_state": 1.5957738908073158e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.399581443165017, "agent_compute-ego0": 0.026714389734039026, "agent_compute-npc0": 0.02195142024986845, "agent_compute-npc1": 0.02960366153893321, "agent_compute-npc2": 0.027303076936224698, "agent_compute-npc3": 0.032468015297062953, "complete-iteration": 1.2900919469138832, "set_robot_commands": 0.0023926340057316637, "deviation-center-line": 0.7023422350010549, "driven_lanedir_consec": 7.821314842532765, "sim_compute_sim_state": 0.06095821667951488, "sim_compute_performance-ego0": 0.0021999662332305627, "sim_compute_performance-npc0": 0.001999110699581351, "sim_compute_performance-npc1": 0.002057888591575975, "sim_compute_performance-npc2": 0.002072061055689334, "sim_compute_performance-npc3": 0.0020880183538976305}, "LFV-norm-techtrack-000-ego0": {"driven_any": 3.225984547361747, "get_ui_image": 0.05392686352459104, "step_physics": 0.965448426367414, "survival_time": 11.400000000000029, "driven_lanedir": 3.199882408080825, "get_state_dump": 0.011486470959592597, "get_robot_state": 0.018356491905112453, "sim_render-ego0": 0.004172369902831498, "sim_render-npc0": 0.004013592499312355, "sim_render-npc1": 0.004113602325905879, "sim_render-npc2": 0.004030816940240985, "sim_render-npc3": 0.004156694662102446, "get_duckie_state": 1.7053695745343204e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.1700323038016436, "agent_compute-ego0": 0.02725235031161246, "agent_compute-npc0": 0.0218888026658104, "agent_compute-npc1": 0.029811896611509365, "agent_compute-npc2": 0.027222405354528967, "agent_compute-npc3": 0.043105441930512675, "complete-iteration": 1.3005478330054137, "set_robot_commands": 0.002443965345490968, "deviation-center-line": 0.2992634114080437, "driven_lanedir_consec": 3.199882408080825, "sim_compute_sim_state": 0.05875531971194338, "sim_compute_performance-ego0": 0.002278653815323609, "sim_compute_performance-npc0": 0.0020617272656036777, "sim_compute_performance-npc1": 0.002090824743545732, "sim_compute_performance-npc2": 0.0020433076083920406, "sim_compute_performance-npc3": 0.002102856032192447}, "LFV-norm-small_loop-000-ego0": {"driven_any": 3.069818644905483, "get_ui_image": 0.034570750686040534, "step_physics": 0.2879065248934708, "survival_time": 11.300000000000026, "driven_lanedir": 3.0346889419134664, "get_state_dump": 0.006724967830506716, "get_robot_state": 0.007940671517460357, "sim_render-ego0": 0.004149525176060882, "sim_render-npc0": 0.004092520029009177, "get_duckie_state": 1.4000527134025677e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.2389846512353706, "agent_compute-ego0": 0.027102133250971723, "agent_compute-npc0": 0.027492057909524387, "complete-iteration": 0.4207382475226986, "set_robot_commands": 0.0025495527074200467, "deviation-center-line": 0.36745582435246826, "driven_lanedir_consec": 3.0346889419134664, "sim_compute_sim_state": 0.011223993637488276, "sim_compute_performance-ego0": 0.0021657723162142716, "sim_compute_performance-npc0": 0.0021629753616937983}}
set_robot_commands_max0.0025828512997403473
set_robot_commands_mean0.0024922508395957563
set_robot_commands_median0.0024967590264555074
set_robot_commands_min0.0023926340057316637
sim_compute_performance-ego0_max0.0023109301763321087
sim_compute_performance-ego0_mean0.002238830635275138
sim_compute_performance-ego0_median0.002239310024277086
sim_compute_performance-ego0_min0.0021657723162142716
sim_compute_performance-npc0_max0.0021949416893914287
sim_compute_performance-npc0_mean0.002104688754067564
sim_compute_performance-npc0_median0.0021123513136487382
sim_compute_performance-npc0_min0.001999110699581351
sim_compute_performance-npc1_max0.0021616112884631656
sim_compute_performance-npc1_mean0.0021034415411949575
sim_compute_performance-npc1_median0.002090824743545732
sim_compute_performance-npc1_min0.002057888591575975
sim_compute_performance-npc2_max0.0022279424357500317
sim_compute_performance-npc2_mean0.002114437033277135
sim_compute_performance-npc2_median0.002072061055689334
sim_compute_performance-npc2_min0.0020433076083920406
sim_compute_performance-npc3_max0.002102856032192447
sim_compute_performance-npc3_mean0.002095437193045038
sim_compute_performance-npc3_median0.002095437193045038
sim_compute_performance-npc3_min0.0020880183538976305
sim_compute_sim_state_max0.06095821667951488
sim_compute_sim_state_mean0.03956273795213445
sim_compute_sim_state_median0.04303437074576732
sim_compute_sim_state_min0.011223993637488276
sim_render-ego0_max0.004174553530310896
sim_render-ego0_mean0.004132308302609876
sim_render-ego0_median0.004160947539446191
sim_render-ego0_min0.004032784601236227
sim_render-npc0_max0.004198307595098062
sim_render-npc0_mean0.004071909805197433
sim_render-npc0_median0.0040530562641607655
sim_render-npc0_min0.00398321909737014
sim_render-npc1_max0.004190280549362678
sim_render-npc1_mean0.004132189717643185
sim_render-npc1_median0.004113602325905879
sim_render-npc1_min0.004092686277660997
sim_render-npc2_max0.004311007282794168
sim_render-npc2_mean0.004137044673916669
sim_render-npc2_median0.004069309798714855
sim_render-npc2_min0.004030816940240985
sim_render-npc3_max0.004156694662102446
sim_render-npc3_mean0.004082218689968515
sim_render-npc3_median0.004082218689968515
sim_render-npc3_min0.004007742717834585
simulation-passed1
step_physics_max0.965448426367414
step_physics_mean0.7538264322737551
step_physics_median0.880975388917068
step_physics_min0.2879065248934708
survival_time_max27.00000000000025
survival_time_mean15.87500000000009
survival_time_min11.300000000000026
No reset possible
5907312883Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:02:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5895312773Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LFV_multi-sim-validationLFVmultibodyv-simsuccessyesnogpu-prod-082:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median15.346415386512014
survival_time_median49.39999999999933
deviation-center-line_median2.5597755489580525
in-drivable-lane_median1.7000000000000206


other stats
agent_compute-ego0_max0.06749656283873583
agent_compute-ego0_mean0.060245422917767806
agent_compute-ego0_median0.06241882869742693
agent_compute-ego0_min0.05219425832056059
agent_compute-ego1_max0.060472028259091544
agent_compute-ego1_mean0.053799257266843314
agent_compute-ego1_median0.05707019433490839
agent_compute-ego1_min0.04612599875254385
complete-iteration_max1.3643344897471736
complete-iteration_mean1.1906926110157638
complete-iteration_median1.3523176699057904
complete-iteration_min0.45691629829851416
deviation-center-line_max4.064325800266463
deviation-center-line_mean2.499764519387145
deviation-center-line_min1.126777927737872
deviation-heading_max24.31893113536188
deviation-heading_mean12.911008260944865
deviation-heading_median12.523344125212915
deviation-heading_min5.774264106731368
driven_any_max27.58168840037928
driven_any_mean16.647275463668045
driven_any_median16.406256557884177
driven_any_min8.048216598365851
driven_lanedir_consec_max26.79664188602629
driven_lanedir_consec_mean15.221626462034603
driven_lanedir_consec_min7.131807685028717
driven_lanedir_max26.79664188602629
driven_lanedir_mean15.397262490188703
driven_lanedir_median15.346415386512014
driven_lanedir_min7.504602018548223
get_duckie_state_max1.7219119601779514e-06
get_duckie_state_mean1.6346293074154795e-06
get_duckie_state_median1.688456752302673e-06
get_duckie_state_min1.4338862588264662e-06
get_robot_state_max0.015659917253700383
get_robot_state_mean0.014265817366277769
get_robot_state_median0.015248268511225408
get_robot_state_min0.0077333980357021615
get_state_dump_max0.010478935285245992
get_state_dump_mean0.00965339584770528
get_state_dump_median0.010028130009609098
get_state_dump_min0.006598946653138986
get_ui_image_max0.05100348251844624
get_ui_image_mean0.04619386850414432
get_ui_image_median0.04892831263334855
get_ui_image_min0.03157678512014219
in-drivable-lane_max25.79999999999911
in-drivable-lane_mean4.974999999999872
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 12.315069619456604, "get_ui_image": 0.04595835205263925, "step_physics": 0.8500551916148564, "survival_time": 32.800000000000274, "driven_lanedir": 11.908448927540606, "get_state_dump": 0.010478935285245992, "get_robot_state": 0.015659917253700383, "sim_render-ego0": 0.0042973598933111045, "sim_render-ego1": 0.004093512371069039, "sim_render-ego2": 0.003995772003220278, "sim_render-ego3": 0.004037815323340475, "get_duckie_state": 1.7219119601779514e-06, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 6.741448330248063, "agent_compute-ego0": 0.06749656283873583, "agent_compute-ego1": 0.060472028259091544, "agent_compute-ego2": 0.05635746610400521, "agent_compute-ego3": 0.05312041967789695, "complete-iteration": 1.2223138297529526, "set_robot_commands": 0.0024441250201592524, "deviation-center-line": 1.6314081292929812, "driven_lanedir_consec": 11.908448927540606, "sim_compute_sim_state": 0.02759117876920889, "sim_compute_performance-ego0": 0.002352521844106178, "sim_compute_performance-ego1": 0.0021098324152976954, "sim_compute_performance-ego2": 0.0020679756205194437, "sim_compute_performance-ego3": 0.002104086781564187}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 14.709084979800233, "get_ui_image": 0.04595835205263925, "step_physics": 0.8500551916148564, "survival_time": 32.800000000000274, "driven_lanedir": 14.224898156299233, "get_state_dump": 0.010478935285245992, "get_robot_state": 0.015659917253700383, "sim_render-ego0": 0.0042973598933111045, "sim_render-ego1": 0.004093512371069039, "sim_render-ego2": 0.003995772003220278, "sim_render-ego3": 0.004037815323340475, "get_duckie_state": 1.7219119601779514e-06, "in-drivable-lane": 0.20000000000000284, "deviation-heading": 6.790071772716778, "agent_compute-ego0": 0.06749656283873583, "agent_compute-ego1": 0.060472028259091544, "agent_compute-ego2": 0.05635746610400521, "agent_compute-ego3": 0.05312041967789695, "complete-iteration": 1.2223138297529526, "set_robot_commands": 0.0024441250201592524, "deviation-center-line": 1.5096016405965311, "driven_lanedir_consec": 14.224898156299233, "sim_compute_sim_state": 0.02759117876920889, "sim_compute_performance-ego0": 0.002352521844106178, "sim_compute_performance-ego1": 0.0021098324152976954, "sim_compute_performance-ego2": 0.0020679756205194437, "sim_compute_performance-ego3": 0.002104086781564187}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 8.048216598365851, "get_ui_image": 0.04595835205263925, "step_physics": 0.8500551916148564, "survival_time": 32.800000000000274, "driven_lanedir": 7.504602018548223, "get_state_dump": 0.010478935285245992, "get_robot_state": 0.015659917253700383, "sim_render-ego0": 0.0042973598933111045, "sim_render-ego1": 0.004093512371069039, "sim_render-ego2": 0.003995772003220278, "sim_render-ego3": 0.004037815323340475, "get_duckie_state": 1.7219119601779514e-06, "in-drivable-lane": 11.500000000000108, "deviation-heading": 6.1433342064898975, "agent_compute-ego0": 0.06749656283873583, "agent_compute-ego1": 0.060472028259091544, "agent_compute-ego2": 0.05635746610400521, "agent_compute-ego3": 0.05312041967789695, "complete-iteration": 1.2223138297529526, "set_robot_commands": 0.0024441250201592524, "deviation-center-line": 1.126777927737872, "driven_lanedir_consec": 7.504602018548223, "sim_compute_sim_state": 0.02759117876920889, "sim_compute_performance-ego0": 0.002352521844106178, "sim_compute_performance-ego1": 0.0021098324152976954, "sim_compute_performance-ego2": 0.0020679756205194437, "sim_compute_performance-ego3": 0.002104086781564187}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 8.911193331209567, "get_ui_image": 0.04595835205263925, "step_physics": 0.8500551916148564, "survival_time": 32.800000000000274, "driven_lanedir": 8.576996349763904, "get_state_dump": 0.010478935285245992, "get_robot_state": 0.015659917253700383, "sim_render-ego0": 0.0042973598933111045, "sim_render-ego1": 0.004093512371069039, "sim_render-ego2": 0.003995772003220278, "sim_render-ego3": 0.004037815323340475, "get_duckie_state": 1.7219119601779514e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.258580216935751, "agent_compute-ego0": 0.06749656283873583, "agent_compute-ego1": 0.060472028259091544, "agent_compute-ego2": 0.05635746610400521, "agent_compute-ego3": 0.05312041967789695, "complete-iteration": 1.2223138297529526, "set_robot_commands": 0.0024441250201592524, "deviation-center-line": 1.1487139902068333, "driven_lanedir_consec": 8.576996349763904, "sim_compute_sim_state": 0.02759117876920889, "sim_compute_performance-ego0": 0.002352521844106178, "sim_compute_performance-ego1": 0.0021098324152976954, "sim_compute_performance-ego2": 0.0020679756205194437, "sim_compute_performance-ego3": 0.002104086781564187}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 18.103428135968123, "get_ui_image": 0.05100348251844624, "step_physics": 0.9693922148854608, "survival_time": 59.99999999999873, "driven_lanedir": 16.467932616724795, "get_state_dump": 0.010028130009609098, "get_robot_state": 0.015155475999195311, "sim_render-ego0": 0.004233173287778373, "sim_render-ego1": 0.0039552651674523145, "sim_render-ego2": 0.003900929354906678, "sim_render-ego3": 0.0038433771744854346, "get_duckie_state": 1.5938907340603208e-06, "in-drivable-lane": 16.54999999999912, "deviation-heading": 12.259397461422363, "agent_compute-ego0": 0.06241882869742693, "agent_compute-ego1": 0.05707019433490839, "agent_compute-ego2": 0.05408167918456981, "agent_compute-ego3": 0.05236695311051622, "complete-iteration": 1.3523176699057904, "set_robot_commands": 0.0022811915455610925, "deviation-center-line": 2.486811053719023, "driven_lanedir_consec": 16.467932616724795, "sim_compute_sim_state": 0.047016644855026005, "sim_compute_performance-ego0": 0.0022675125525456283, "sim_compute_performance-ego1": 0.0020552985773396233, "sim_compute_performance-ego2": 0.0020131564557204933, "sim_compute_performance-ego3": 0.0019857309740052235}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 22.6730782955318, "get_ui_image": 0.05100348251844624, "step_physics": 0.9693922148854608, "survival_time": 59.99999999999873, "driven_lanedir": 20.66941790950471, "get_state_dump": 0.010028130009609098, "get_robot_state": 0.015155475999195311, "sim_render-ego0": 0.004233173287778373, "sim_render-ego1": 0.0039552651674523145, "sim_render-ego2": 0.003900929354906678, "sim_render-ego3": 0.0038433771744854346, "get_duckie_state": 1.5938907340603208e-06, "in-drivable-lane": 3.3499999999999392, "deviation-heading": 14.93971686087217, "agent_compute-ego0": 0.06241882869742693, "agent_compute-ego1": 0.05707019433490839, "agent_compute-ego2": 0.05408167918456981, "agent_compute-ego3": 0.05236695311051622, "complete-iteration": 1.3523176699057904, "set_robot_commands": 0.0022811915455610925, "deviation-center-line": 4.064325800266463, "driven_lanedir_consec": 20.66941790950471, "sim_compute_sim_state": 0.047016644855026005, "sim_compute_performance-ego0": 0.0022675125525456283, "sim_compute_performance-ego1": 0.0020552985773396233, "sim_compute_performance-ego2": 0.0020131564557204933, "sim_compute_performance-ego3": 0.0019857309740052235}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 23.45895604451161, "get_ui_image": 0.05100348251844624, "step_physics": 0.9693922148854608, "survival_time": 59.99999999999873, "driven_lanedir": 21.09314638409324, "get_state_dump": 0.010028130009609098, "get_robot_state": 0.015155475999195311, "sim_render-ego0": 0.004233173287778373, "sim_render-ego1": 0.0039552651674523145, "sim_render-ego2": 0.003900929354906678, "sim_render-ego3": 0.0038433771744854346, "get_duckie_state": 1.5938907340603208e-06, "in-drivable-lane": 3.749999999999938, "deviation-heading": 16.777103100091594, "agent_compute-ego0": 0.06241882869742693, "agent_compute-ego1": 0.05707019433490839, "agent_compute-ego2": 0.05408167918456981, "agent_compute-ego3": 0.05236695311051622, "complete-iteration": 1.3523176699057904, "set_robot_commands": 0.0022811915455610925, "deviation-center-line": 3.490162493884269, "driven_lanedir_consec": 21.09314638409324, "sim_compute_sim_state": 0.047016644855026005, "sim_compute_performance-ego0": 0.0022675125525456283, "sim_compute_performance-ego1": 0.0020552985773396233, "sim_compute_performance-ego2": 0.0020131564557204933, "sim_compute_performance-ego3": 0.0019857309740052235}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 23.317404956672934, "get_ui_image": 0.05100348251844624, "step_physics": 0.9693922148854608, "survival_time": 59.99999999999873, "driven_lanedir": 21.16766967361322, "get_state_dump": 0.010028130009609098, "get_robot_state": 0.015155475999195311, "sim_render-ego0": 0.004233173287778373, "sim_render-ego1": 0.0039552651674523145, "sim_render-ego2": 0.003900929354906678, "sim_render-ego3": 0.0038433771744854346, "get_duckie_state": 1.5938907340603208e-06, "in-drivable-lane": 2.1000000000000227, "deviation-heading": 18.873099141289796, "agent_compute-ego0": 0.06241882869742693, "agent_compute-ego1": 0.05707019433490839, "agent_compute-ego2": 0.05408167918456981, "agent_compute-ego3": 0.05236695311051622, "complete-iteration": 1.3523176699057904, "set_robot_commands": 0.0022811915455610925, "deviation-center-line": 3.9012378860548265, "driven_lanedir_consec": 21.16766967361322, "sim_compute_sim_state": 0.047016644855026005, "sim_compute_performance-ego0": 0.0022675125525456283, "sim_compute_performance-ego1": 0.0020552985773396233, "sim_compute_performance-ego2": 0.0020131564557204933, "sim_compute_performance-ego3": 0.0019857309740052235}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 10.469998578549031, "get_ui_image": 0.04892831263334855, "step_physics": 1.0343186433443043, "survival_time": 49.39999999999933, "driven_lanedir": 9.5907120791861, "get_state_dump": 0.009980346845543903, "get_robot_state": 0.015248268511225408, "sim_render-ego0": 0.004159382790236671, "sim_render-ego1": 0.003919018291245818, "sim_render-ego2": 0.003894558570020963, "sim_render-ego3": 0.003820358320724133, "get_duckie_state": 1.688456752302673e-06, "in-drivable-lane": 1.200000000000017, "deviation-heading": 24.31893113536188, "agent_compute-ego0": 0.05219425832056059, "agent_compute-ego1": 0.04612599875254385, "agent_compute-ego2": 0.04590106854183247, "agent_compute-ego3": 0.04613247534864713, "complete-iteration": 1.3643344897471736, "set_robot_commands": 0.0022808847340582837, "deviation-center-line": 2.632740044197082, "driven_lanedir_consec": 7.131807685028717, "sim_compute_sim_state": 0.03151966997538105, "sim_compute_performance-ego0": 0.002225663712581561, "sim_compute_performance-ego1": 0.0020684424497722015, "sim_compute_performance-ego2": 0.002033715060073035, "sim_compute_performance-ego3": 0.002018717832343523}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 11.014407568503948, "get_ui_image": 0.04892831263334855, "step_physics": 1.0343186433443043, "survival_time": 49.39999999999933, "driven_lanedir": 10.014028804267152, "get_state_dump": 0.009980346845543903, "get_robot_state": 0.015248268511225408, "sim_render-ego0": 0.004159382790236671, "sim_render-ego1": 0.003919018291245818, "sim_render-ego2": 0.003894558570020963, "sim_render-ego3": 0.003820358320724133, "get_duckie_state": 1.688456752302673e-06, "in-drivable-lane": 25.79999999999911, "deviation-heading": 5.774264106731368, "agent_compute-ego0": 0.05219425832056059, "agent_compute-ego1": 0.04612599875254385, "agent_compute-ego2": 0.04590106854183247, "agent_compute-ego3": 0.04613247534864713, "complete-iteration": 1.3643344897471736, "set_robot_commands": 0.0022808847340582837, "deviation-center-line": 1.4108224907596705, "driven_lanedir_consec": 10.014028804267152, "sim_compute_sim_state": 0.03151966997538105, "sim_compute_performance-ego0": 0.002225663712581561, "sim_compute_performance-ego1": 0.0020684424497722015, "sim_compute_performance-ego2": 0.002033715060073035, "sim_compute_performance-ego3": 0.002018717832343523}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 9.794312389097096, "get_ui_image": 0.04892831263334855, "step_physics": 1.0343186433443043, "survival_time": 49.39999999999933, "driven_lanedir": 8.96936521790357, "get_state_dump": 0.009980346845543903, "get_robot_state": 0.015248268511225408, "sim_render-ego0": 0.004159382790236671, "sim_render-ego1": 0.003919018291245818, "sim_render-ego2": 0.003894558570020963, "sim_render-ego3": 0.003820358320724133, "get_duckie_state": 1.688456752302673e-06, "in-drivable-lane": 0.5000000000000071, "deviation-heading": 12.787290789003466, "agent_compute-ego0": 0.05219425832056059, "agent_compute-ego1": 0.04612599875254385, "agent_compute-ego2": 0.04590106854183247, "agent_compute-ego3": 0.04613247534864713, "complete-iteration": 1.3643344897471736, "set_robot_commands": 0.0022808847340582837, "deviation-center-line": 2.0929538238387684, "driven_lanedir_consec": 8.96936521790357, "sim_compute_sim_state": 0.03151966997538105, "sim_compute_performance-ego0": 0.002225663712581561, "sim_compute_performance-ego1": 0.0020684424497722015, "sim_compute_performance-ego2": 0.002033715060073035, "sim_compute_performance-ego3": 0.002018717832343523}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 20.25271241415137, "get_ui_image": 0.04892831263334855, "step_physics": 1.0343186433443043, "survival_time": 49.39999999999933, "driven_lanedir": 18.887482219640347, "get_state_dump": 0.009980346845543903, "get_robot_state": 0.015248268511225408, "sim_render-ego0": 0.004159382790236671, "sim_render-ego1": 0.003919018291245818, "sim_render-ego2": 0.003894558570020963, "sim_render-ego3": 0.003820358320724133, "get_duckie_state": 1.688456752302673e-06, "in-drivable-lane": 1.3000000000000185, "deviation-heading": 13.14045725935853, "agent_compute-ego0": 0.05219425832056059, "agent_compute-ego1": 0.04612599875254385, "agent_compute-ego2": 0.04590106854183247, "agent_compute-ego3": 0.04613247534864713, "complete-iteration": 1.3643344897471736, "set_robot_commands": 0.0022808847340582837, "deviation-center-line": 2.8395904140125423, "driven_lanedir_consec": 18.887482219640347, "sim_compute_sim_state": 0.03151966997538105, "sim_compute_performance-ego0": 0.002225663712581561, "sim_compute_performance-ego1": 0.0020684424497722015, "sim_compute_performance-ego2": 0.002033715060073035, "sim_compute_performance-ego3": 0.002018717832343523}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 27.58168840037928, "get_ui_image": 0.03157678512014219, "step_physics": 0.27644776801681836, "survival_time": 59.99999999999873, "driven_lanedir": 26.79664188602629, "get_state_dump": 0.006598946653138986, "get_robot_state": 0.0077333980357021615, "sim_render-ego0": 0.004050602226034985, "sim_render-ego1": 0.0038893355815039386, "get_duckie_state": 1.4338862588264662e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.249545393963675, "agent_compute-ego0": 0.05749866071092795, "agent_compute-ego1": 0.04925835817481556, "complete-iteration": 0.45691629829851416, "set_robot_commands": 0.0023319423446845847, "deviation-center-line": 2.835669000045721, "driven_lanedir_consec": 26.79664188602629, "sim_compute_sim_state": 0.010851330602298074, "sim_compute_performance-ego0": 0.002149694269642445, "sim_compute_performance-ego1": 0.002027972155466961}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 22.412305179155187, "get_ui_image": 0.03157678512014219, "step_physics": 0.27644776801681836, "survival_time": 59.99999999999873, "driven_lanedir": 19.69033261953043, "get_state_dump": 0.006598946653138986, "get_robot_state": 0.0077333980357021615, "sim_render-ego0": 0.004050602226034985, "sim_render-ego1": 0.0038893355815039386, "get_duckie_state": 1.4338862588264662e-06, "in-drivable-lane": 3.099999999999917, "deviation-heading": 20.700875878742774, "agent_compute-ego0": 0.05749866071092795, "agent_compute-ego1": 0.04925835817481556, "complete-iteration": 0.45691629829851416, "set_robot_commands": 0.0023319423446845847, "deviation-center-line": 3.825888576807445, "driven_lanedir_consec": 19.69033261953043, "sim_compute_sim_state": 0.010851330602298074, "sim_compute_performance-ego0": 0.002149694269642445, "sim_compute_performance-ego1": 0.002027972155466961}}
set_robot_commands_max0.0024441250201592524
set_robot_commands_mean0.002334906420605977
set_robot_commands_median0.0022811915455610925
set_robot_commands_min0.0022808847340582837
sim_compute_performance-ego0_max0.002352521844106178
sim_compute_performance-ego0_mean0.0022630129268727396
sim_compute_performance-ego0_median0.0022675125525456283
sim_compute_performance-ego0_min0.002149694269642445
sim_compute_performance-ego1_max0.0021098324152976954
sim_compute_performance-ego1_mean0.0020707312914694286
sim_compute_performance-ego1_median0.0020684424497722015
sim_compute_performance-ego1_min0.002027972155466961
sim_compute_sim_state_max0.047016644855026005
sim_compute_sim_state_mean0.031872331114504285
sim_compute_sim_state_median0.03151966997538105
sim_compute_sim_state_min0.010851330602298074
sim_render-ego0_max0.0042973598933111045
sim_render-ego0_mean0.004204347738383898
sim_render-ego0_median0.004233173287778373
sim_render-ego0_min0.004050602226034985
sim_render-ego1_max0.004093512371069039
sim_render-ego1_mean0.003974989605862611
sim_render-ego1_median0.0039552651674523145
sim_render-ego1_min0.0038893355815039386
simulation-passed1
step_physics_max1.0343186433443043
step_physics_mean0.8548542668151519
step_physics_median0.9693922148854608
step_physics_min0.27644776801681836
survival_time_max59.99999999999873
survival_time_mean49.19999999999935
survival_time_min32.800000000000274
No reset possible
5892912802Yishu Malhotra 🇨🇦exercise_state_estimationaido5-LFV-sim-validationLFVv-simsuccessyesnogpu-prod-080:39:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0113016095405363
survival_time_median21.725000000000172
deviation-center-line_median1.2424879972515916
in-drivable-lane_median1.675000000000002


other stats
agent_compute-ego0_max0.012700026009672433
agent_compute-ego0_mean0.012083592061888094
agent_compute-ego0_median0.011988638991455088
agent_compute-ego0_min0.011657064254969767
agent_compute-npc0_max0.02858085436363743
agent_compute-npc0_mean0.024038847913866877
agent_compute-npc0_median0.023046686574652277
agent_compute-npc0_min0.021481164142525513
agent_compute-npc1_max0.03417989976944462
agent_compute-npc1_mean0.03234641307095058
agent_compute-npc1_median0.03251206037784604
agent_compute-npc1_min0.03034727906556109
agent_compute-npc2_max0.03674893344574344
agent_compute-npc2_mean0.0307878879236439
agent_compute-npc2_median0.02861566799943165
agent_compute-npc2_min0.026999062325756624
agent_compute-npc3_max0.04861636674532326
agent_compute-npc3_mean0.04080098769796529
agent_compute-npc3_median0.04080098769796529
agent_compute-npc3_min0.03298560865060731
complete-iteration_max1.282992900198724
complete-iteration_mean0.9365519811790513
complete-iteration_median1.0723242978594807
complete-iteration_min0.31856642879851876
deviation-center-line_max1.9569549597330091
deviation-center-line_mean1.1660596027282852
deviation-center-line_min0.22230745667694815
deviation-heading_max7.619286862748656
deviation-heading_mean5.533372388654442
deviation-heading_median6.4718673728150975
deviation-heading_min1.5704679462389166
driven_any_max4.483832138153108
driven_any_mean4.076211057524242
driven_any_median4.224444452314102
driven_any_min3.3721231873156583
driven_lanedir_consec_max4.007394891383655
driven_lanedir_consec_mean2.671885604058285
driven_lanedir_consec_min0.6575443057684125
driven_lanedir_max4.007394891383655
driven_lanedir_mean3.0535894608604273
driven_lanedir_median3.768424079194441
driven_lanedir_min0.6701147936691731
get_duckie_state_max1.715780866198144e-06
get_duckie_state_mean1.5753938888994269e-06
get_duckie_state_median1.6703962326894006e-06
get_duckie_state_min1.245002224020762e-06
get_robot_state_max0.01916258360749932
get_robot_state_mean0.014639955104019107
get_robot_state_median0.016215781511128506
get_robot_state_min0.006965673786320099
get_state_dump_max0.012010160056493616
get_state_dump_mean0.009753423942154685
get_state_dump_median0.010448378345999286
get_state_dump_min0.006106779020126552
get_ui_image_max0.05599762649946315
get_ui_image_mean0.04678283107127323
get_ui_image_median0.05017702465263986
get_ui_image_min0.030779648480350023
in-drivable-lane_max14.450000000000127
in-drivable-lane_mean4.450000000000033
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 4.075163115317679, "get_ui_image": 0.04490648805373518, "step_physics": 0.633348012951904, "survival_time": 20.60000000000016, "driven_lanedir": 3.732317738191027, "get_state_dump": 0.009745912459514332, "get_robot_state": 0.014308904042832788, "sim_render-ego0": 0.003900114040975132, "sim_render-npc0": 0.004049276901503741, "sim_render-npc1": 0.00393390309146761, "sim_render-npc2": 0.0040643365273464105, "get_duckie_state": 1.6493023740754577e-06, "in-drivable-lane": 0.9000000000000128, "deviation-heading": 5.638770361979368, "agent_compute-ego0": 0.01216614390689582, "agent_compute-npc0": 0.021481164142525513, "agent_compute-npc1": 0.03251206037784604, "agent_compute-npc2": 0.03674893344574344, "complete-iteration": 0.8638332732941856, "set_robot_commands": 0.0023724501704476936, "deviation-center-line": 1.2079769084847936, "driven_lanedir_consec": 3.732317738191027, "sim_compute_sim_state": 0.025002332922910084, "sim_compute_performance-ego0": 0.0020696366381702932, "sim_compute_performance-npc0": 0.001986802057261617, "sim_compute_performance-npc1": 0.0020551525651686994, "sim_compute_performance-npc2": 0.002071567078190912}, "LFV-norm-zigzag-000-ego0": {"driven_any": 4.483832138153108, "get_ui_image": 0.055447561251544535, "step_physics": 0.9699931285266792, "survival_time": 22.85000000000019, "driven_lanedir": 3.8045304201978545, "get_state_dump": 0.011150844232484242, "get_robot_state": 0.018122658979424226, "sim_render-ego0": 0.003944572402920786, "sim_render-npc0": 0.0041075367073825355, "sim_render-npc1": 0.004082730763864309, "sim_render-npc2": 0.004034368752392098, "sim_render-npc3": 0.003916048587149407, "get_duckie_state": 1.715780866198144e-06, "in-drivable-lane": 2.4499999999999913, "deviation-heading": 7.304964383650828, "agent_compute-ego0": 0.011811134076014355, "agent_compute-npc0": 0.022267614389611123, "agent_compute-npc1": 0.03034727906556109, "agent_compute-npc2": 0.026999062325756624, "agent_compute-npc3": 0.03298560865060731, "complete-iteration": 1.282992900198724, "set_robot_commands": 0.0022824643480725683, "deviation-center-line": 1.27699908601839, "driven_lanedir_consec": 2.2902854808900455, "sim_compute_sim_state": 0.06135818635532429, "sim_compute_performance-ego0": 0.002177476362369987, "sim_compute_performance-npc0": 0.0020050643312879003, "sim_compute_performance-npc1": 0.002090582160449965, "sim_compute_performance-npc2": 0.0020859793284053888, "sim_compute_performance-npc3": 0.002077044357899495}, "LFV-norm-techtrack-000-ego0": {"driven_any": 4.373725789310525, "get_ui_image": 0.05599762649946315, "step_physics": 0.9372997914591144, "survival_time": 23.200000000000195, "driven_lanedir": 4.007394891383655, "get_state_dump": 0.012010160056493616, "get_robot_state": 0.01916258360749932, "sim_render-ego0": 0.004231601120323263, "sim_render-npc0": 0.004363309696156492, "sim_render-npc1": 0.004322954403456821, "sim_render-npc2": 0.004107071250997564, "sim_render-npc3": 0.004214485229984406, "get_duckie_state": 1.6914900913033434e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.619286862748656, "agent_compute-ego0": 0.012700026009672433, "agent_compute-npc0": 0.023825758759693432, "agent_compute-npc1": 0.03417989976944462, "agent_compute-npc2": 0.02861566799943165, "agent_compute-npc3": 0.04861636674532326, "complete-iteration": 1.2808153224247758, "set_robot_commands": 0.0024719294681343983, "deviation-center-line": 1.9569549597330091, "driven_lanedir_consec": 4.007394891383655, "sim_compute_sim_state": 0.0637102819258167, "sim_compute_performance-ego0": 0.0023397209823772473, "sim_compute_performance-npc0": 0.002198508477980091, "sim_compute_performance-npc1": 0.0021618140641079153, "sim_compute_performance-npc2": 0.002146351721978957, "sim_compute_performance-npc3": 0.0021353972855434624}, "LFV-norm-small_loop-000-ego0": {"driven_any": 3.3721231873156583, "get_ui_image": 0.030779648480350023, "step_physics": 0.2087638358547263, "survival_time": 18.200000000000124, "driven_lanedir": 0.6701147936691731, "get_state_dump": 0.006106779020126552, "get_robot_state": 0.006965673786320099, "sim_render-ego0": 0.003747564472564279, "sim_render-npc0": 0.003984306936394679, "get_duckie_state": 1.245002224020762e-06, "in-drivable-lane": 14.450000000000127, "deviation-heading": 1.5704679462389166, "agent_compute-ego0": 0.011657064254969767, "agent_compute-npc0": 0.02858085436363743, "complete-iteration": 0.31856642879851876, "set_robot_commands": 0.002232993138979559, "deviation-center-line": 0.22230745667694815, "driven_lanedir_consec": 0.6575443057684125, "sim_compute_sim_state": 0.009650042285657908, "sim_compute_performance-ego0": 0.001892487643516227, "sim_compute_performance-npc0": 0.0019128498965746735}}
set_robot_commands_max0.0024719294681343983
set_robot_commands_mean0.002339959281408555
set_robot_commands_median0.002327457259260131
set_robot_commands_min0.002232993138979559
sim_compute_performance-ego0_max0.0023397209823772473
sim_compute_performance-ego0_mean0.002119830406608439
sim_compute_performance-ego0_median0.00212355650027014
sim_compute_performance-ego0_min0.001892487643516227
sim_compute_performance-npc0_max0.002198508477980091
sim_compute_performance-npc0_mean0.0020258061907760705
sim_compute_performance-npc0_median0.0019959331942747587
sim_compute_performance-npc0_min0.0019128498965746735
sim_compute_performance-npc1_max0.0021618140641079153
sim_compute_performance-npc1_mean0.002102516263242193
sim_compute_performance-npc1_median0.002090582160449965
sim_compute_performance-npc1_min0.0020551525651686994
sim_compute_performance-npc2_max0.002146351721978957
sim_compute_performance-npc2_mean0.0021012993761917527
sim_compute_performance-npc2_median0.0020859793284053888
sim_compute_performance-npc2_min0.002071567078190912
sim_compute_performance-npc3_max0.0021353972855434624
sim_compute_performance-npc3_mean0.002106220821721479
sim_compute_performance-npc3_median0.002106220821721479
sim_compute_performance-npc3_min0.002077044357899495
sim_compute_sim_state_max0.0637102819258167
sim_compute_sim_state_mean0.03993021087242725
sim_compute_sim_state_median0.04318025963911719
sim_compute_sim_state_min0.009650042285657908
sim_render-ego0_max0.004231601120323263
sim_render-ego0_mean0.003955963009195864
sim_render-ego0_median0.003922343221947958
sim_render-ego0_min0.003747564472564279
sim_render-npc0_max0.004363309696156492
sim_render-npc0_mean0.004126107560359362
sim_render-npc0_median0.0040784068044431385
sim_render-npc0_min0.003984306936394679
sim_render-npc1_max0.004322954403456821
sim_render-npc1_mean0.004113196086262913
sim_render-npc1_median0.004082730763864309
sim_render-npc1_min0.00393390309146761
sim_render-npc2_max0.004107071250997564
sim_render-npc2_mean0.004068592176912024
sim_render-npc2_median0.0040643365273464105
sim_render-npc2_min0.004034368752392098
sim_render-npc3_max0.004214485229984406
sim_render-npc3_mean0.004065266908566907
sim_render-npc3_median0.004065266908566907
sim_render-npc3_min0.003916048587149407
simulation-passed1
step_physics_max0.9699931285266792
step_physics_mean0.687351192198106
step_physics_median0.7853239022055092
step_physics_min0.2087638358547263
survival_time_max23.200000000000195
survival_time_mean21.21250000000017
survival_time_min18.200000000000124
No reset possible
5892212814Yishu Malhotra 🇨🇦sim-exercise-2aido5-LFP-sim-validationLFP-simsuccessnonogpu-prod-080:08:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.00000000000002
in-drivable-lane_median0.0
driven_lanedir_consec_median1.61459972134554
deviation-center-line_median0.48733252676586186


other stats
agent_compute-ego0_max0.013832714304577704
agent_compute-ego0_mean0.013434315298955234
agent_compute-ego0_median0.013486985044971592
agent_compute-ego0_min0.012930576801300048
complete-iteration_max0.34213340872585185
complete-iteration_mean0.276937062501722
complete-iteration_median0.279763748396764
complete-iteration_min0.20608734448750815
deviation-center-line_max0.8467745471695113
deviation-center-line_mean0.5448954362141133
deviation-center-line_min0.35814214415521806
deviation-heading_max4.926104223486742
deviation-heading_mean3.0848776884031084
deviation-heading_median2.715457269099636
deviation-heading_min1.9824919919264188
driven_any_max2.5227193852917593
driven_any_mean1.7779158466114302
driven_any_median1.976122135230097
driven_any_min0.6366997306937671
driven_lanedir_consec_max2.316975928892796
driven_lanedir_consec_mean1.5308225477770636
driven_lanedir_consec_min0.5771148195243792
driven_lanedir_max2.316975928892796
driven_lanedir_mean1.5308225477770636
driven_lanedir_median1.61459972134554
driven_lanedir_min0.5771148195243792
get_duckie_state_max0.025850086611033392
get_duckie_state_mean0.01856998845688832
get_duckie_state_median0.02205498287507513
get_duckie_state_min0.004319901466369629
get_robot_state_max0.003984236445263765
get_robot_state_mean0.003923812875223231
get_robot_state_median0.003924994145856573
get_robot_state_min0.003861026763916016
get_state_dump_max0.00897763437191343
get_state_dump_mean0.007755815305511985
get_state_dump_median0.00830539594650585
get_state_dump_min0.005434834957122802
get_ui_image_max0.04134011032557724
get_ui_image_mean0.03548360460217729
get_ui_image_median0.03635425195340067
get_ui_image_min0.027885804176330565
in-drivable-lane_max3.300000000000047
in-drivable-lane_mean0.8250000000000117
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.5227193852917593, "get_ui_image": 0.03486187739064032, "step_physics": 0.15133148273134414, "survival_time": 13.100000000000051, "driven_lanedir": 1.8536204200470392, "get_state_dump": 0.00897763437191343, "get_robot_state": 0.003984236445263765, "sim_render-ego0": 0.004003838441217807, "get_duckie_state": 0.025850086611033392, "in-drivable-lane": 3.300000000000047, "deviation-heading": 2.9757784962396725, "agent_compute-ego0": 0.013315411121673004, "complete-iteration": 0.25499535513468113, "set_robot_commands": 0.002338082164865936, "deviation-center-line": 0.4795306076205466, "driven_lanedir_consec": 1.8536204200470392, "sim_compute_sim_state": 0.008232333360969341, "sim_compute_performance-ego0": 0.002002425066871788}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.6366997306937671, "get_ui_image": 0.04134011032557724, "step_physics": 0.2328107994381744, "survival_time": 4.99999999999999, "driven_lanedir": 0.5771148195243792, "get_state_dump": 0.00836647855173243, "get_robot_state": 0.003923784388173925, "sim_render-ego0": 0.004242984375151077, "get_duckie_state": 0.022169689140697516, "in-drivable-lane": 0.0, "deviation-heading": 1.9824919919264188, "agent_compute-ego0": 0.01365855896827018, "complete-iteration": 0.34213340872585185, "set_robot_commands": 0.002431501256357325, "deviation-center-line": 0.35814214415521806, "driven_lanedir_consec": 0.5771148195243792, "sim_compute_sim_state": 0.010929506604034122, "sim_compute_performance-ego0": 0.002158984099284257}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.4440845850721875, "get_ui_image": 0.03784662651616102, "step_physics": 0.19516694745537955, "survival_time": 8.899999999999991, "driven_lanedir": 1.3755790226440403, "get_state_dump": 0.00824431334127927, "get_robot_state": 0.0039262039035392205, "sim_render-ego0": 0.004084615068062724, "get_duckie_state": 0.021940276609452743, "in-drivable-lane": 0.0, "deviation-heading": 2.4551360419596, "agent_compute-ego0": 0.013832714304577704, "complete-iteration": 0.3045321416588469, "set_robot_commands": 0.0023607808118425934, "deviation-center-line": 0.4951344459111771, "driven_lanedir_consec": 1.3755790226440403, "sim_compute_sim_state": 0.014748702502117477, "sim_compute_performance-ego0": 0.00227853439373677}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.508159685388007, "get_ui_image": 0.027885804176330565, "step_physics": 0.1372003706296285, "survival_time": 14.950000000000076, "driven_lanedir": 2.316975928892796, "get_state_dump": 0.005434834957122802, "get_robot_state": 0.003861026763916016, "sim_render-ego0": 0.0038654430707295738, "get_duckie_state": 0.004319901466369629, "in-drivable-lane": 0.0, "deviation-heading": 4.926104223486742, "agent_compute-ego0": 0.012930576801300048, "complete-iteration": 0.20608734448750815, "set_robot_commands": 0.002339606285095215, "deviation-center-line": 0.8467745471695113, "driven_lanedir_consec": 2.316975928892796, "sim_compute_sim_state": 0.006129759152730306, "sim_compute_performance-ego0": 0.0020345226923624673}}
set_robot_commands_max0.002431501256357325
set_robot_commands_mean0.0023674926295402677
set_robot_commands_median0.0023501935484689044
set_robot_commands_min0.002338082164865936
sim_compute_performance-ego0_max0.00227853439373677
sim_compute_performance-ego0_mean0.0021186165630638206
sim_compute_performance-ego0_median0.002096753395823362
sim_compute_performance-ego0_min0.002002425066871788
sim_compute_sim_state_max0.014748702502117477
sim_compute_sim_state_mean0.010010075404962812
sim_compute_sim_state_median0.009580919982501731
sim_compute_sim_state_min0.006129759152730306
sim_render-ego0_max0.004242984375151077
sim_render-ego0_mean0.004049220238790295
sim_render-ego0_median0.004044226754640265
sim_render-ego0_min0.0038654430707295738
simulation-passed1
step_physics_max0.2328107994381744
step_physics_mean0.17912740006363165
step_physics_median0.17324921509336183
step_physics_min0.1372003706296285
survival_time_max14.950000000000076
survival_time_mean10.487500000000027
survival_time_min4.99999999999999
No reset possible
5890412825Melisande Tengexercise_state_estimationaido5-LFI-sim-testingLFVIv-simsuccessyesnogpu-prod-080:21:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.96560063148576
survival_time_median59.99999999999873
deviation-center-line_median2.779051591705116
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01265171922116752
agent_compute-ego0_mean0.01244521607566535
agent_compute-ego0_median0.01244521607566535
agent_compute-ego0_min0.012238712930163178
complete-iteration_max0.24441001476792867
complete-iteration_mean0.2369236494480422
complete-iteration_median0.2369236494480422
complete-iteration_min0.22943728412815573
deviation-center-line_max2.901313755629798
deviation-center-line_mean2.779051591705116
deviation-center-line_min2.6567894277804345
deviation-heading_max11.038004125612384
deviation-heading_mean11.00029695659699
deviation-heading_median11.00029695659699
deviation-heading_min10.9625897875816
driven_any_max11.673126610565795
driven_any_mean11.668232407408947
driven_any_median11.668232407408947
driven_any_min11.6633382042521
driven_lanedir_consec_max11.09806869371723
driven_lanedir_consec_mean10.96560063148576
driven_lanedir_consec_min10.833132569254287
driven_lanedir_max11.393401046255311
driven_lanedir_mean11.384765137906632
driven_lanedir_median11.384765137906632
driven_lanedir_min11.376129229557954
get_duckie_state_max1.5913100167178393e-06
get_duckie_state_mean1.4770636451333689e-06
get_duckie_state_median1.4770636451333689e-06
get_duckie_state_min1.362817273548898e-06
get_robot_state_max0.004039090837070487
get_robot_state_mean0.003917406937363344
get_robot_state_median0.003917406937363344
get_robot_state_min0.003795723037656201
get_state_dump_max0.005006715121813162
get_state_dump_mean0.004828176430917402
get_state_dump_median0.004828176430917402
get_state_dump_min0.004649637740021641
get_ui_image_max0.04126426937379607
get_ui_image_mean0.039567315409721485
get_ui_image_median0.039567315409721485
get_ui_image_min0.0378703614456469
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 11.673126610565795, "get_ui_image": 0.04126426937379607, "step_physics": 0.15884303490784046, "survival_time": 59.99999999999873, "driven_lanedir": 11.376129229557954, "get_state_dump": 0.005006715121813162, "get_robot_state": 0.004039090837070487, "sim_render-ego0": 0.00423879964861842, "get_duckie_state": 1.5913100167178393e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.038004125612384, "agent_compute-ego0": 0.01265171922116752, "complete-iteration": 0.24441001476792867, "set_robot_commands": 0.002429055730865758, "deviation-center-line": 2.901313755629798, "driven_lanedir_consec": 11.09806869371723, "sim_compute_sim_state": 0.013601864902899724, "sim_compute_performance-ego0": 0.0022442860964632947}, "LFI-norm-udem1-000-ego0": {"driven_any": 11.6633382042521, "get_ui_image": 0.0378703614456469, "step_physics": 0.14957038389455268, "survival_time": 59.99999999999873, "driven_lanedir": 11.393401046255311, "get_state_dump": 0.004649637740021641, "get_robot_state": 0.003795723037656201, "sim_render-ego0": 0.003968648966107142, "get_duckie_state": 1.362817273548898e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.9625897875816, "agent_compute-ego0": 0.012238712930163178, "complete-iteration": 0.22943728412815573, "set_robot_commands": 0.0023238883228921376, "deviation-center-line": 2.6567894277804345, "driven_lanedir_consec": 10.833132569254287, "sim_compute_sim_state": 0.012827118469416152, "sim_compute_performance-ego0": 0.002107497158892248}}
set_robot_commands_max0.002429055730865758
set_robot_commands_mean0.002376472026878948
set_robot_commands_median0.002376472026878948
set_robot_commands_min0.0023238883228921376
sim_compute_performance-ego0_max0.0022442860964632947
sim_compute_performance-ego0_mean0.0021758916276777714
sim_compute_performance-ego0_median0.0021758916276777714
sim_compute_performance-ego0_min0.002107497158892248
sim_compute_sim_state_max0.013601864902899724
sim_compute_sim_state_mean0.013214491686157938
sim_compute_sim_state_median0.013214491686157938
sim_compute_sim_state_min0.012827118469416152
sim_render-ego0_max0.00423879964861842
sim_render-ego0_mean0.004103724307362781
sim_render-ego0_median0.004103724307362781
sim_render-ego0_min0.003968648966107142
simulation-passed1
step_physics_max0.15884303490784046
step_physics_mean0.15420670940119657
step_physics_median0.15420670940119657
step_physics_min0.14957038389455268
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5885212847Raphael Jeanexercise_state_estimationaido5-LFVI_multi-sim-validationLFVIv-simsuccessyesnogpu-prod-081:15:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.73364262810328
survival_time_median59.99999999999873
deviation-center-line_median2.4383912030479395
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012359452188064614
agent_compute-ego0_mean0.01221854253970614
agent_compute-ego0_median0.01221854253970614
agent_compute-ego0_min0.012077632891347664
agent_compute-ego1_max0.012766561936974823
agent_compute-ego1_mean0.012710734569063593
agent_compute-ego1_median0.012710734569063593
agent_compute-ego1_min0.01265490720115236
agent_compute-ego2_max0.013191053412736804
agent_compute-ego2_mean0.013179369314227076
agent_compute-ego2_median0.013179369314227076
agent_compute-ego2_min0.01316768521571735
agent_compute-ego3_max0.012499755467105965
agent_compute-ego3_mean0.012494132381791777
agent_compute-ego3_median0.012494132381791777
agent_compute-ego3_min0.012488509296477586
complete-iteration_max1.002415952039301
complete-iteration_mean0.9649406728101312
complete-iteration_median0.9649406728101312
complete-iteration_min0.9274653935809616
deviation-center-line_max4.205147941117272
deviation-center-line_mean2.3372572074885274
deviation-center-line_min0.1905702421849274
deviation-heading_max12.727318911293231
deviation-heading_mean8.029506537639593
deviation-heading_median8.695914832304034
deviation-heading_min0.941437983047616
driven_any_max14.882186359407466
driven_any_mean10.59018641858541
driven_any_median11.86860890040549
driven_any_min1.4104853879178365
driven_lanedir_consec_max13.973858186193528
driven_lanedir_consec_mean9.267513516394908
driven_lanedir_consec_min0.4954203420515211
driven_lanedir_max14.601540981566984
driven_lanedir_mean10.086982246350455
driven_lanedir_median11.63959024437814
driven_lanedir_min0.4954203420515211
get_duckie_state_max1.663570102307322e-06
get_duckie_state_mean1.6303185519330408e-06
get_duckie_state_median1.6303185519330408e-06
get_duckie_state_min1.5970670015587597e-06
get_robot_state_max0.015604273266438935
get_robot_state_mean0.01528850651899047
get_robot_state_median0.01528850651899047
get_robot_state_min0.014972739771542004
get_state_dump_max0.010278908835164116
get_state_dump_mean0.010066694959216471
get_state_dump_median0.010066694959216471
get_state_dump_min0.009854481083268826
get_ui_image_max0.05542546942470274
get_ui_image_mean0.05407786448730418
get_ui_image_median0.05407786448730418
get_ui_image_min0.052730259549905616
in-drivable-lane_max56.69999999999873
in-drivable-lane_mean9.624999999999748
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 12.7411337336886, "get_ui_image": 0.05542546942470274, "step_physics": 0.7184598199731603, "survival_time": 59.99999999999873, "driven_lanedir": 12.564643098880676, "get_state_dump": 0.010278908835164116, "get_robot_state": 0.015604273266438935, "sim_render-ego0": 0.004168019505166491, "sim_render-ego1": 0.004299199948402169, "sim_render-ego2": 0.004316410752359179, "sim_render-ego3": 0.004362302656276935, "get_duckie_state": 1.663570102307322e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.509681639793864, "agent_compute-ego0": 0.012359452188064614, "agent_compute-ego1": 0.01265490720115236, "agent_compute-ego2": 0.013191053412736804, "agent_compute-ego3": 0.012488509296477586, "complete-iteration": 0.9274653935809616, "set_robot_commands": 0.002455638112076911, "deviation-center-line": 2.0853978540071023, "driven_lanedir_consec": 11.960105177201996, "sim_compute_sim_state": 0.04090745065928895, "sim_compute_performance-ego0": 0.002286557650982986, "sim_compute_performance-ego1": 0.002139808137053554, "sim_compute_performance-ego2": 0.002187358052605495, "sim_compute_performance-ego3": 0.002202968017743291}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 9.696265732826868, "get_ui_image": 0.05542546942470274, "step_physics": 0.7184598199731603, "survival_time": 59.99999999999873, "driven_lanedir": 8.467446737494198, "get_state_dump": 0.010278908835164116, "get_robot_state": 0.015604273266438935, "sim_render-ego0": 0.004168019505166491, "sim_render-ego1": 0.004299199948402169, "sim_render-ego2": 0.004316410752359179, "sim_render-ego3": 0.004362302656276935, "get_duckie_state": 1.663570102307322e-06, "in-drivable-lane": 18.299999999999297, "deviation-heading": 8.56795841638704, "agent_compute-ego0": 0.012359452188064614, "agent_compute-ego1": 0.01265490720115236, "agent_compute-ego2": 0.013191053412736804, "agent_compute-ego3": 0.012488509296477586, "complete-iteration": 0.9274653935809616, "set_robot_commands": 0.002455638112076911, "deviation-center-line": 2.5621134745112717, "driven_lanedir_consec": 8.0099923925149, "sim_compute_sim_state": 0.04090745065928895, "sim_compute_performance-ego0": 0.002286557650982986, "sim_compute_performance-ego1": 0.002139808137053554, "sim_compute_performance-ego2": 0.002187358052605495, "sim_compute_performance-ego3": 0.002202968017743291}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 11.839884997393003, "get_ui_image": 0.05542546942470274, "step_physics": 0.7184598199731603, "survival_time": 59.99999999999873, "driven_lanedir": 11.589172600810556, "get_state_dump": 0.010278908835164116, "get_robot_state": 0.015604273266438935, "sim_render-ego0": 0.004168019505166491, "sim_render-ego1": 0.004299199948402169, "sim_render-ego2": 0.004316410752359179, "sim_render-ego3": 0.004362302656276935, "get_duckie_state": 1.663570102307322e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.823871248221026, "agent_compute-ego0": 0.012359452188064614, "agent_compute-ego1": 0.01265490720115236, "agent_compute-ego2": 0.013191053412736804, "agent_compute-ego3": 0.012488509296477586, "complete-iteration": 0.9274653935809616, "set_robot_commands": 0.002455638112076911, "deviation-center-line": 2.314668931584608, "driven_lanedir_consec": 10.251787688877366, "sim_compute_sim_state": 0.04090745065928895, "sim_compute_performance-ego0": 0.002286557650982986, "sim_compute_performance-ego1": 0.002139808137053554, "sim_compute_performance-ego2": 0.002187358052605495, "sim_compute_performance-ego3": 0.002202968017743291}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 12.576943452501895, "get_ui_image": 0.05542546942470274, "step_physics": 0.7184598199731603, "survival_time": 59.99999999999873, "driven_lanedir": 11.782117456452486, "get_state_dump": 0.010278908835164116, "get_robot_state": 0.015604273266438935, "sim_render-ego0": 0.004168019505166491, "sim_render-ego1": 0.004299199948402169, "sim_render-ego2": 0.004316410752359179, "sim_render-ego3": 0.004362302656276935, "get_duckie_state": 1.663570102307322e-06, "in-drivable-lane": 1.9999999999999505, "deviation-heading": 12.727318911293231, "agent_compute-ego0": 0.012359452188064614, "agent_compute-ego1": 0.01265490720115236, "agent_compute-ego2": 0.013191053412736804, "agent_compute-ego3": 0.012488509296477586, "complete-iteration": 0.9274653935809616, "set_robot_commands": 0.002455638112076911, "deviation-center-line": 2.5864196322523094, "driven_lanedir_consec": 9.21549756732919, "sim_compute_sim_state": 0.04090745065928895, "sim_compute_performance-ego0": 0.002286557650982986, "sim_compute_performance-ego1": 0.002139808137053554, "sim_compute_performance-ego2": 0.002187358052605495, "sim_compute_performance-ego3": 0.002202968017743291}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 11.89733280341798, "get_ui_image": 0.052730259549905616, "step_physics": 0.8084686602482093, "survival_time": 59.99999999999873, "driven_lanedir": 11.690007887945724, "get_state_dump": 0.009854481083268826, "get_robot_state": 0.014972739771542004, "sim_render-ego0": 0.004018659893420217, "sim_render-ego1": 0.004160010546669178, "sim_render-ego2": 0.004265951375778668, "sim_render-ego3": 0.0042761565247344336, "get_duckie_state": 1.5970670015587597e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.644377918138058, "agent_compute-ego0": 0.012077632891347664, "agent_compute-ego1": 0.012766561936974823, "agent_compute-ego2": 0.01316768521571735, "agent_compute-ego3": 0.012499755467105965, "complete-iteration": 1.002415952039301, "set_robot_commands": 0.002576744824424572, "deviation-center-line": 2.155156140122347, "driven_lanedir_consec": 11.094311562316792, "sim_compute_sim_state": 0.030704789912075325, "sim_compute_performance-ego0": 0.0021896515162560864, "sim_compute_performance-ego1": 0.0020630911526136058, "sim_compute_performance-ego2": 0.002100046032374348, "sim_compute_performance-ego3": 0.0021176479142671024}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 14.882186359407466, "get_ui_image": 0.052730259549905616, "step_physics": 0.8084686602482093, "survival_time": 59.99999999999873, "driven_lanedir": 14.601540981566984, "get_state_dump": 0.009854481083268826, "get_robot_state": 0.014972739771542004, "sim_render-ego0": 0.004018659893420217, "sim_render-ego1": 0.004160010546669178, "sim_render-ego2": 0.004265951375778668, "sim_render-ego3": 0.0042761565247344336, "get_duckie_state": 1.5970670015587597e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.182214999822165, "agent_compute-ego0": 0.012077632891347664, "agent_compute-ego1": 0.012766561936974823, "agent_compute-ego2": 0.01316768521571735, "agent_compute-ego3": 0.012499755467105965, "complete-iteration": 1.002415952039301, "set_robot_commands": 0.002576744824424572, "deviation-center-line": 2.598583444128381, "driven_lanedir_consec": 13.973858186193528, "sim_compute_sim_state": 0.030704789912075325, "sim_compute_performance-ego0": 0.0021896515162560864, "sim_compute_performance-ego1": 0.0020630911526136058, "sim_compute_performance-ego2": 0.002100046032374348, "sim_compute_performance-ego3": 0.0021176479142671024}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 9.677258881529644, "get_ui_image": 0.052730259549905616, "step_physics": 0.8084686602482093, "survival_time": 59.99999999999873, "driven_lanedir": 9.5055088656015, "get_state_dump": 0.009854481083268826, "get_robot_state": 0.014972739771542004, "sim_render-ego0": 0.004018659893420217, "sim_render-ego1": 0.004160010546669178, "sim_render-ego2": 0.004265951375778668, "sim_render-ego3": 0.0042761565247344336, "get_duckie_state": 1.5970670015587597e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.839191184413746, "agent_compute-ego0": 0.012077632891347664, "agent_compute-ego1": 0.012766561936974823, "agent_compute-ego2": 0.01316768521571735, "agent_compute-ego3": 0.012499755467105965, "complete-iteration": 1.002415952039301, "set_robot_commands": 0.002576744824424572, "deviation-center-line": 4.205147941117272, "driven_lanedir_consec": 9.139135214673956, "sim_compute_sim_state": 0.030704789912075325, "sim_compute_performance-ego0": 0.0021896515162560864, "sim_compute_performance-ego1": 0.0020630911526136058, "sim_compute_performance-ego2": 0.002100046032374348, "sim_compute_performance-ego3": 0.0021176479142671024}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.4104853879178365, "get_ui_image": 0.052730259549905616, "step_physics": 0.8084686602482093, "survival_time": 59.99999999999873, "driven_lanedir": 0.4954203420515211, "get_state_dump": 0.009854481083268826, "get_robot_state": 0.014972739771542004, "sim_render-ego0": 0.004018659893420217, "sim_render-ego1": 0.004160010546669178, "sim_render-ego2": 0.004265951375778668, "sim_render-ego3": 0.0042761565247344336, "get_duckie_state": 1.5970670015587597e-06, "in-drivable-lane": 56.69999999999873, "deviation-heading": 0.941437983047616, "agent_compute-ego0": 0.012077632891347664, "agent_compute-ego1": 0.012766561936974823, "agent_compute-ego2": 0.01316768521571735, "agent_compute-ego3": 0.012499755467105965, "complete-iteration": 1.002415952039301, "set_robot_commands": 0.002576744824424572, "deviation-center-line": 0.1905702421849274, "driven_lanedir_consec": 0.4954203420515211, "sim_compute_sim_state": 0.030704789912075325, "sim_compute_performance-ego0": 0.0021896515162560864, "sim_compute_performance-ego1": 0.0020630911526136058, "sim_compute_performance-ego2": 0.002100046032374348, "sim_compute_performance-ego3": 0.0021176479142671024}}
set_robot_commands_max0.002576744824424572
set_robot_commands_mean0.0025161914682507417
set_robot_commands_median0.0025161914682507417
set_robot_commands_min0.002455638112076911
sim_compute_performance-ego0_max0.002286557650982986
sim_compute_performance-ego0_mean0.0022381045836195363
sim_compute_performance-ego0_median0.0022381045836195363
sim_compute_performance-ego0_min0.0021896515162560864
sim_compute_performance-ego1_max0.002139808137053554
sim_compute_performance-ego1_mean0.00210144964483358
sim_compute_performance-ego1_median0.00210144964483358
sim_compute_performance-ego1_min0.0020630911526136058
sim_compute_performance-ego2_max0.002187358052605495
sim_compute_performance-ego2_mean0.0021437020424899212
sim_compute_performance-ego2_median0.0021437020424899212
sim_compute_performance-ego2_min0.002100046032374348
sim_compute_performance-ego3_max0.002202968017743291
sim_compute_performance-ego3_mean0.0021603079660051966
sim_compute_performance-ego3_median0.0021603079660051966
sim_compute_performance-ego3_min0.0021176479142671024
sim_compute_sim_state_max0.04090745065928895
sim_compute_sim_state_mean0.035806120285682135
sim_compute_sim_state_median0.035806120285682135
sim_compute_sim_state_min0.030704789912075325
sim_render-ego0_max0.004168019505166491
sim_render-ego0_mean0.004093339699293354
sim_render-ego0_median0.004093339699293354
sim_render-ego0_min0.004018659893420217
sim_render-ego1_max0.004299199948402169
sim_render-ego1_mean0.004229605247535673
sim_render-ego1_median0.004229605247535673
sim_render-ego1_min0.004160010546669178
sim_render-ego2_max0.004316410752359179
sim_render-ego2_mean0.004291181064068924
sim_render-ego2_median0.004291181064068924
sim_render-ego2_min0.004265951375778668
sim_render-ego3_max0.004362302656276935
sim_render-ego3_mean0.004319229590505684
sim_render-ego3_median0.004319229590505684
sim_render-ego3_min0.0042761565247344336
simulation-passed1
step_physics_max0.8084686602482093
step_physics_mean0.7634642401106848
step_physics_median0.7634642401106848
step_physics_min0.7184598199731603
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5879012744Thomas Wiggers 🇳🇱ppo_v1aido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesnogpu-prod-081:55:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0983541398027032
survival_time_median59.99999999999873
deviation-center-line_median1.3815148761237874
in-drivable-lane_median23.32499999999964


other stats
agent_compute-ego0_max0.07344313307070514
agent_compute-ego0_mean0.06857923177673088
agent_compute-ego0_median0.06838649059711745
agent_compute-ego0_min0.06385679601350289
agent_compute-ego1_max0.06957206221841754
agent_compute-ego1_mean0.06383618347670947
agent_compute-ego1_median0.06562529118432292
agent_compute-ego1_min0.056468133824575835
complete-iteration_max1.1431993554771989
complete-iteration_mean0.9280768572549098
complete-iteration_median0.9799355849139796
complete-iteration_min0.3285292425189578
deviation-center-line_max4.413645943315625
deviation-center-line_mean1.4417684591753008
deviation-center-line_min0.2530789513376133
deviation-heading_max27.31715699009108
deviation-heading_mean8.432814022344413
deviation-heading_median6.796731492199607
deviation-heading_min1.9006536347707013
driven_any_max9.728362916027685
driven_any_mean4.879117997701984
driven_any_median4.572768804413098
driven_any_min0.7973361560178924
driven_lanedir_consec_max8.079859861323152
driven_lanedir_consec_mean2.6282550880024007
driven_lanedir_consec_min0.07904964542260284
driven_lanedir_max8.08409399177013
driven_lanedir_mean3.0985706524549146
driven_lanedir_median2.6709602445456113
driven_lanedir_min0.0975031382126268
get_duckie_state_max1.72153698415383e-06
get_duckie_state_mean1.6531632645032736e-06
get_duckie_state_median1.717765166499434e-06
get_duckie_state_min1.3965728868369105e-06
get_robot_state_max0.015586556641882802
get_robot_state_mean0.014016934176212898
get_robot_state_median0.014937869317327114
get_robot_state_min0.0072503488683191486
get_state_dump_max0.01007144000508406
get_state_dump_mean0.00938309260991023
get_state_dump_median0.009844722596930028
get_state_dump_min0.006205536716773417
get_ui_image_max0.05020669219297334
get_ui_image_mean0.04541812819476749
get_ui_image_median0.05008560930263192
get_ui_image_min0.029434516336570005
in-drivable-lane_max56.749999999998735
in-drivable-lane_mean23.032142857142333
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.8080912424391244, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 1.3605112972951914, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 14.350000000000202, "deviation-heading": 27.31715699009108, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 4.413645943315625, "driven_lanedir_consec": 1.3132834376113705, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.3142893202758046, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 2.5319699155430535, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 3.4499999999999904, "deviation-heading": 13.308626802537782, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 2.467832836497597, "driven_lanedir_consec": 2.5319699155430535, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.249375470341283, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 4.509140212445026, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 25.299999999999415, "deviation-heading": 7.969840486418534, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 1.5084287656737665, "driven_lanedir_consec": 3.98050054375529, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 8.836925542371242, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 8.08409399177013, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 9.199999999999475, "deviation-heading": 7.516984176738013, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 2.071209476960221, "driven_lanedir_consec": 8.079859861323152, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 6.793733571695143, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 3.53672069906364, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 26.799999999999493, "deviation-heading": 11.538091660163886, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 1.8205898778486296, "driven_lanedir_consec": 1.960633532019494, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 0.7973361560178924, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 0.0975031382126268, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 56.749999999998735, "deviation-heading": 3.8293023567133737, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 0.2530789513376133, "driven_lanedir_consec": 0.07904964542260284, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 6.297324339091237, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 3.2562059933482588, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 27.449999999998916, "deviation-heading": 13.805730385774654, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 1.684034840294491, "driven_lanedir_consec": 2.795995015923963, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 6.4697816352780775, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 2.9224230610932356, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 29.949999999998965, "deviation-heading": 11.154848597705762, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 1.5810046345441815, "driven_lanedir_consec": 2.2360747475859126, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.728362916027685, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 7.259982135946148, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 21.349999999999863, "deviation-heading": 4.897446819080791, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 1.2546009865738084, "driven_lanedir_consec": 4.638905733553564, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.3557900717984817, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 1.2658322592935, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 51.54999999999875, "deviation-heading": 2.0436738190618966, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 0.27460122912983925, "driven_lanedir_consec": 1.2658322592935, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.931015304270937, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 2.307110483155605, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 38.49999999999864, "deviation-heading": 6.0764788076612, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 1.20138517553391, "driven_lanedir_consec": 1.6649705927993144, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 5.214522304555258, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 2.8099505735481696, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 17.050000000000242, "deviation-heading": 4.624203606628596, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 0.7162236741317428, "driven_lanedir_consec": 2.8099505735481696, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.8868319209481177, "get_ui_image": 0.029434516336570005, "step_physics": 0.14044011275539195, "survival_time": 14.000000000000064, "driven_lanedir": 1.8695941055544616, "get_state_dump": 0.006205536716773417, "get_robot_state": 0.0072503488683191486, "sim_render-ego0": 0.003776163393068144, "sim_render-ego1": 0.003677805971844765, "get_duckie_state": 1.3965728868369105e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.9006536347707013, "agent_compute-ego0": 0.06385679601350289, "agent_compute-ego1": 0.056468133824575835, "complete-iteration": 0.3285292425189578, "set_robot_commands": 0.0020843799428159233, "deviation-center-line": 0.5799403265632029, "driven_lanedir_consec": 1.8695941055544616, "sim_compute_sim_state": 0.009298642759221303, "sim_compute_performance-ego0": 0.001890151101923498, "sim_compute_performance-ego1": 0.001887839035631499}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.6242721727174907, "get_ui_image": 0.029434516336570005, "step_physics": 0.14044011275539195, "survival_time": 14.000000000000064, "driven_lanedir": 1.5689512680997564, "get_state_dump": 0.006205536716773417, "get_robot_state": 0.0072503488683191486, "sim_render-ego0": 0.003776163393068144, "sim_render-ego1": 0.003677805971844765, "get_duckie_state": 1.3965728868369105e-06, "in-drivable-lane": 0.7500000000000107, "deviation-heading": 2.0763581694755175, "agent_compute-ego0": 0.06385679601350289, "agent_compute-ego1": 0.056468133824575835, "complete-iteration": 0.3285292425189578, "set_robot_commands": 0.0020843799428159233, "deviation-center-line": 0.358181710049586, "driven_lanedir_consec": 1.5689512680997564, "sim_compute_sim_state": 0.009298642759221303, "sim_compute_performance-ego0": 0.001890151101923498, "sim_compute_performance-ego1": 0.001887839035631499}}
set_robot_commands_max0.0024741539649423415
set_robot_commands_mean0.002258096884193377
set_robot_commands_median0.002203908788472985
set_robot_commands_min0.0020843799428159233
sim_compute_performance-ego0_max0.002339213813572105
sim_compute_performance-ego0_mean0.0021879510464676206
sim_compute_performance-ego0_median0.0022254958934926866
sim_compute_performance-ego0_min0.001890151101923498
sim_compute_performance-ego1_max0.0022474988910379658
sim_compute_performance-ego1_mean0.0020586547620439384
sim_compute_performance-ego1_median0.0020328713495665843
sim_compute_performance-ego1_min0.001887839035631499
sim_compute_sim_state_max0.03273219033939257
sim_compute_sim_state_mean0.02529670222437727
sim_compute_sim_state_median0.02944537801210529
sim_compute_sim_state_min0.009298642759221303
sim_render-ego0_max0.004252444893791714
sim_render-ego0_mean0.004135243261847734
sim_render-ego0_median0.0041881959503834495
sim_render-ego0_min0.003776163393068144
sim_render-ego1_max0.0043588782428801804
sim_render-ego1_mean0.0040309199001332735
sim_render-ego1_median0.004024331714588835
sim_render-ego1_min0.003677805971844765
simulation-passed1
step_physics_max0.7386424259579648
step_physics_mean0.5604149717731356
step_physics_median0.5903470228355592
step_physics_min0.14044011275539195
survival_time_max59.99999999999873
survival_time_mean53.42857142857036
survival_time_min14.000000000000064
No reset possible
5878012753Raphael Jeansim-exercise-1aido5-LFP-sim-validationLFP-simsuccessnonogpu-prod-080:09:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.100000000000051
in-drivable-lane_median0.7500000000000107
driven_lanedir_consec_median1.7634408891323048
deviation-center-line_median0.5631774442218882


other stats
agent_compute-ego0_max0.013788413442125069
agent_compute-ego0_mean0.01346297144874253
agent_compute-ego0_median0.01357838985333858
agent_compute-ego0_min0.012906692646167896
complete-iteration_max0.3285955938638425
complete-iteration_mean0.26261370677062396
complete-iteration_median0.26559115603708716
complete-iteration_min0.19067692114447904
deviation-center-line_max0.8977167042169929
deviation-center-line_mean0.5853428284755782
deviation-center-line_min0.3172997212415434
deviation-heading_max3.4843655891128726
deviation-heading_mean2.4814268071013
deviation-heading_median2.5903520756015883
deviation-heading_min1.2606374880891509
driven_any_max3.153018733228156
driven_any_mean2.0109695507135292
driven_any_median2.1572142283191535
driven_any_min0.5764310129876535
driven_lanedir_consec_max2.312641754032205
driven_lanedir_consec_mean1.598082002884744
driven_lanedir_consec_min0.5528044792421619
driven_lanedir_max2.312641754032205
driven_lanedir_mean1.598082002884744
driven_lanedir_median1.7634408891323048
driven_lanedir_min0.5528044792421619
get_duckie_state_max0.028538335358732132
get_duckie_state_mean0.019622482507351664
get_duckie_state_median0.02269814170172556
get_duckie_state_min0.0045553112672234225
get_robot_state_max0.004264283909027233
get_robot_state_mean0.004032926713267579
get_robot_state_median0.004022201351282904
get_robot_state_min0.003823020241477273
get_state_dump_max0.009532498480451158
get_state_dump_mean0.008038709845311133
get_state_dump_median0.008552277350698535
get_state_dump_min0.005517786199396307
get_ui_image_max0.042540914872113395
get_ui_image_mean0.0361207273822884
get_ui_image_median0.03703115309108656
get_ui_image_min0.02787968847486708
in-drivable-lane_max6.700000000000054
in-drivable-lane_mean2.050000000000019
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 1.9311583374199677, "get_ui_image": 0.03587894148181099, "step_physics": 0.1378425916730056, "survival_time": 11.400000000000029, "driven_lanedir": 1.7430644799717336, "get_state_dump": 0.009532498480451158, "get_robot_state": 0.004264283909027233, "sim_render-ego0": 0.004174636441026712, "get_duckie_state": 0.028538335358732132, "in-drivable-lane": 1.500000000000021, "deviation-heading": 2.1266902039645337, "agent_compute-ego0": 0.013430594356820051, "complete-iteration": 0.247336404292344, "set_robot_commands": 0.002502371650595853, "deviation-center-line": 0.3172997212415434, "driven_lanedir_consec": 1.7430644799717336, "sim_compute_sim_state": 0.008802112012971437, "sim_compute_performance-ego0": 0.0022504704487896383}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5764310129876535, "get_ui_image": 0.042540914872113395, "step_physics": 0.21724678955826104, "survival_time": 5.04999999999999, "driven_lanedir": 0.5528044792421619, "get_state_dump": 0.008794971540862439, "get_robot_state": 0.0039793533437392295, "sim_render-ego0": 0.004083395004272461, "get_duckie_state": 0.0227205566331452, "in-drivable-lane": 0.0, "deviation-heading": 1.2606374880891509, "agent_compute-ego0": 0.013726185349857103, "complete-iteration": 0.3285955938638425, "set_robot_commands": 0.002472732581344305, "deviation-center-line": 0.4007946705397557, "driven_lanedir_consec": 0.5528044792421619, "sim_compute_sim_state": 0.0107574416141884, "sim_compute_performance-ego0": 0.0021529291190353094}, "LFP-norm-techtrack-000-ego0": {"driven_any": 3.153018733228156, "get_ui_image": 0.03818336470036213, "step_physics": 0.17208360856579197, "survival_time": 17.000000000000107, "driven_lanedir": 1.7838172982928755, "get_state_dump": 0.008309583160534631, "get_robot_state": 0.004065049358826579, "sim_render-ego0": 0.00408794243664336, "get_duckie_state": 0.022675726770305913, "in-drivable-lane": 6.700000000000054, "deviation-heading": 3.4843655891128726, "agent_compute-ego0": 0.013788413442125069, "complete-iteration": 0.2838459077818303, "set_robot_commands": 0.002435595408912278, "deviation-center-line": 0.7255602179040207, "driven_lanedir_consec": 1.7838172982928755, "sim_compute_sim_state": 0.015851565470094205, "sim_compute_performance-ego0": 0.0022594047781309425}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.3832701192183396, "get_ui_image": 0.02787968847486708, "step_physics": 0.12129678148211856, "survival_time": 14.800000000000075, "driven_lanedir": 2.312641754032205, "get_state_dump": 0.005517786199396307, "get_robot_state": 0.003823020241477273, "sim_render-ego0": 0.003948699745666299, "get_duckie_state": 0.0045553112672234225, "in-drivable-lane": 0.0, "deviation-heading": 3.054013947238643, "agent_compute-ego0": 0.012906692646167896, "complete-iteration": 0.19067692114447904, "set_robot_commands": 0.002362033734819303, "deviation-center-line": 0.8977167042169929, "driven_lanedir_consec": 2.312641754032205, "sim_compute_sim_state": 0.006108137894961167, "sim_compute_performance-ego0": 0.0021841574196863655}}
set_robot_commands_max0.002502371650595853
set_robot_commands_mean0.0024431833439179347
set_robot_commands_median0.002454163995128292
set_robot_commands_min0.002362033734819303
sim_compute_performance-ego0_max0.0022594047781309425
sim_compute_performance-ego0_mean0.0022117404414105637
sim_compute_performance-ego0_median0.002217313934238002
sim_compute_performance-ego0_min0.0021529291190353094
sim_compute_sim_state_max0.015851565470094205
sim_compute_sim_state_mean0.010379814248053804
sim_compute_sim_state_median0.00977977681357992
sim_compute_sim_state_min0.006108137894961167
sim_render-ego0_max0.004174636441026712
sim_render-ego0_mean0.004073668406902208
sim_render-ego0_median0.004085668720457911
sim_render-ego0_min0.003948699745666299
simulation-passed1
step_physics_max0.21724678955826104
step_physics_mean0.1621174428197943
step_physics_median0.1549631001193988
step_physics_min0.12129678148211856
survival_time_max17.000000000000107
survival_time_mean12.06250000000005
survival_time_min5.04999999999999
No reset possible
5872211772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-080:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5870210936Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:05:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.635240456758402
survival_time_median6.324999999999985
deviation-center-line_median0.162880221275905
in-drivable-lane_median3.4500000000000055


other stats
agent_compute-ego0_max0.01345756800487788
agent_compute-ego0_mean0.012044081424611714
agent_compute-ego0_median0.01187298984557396
agent_compute-ego0_min0.01097277800242106
complete-iteration_max0.1842212677001953
complete-iteration_mean0.15752854098538424
complete-iteration_median0.15758722655627194
complete-iteration_min0.13071844312879774
deviation-center-line_max0.5362740643534367
deviation-center-line_mean0.2401740286916691
deviation-center-line_min0.09866160786142976
deviation-heading_max1.772167965593244
deviation-heading_mean0.9756191524588368
deviation-heading_median0.8440120739554773
deviation-heading_min0.4422844963311483
driven_any_max2.4521091379052353
driven_any_mean1.6232694274388892
driven_any_median1.4879899733306008
driven_any_min1.064988625189121
driven_lanedir_consec_max1.5896252471516426
driven_lanedir_consec_mean0.7929085383263111
driven_lanedir_consec_min0.311527992636798
driven_lanedir_max1.5896252471516426
driven_lanedir_mean0.7929085383263111
driven_lanedir_median0.635240456758402
driven_lanedir_min0.311527992636798
get_duckie_state_max1.7532194503630051e-06
get_duckie_state_mean1.5800395591825656e-06
get_duckie_state_median1.5880818708040716e-06
get_duckie_state_min1.3907750447591143e-06
get_robot_state_max0.003916752458822848
get_robot_state_mean0.0034378413921358607
get_robot_state_median0.003315002904216207
get_robot_state_min0.003204607301288181
get_state_dump_max0.00476858832619407
get_state_dump_mean0.004385874160540908
get_state_dump_median0.004270327805727583
get_state_dump_min0.004234252704514397
get_ui_image_max0.03169471938330848
get_ui_image_mean0.02763772896838968
get_ui_image_median0.027803005354597603
get_ui_image_min0.023250185781055022
in-drivable-lane_max4.449999999999984
in-drivable-lane_mean3.3749999999999973
in-drivable-lane_min2.1499999999999924
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4521091379052353, "get_ui_image": 0.024511885886289636, "step_physics": 0.08574634547136267, "survival_time": 9.750000000000004, "driven_lanedir": 1.5896252471516426, "get_state_dump": 0.004273538686791245, "get_robot_state": 0.003336261729804837, "sim_render-ego0": 0.0033958736731081593, "get_duckie_state": 1.599594038359973e-06, "in-drivable-lane": 3.65000000000002, "deviation-heading": 1.207568156973917, "agent_compute-ego0": 0.01176812454145782, "complete-iteration": 0.1451979802579296, "set_robot_commands": 0.0019392675283003823, "deviation-center-line": 0.5362740643534367, "driven_lanedir_consec": 1.5896252471516426, "sim_compute_sim_state": 0.008420010002291933, "sim_compute_performance-ego0": 0.0017319929843046227}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2466776297867128, "get_ui_image": 0.03169471938330848, "step_physics": 0.1025956901344093, "survival_time": 5.4999999999999885, "driven_lanedir": 0.311527992636798, "get_state_dump": 0.0042671169246639214, "get_robot_state": 0.003293744078627578, "sim_render-ego0": 0.00340611440641386, "get_duckie_state": 1.57656970324817e-06, "in-drivable-lane": 3.2499999999999907, "deviation-heading": 1.772167965593244, "agent_compute-ego0": 0.011977855149690096, "complete-iteration": 0.16997647285461426, "set_robot_commands": 0.0019447975330524616, "deviation-center-line": 0.182884613614752, "driven_lanedir_consec": 0.311527992636798, "sim_compute_sim_state": 0.008966445922851562, "sim_compute_performance-ego0": 0.0017547414109513567}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.064988625189121, "get_ui_image": 0.03109412482290557, "step_physics": 0.11437623669402767, "survival_time": 4.899999999999991, "driven_lanedir": 0.6325288344380494, "get_state_dump": 0.00476858832619407, "get_robot_state": 0.003916752458822848, "sim_render-ego0": 0.003932386937767568, "get_duckie_state": 1.7532194503630051e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 0.48045599093703767, "agent_compute-ego0": 0.01345756800487788, "complete-iteration": 0.1842212677001953, "set_robot_commands": 0.0023817149075594816, "deviation-center-line": 0.09866160786142976, "driven_lanedir_consec": 0.6325288344380494, "sim_compute_sim_state": 0.00803962620821866, "sim_compute_performance-ego0": 0.0021668540106879342}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7293023168744883, "get_ui_image": 0.023250185781055022, "step_physics": 0.0776069313287735, "survival_time": 7.149999999999983, "driven_lanedir": 0.6379520790787545, "get_state_dump": 0.004234252704514397, "get_robot_state": 0.003204607301288181, "sim_render-ego0": 0.003283277153968811, "get_duckie_state": 1.3907750447591143e-06, "in-drivable-lane": 4.449999999999984, "deviation-heading": 0.4422844963311483, "agent_compute-ego0": 0.01097277800242106, "complete-iteration": 0.13071844312879774, "set_robot_commands": 0.0018745313088099165, "deviation-center-line": 0.14287582893705802, "driven_lanedir_consec": 0.6379520790787545, "sim_compute_sim_state": 0.004562661051750183, "sim_compute_performance-ego0": 0.0016586134831110635}}
set_robot_commands_max0.0023817149075594816
set_robot_commands_mean0.0020350778194305605
set_robot_commands_median0.001942032530676422
set_robot_commands_min0.0018745313088099165
sim_compute_performance-ego0_max0.0021668540106879342
sim_compute_performance-ego0_mean0.0018280504722637445
sim_compute_performance-ego0_median0.0017433671976279895
sim_compute_performance-ego0_min0.0016586134831110635
sim_compute_sim_state_max0.008966445922851562
sim_compute_sim_state_mean0.007497185796278085
sim_compute_sim_state_median0.008229818105255297
sim_compute_sim_state_min0.004562661051750183
sim_render-ego0_max0.003932386937767568
sim_render-ego0_mean0.0035044130428145996
sim_render-ego0_median0.0034009940397610097
sim_render-ego0_min0.003283277153968811
simulation-passed1
step_physics_max0.11437623669402767
step_physics_mean0.09508130090714328
step_physics_median0.094171017802886
step_physics_min0.0776069313287735
survival_time_max9.750000000000004
survival_time_mean6.824999999999992
survival_time_min4.899999999999991
No reset possible
586826729Andrea Censi 🇨🇭template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:04:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.010504828559027778
agent_compute-ego0_mean0.010433763312195804
agent_compute-ego0_median0.010463280489501157
agent_compute-ego0_min0.010303663710753122
complete-iteration_max0.20347191976464313
complete-iteration_mean0.1774627032443095
complete-iteration_median0.1744436915497572
complete-iteration_min0.15749151011308035
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.2889504432678225e-06
get_duckie_state_mean1.2255101368156534e-06
get_duckie_state_median1.2195688762745273e-06
get_duckie_state_min1.173952351445737e-06
get_robot_state_max0.0036751429239908857
get_robot_state_mean0.003626246797373657
get_robot_state_median0.0036212551065638097
get_robot_state_min0.0035873340523761253
get_state_dump_max0.0047383904457092285
get_state_dump_mean0.00461504919528378
get_state_dump_median0.004593540216989564
get_state_dump_min0.004534725901446765
get_ui_image_max0.03450518328210582
get_ui_image_mean0.029680005630714837
get_ui_image_median0.028822335303248903
get_ui_image_min0.02657016863425573
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.02737603459177138, "step_physics": 0.09812214102926134, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004534725901446765, "get_robot_state": 0.003592053546181208, "sim_render-ego0": 0.003745862200290342, "get_duckie_state": 1.2569789645038073e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.010496294951137108, "complete-iteration": 0.1614642399775831, "set_robot_commands": 0.002150885666473002, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.009420649914801876, "sim_compute_performance-ego0": 0.0019452451150628585}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03450518328210582, "step_physics": 0.1329018629115561, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.004589231117911961, "get_robot_state": 0.0035873340523761253, "sim_render-ego0": 0.003786983697310738, "get_duckie_state": 1.173952351445737e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.010430266027865202, "complete-iteration": 0.20347191976464313, "set_robot_commands": 0.002177590909211532, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.009456997332365616, "sim_compute_performance-ego0": 0.001958880735480267}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.030268636014726423, "step_physics": 0.12288444572024876, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004597849316067166, "get_robot_state": 0.0036751429239908857, "sim_render-ego0": 0.0038037035200330946, "get_duckie_state": 1.1821587880452471e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.010504828559027778, "complete-iteration": 0.18742314312193128, "set_robot_commands": 0.002184185716840956, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.007448630200492011, "sim_compute_performance-ego0": 0.001974976725048489}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.02657016863425573, "step_physics": 0.09947987894217174, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.0047383904457092285, "get_robot_state": 0.003650456666946411, "sim_render-ego0": 0.0036613792181015015, "get_duckie_state": 1.2889504432678225e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.010303663710753122, "complete-iteration": 0.15749151011308035, "set_robot_commands": 0.0022067601482073465, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.004857271909713745, "sim_compute_performance-ego0": 0.0019437149167060852}}
set_robot_commands_max0.0022067601482073465
set_robot_commands_mean0.002179855610183209
set_robot_commands_median0.002180888313026244
set_robot_commands_min0.002150885666473002
sim_compute_performance-ego0_max0.001974976725048489
sim_compute_performance-ego0_mean0.001955704373074425
sim_compute_performance-ego0_median0.0019520629252715628
sim_compute_performance-ego0_min0.0019437149167060852
sim_compute_sim_state_max0.009456997332365616
sim_compute_sim_state_mean0.007795887339343312
sim_compute_sim_state_median0.008434640057646943
sim_compute_sim_state_min0.004857271909713745
sim_render-ego0_max0.0038037035200330946
sim_render-ego0_mean0.003749482158933919
sim_render-ego0_median0.00376642294880054
sim_render-ego0_min0.0036613792181015015
simulation-passed1
step_physics_max0.1329018629115561
step_physics_mean0.11334708215080948
step_physics_median0.11118216233121024
step_physics_min0.09812214102926134
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
586706756Liam Paull 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:02:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586446803Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:03:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586366800Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:00:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 39, in on_received_observations
              ||     jpg_data = data['camera']['jpg_data']
              || TypeError: 'Duckiebot1Observations' object is not subscriptable
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 474, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
              ||     raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
              || zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method ROSBaselineAgent.on_received_observations of <__main__.ROSBaselineAgent object at 0x7f71df3163d0>>.
              || │       f: <bound method ROSBaselineAgent.on_received_observations of <__main__.ROSBaselineAgent object at 0x7f71df3163d0>>
              || │    args: dict[2]
              || │          │ data:
              || │          │ Duckiebot1Observations
              || │          │ │ camera: JPGImage(jpg_data=71872 bytes b'\xff\xd8\xff\xe0\x00\x10JFIF')
              || │          │ context: <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f71c425cfa0>
              || │ argspec: <class 'inspect.FullArgSpec'>[7]
              || │          #0 [self, context, data]
              || │          #1 None
              || │          #2 None
              || │          #3 None
              || │          #4 []
              || │          #5 None
              || │          #6 dict[2]
              || │             │ context: <class 'zuper_nodes_wrapper.interface.Context'>
              || │             │ data:
              || │             │ dataclass aido_schemas.schemas.Duckiebot1Observations
              || │             │  field  camera : dataclass aido_schemas.protocol_simulator.JPGImage
              || │             │                   field jpg_data : bytes
              || │             │                          __doc__
              || │             │                                            An image in JPG format.
              || │             │
              || │             │                                            jpg_data
              || │             │        __doc__   Duckiebot1Observations(camera: aido_schemas.protoc
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586256805Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:03:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
585936823Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:28:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.205385464638705
survival_time_median59.99999999999873
deviation-center-line_median2.806634559730705
in-drivable-lane_median8.22499999999999


other stats
agent_compute-ego0_max0.013085618404226436
agent_compute-ego0_mean0.012780131394573142
agent_compute-ego0_median0.0127740756878822
agent_compute-ego0_min0.012486755798301727
complete-iteration_max0.22933768550394035
complete-iteration_mean0.1936844537182495
complete-iteration_median0.18625439047118608
complete-iteration_min0.17289134842668544
deviation-center-line_max3.949581296790671
deviation-center-line_mean2.6287355594272475
deviation-center-line_min0.952091821456907
deviation-heading_max10.3417188011292
deviation-heading_mean6.984910638904266
deviation-heading_median7.760958953486893
deviation-heading_min2.0760058475140744
driven_any_max7.921197772223129
driven_any_mean6.312851547014995
driven_any_median7.917633743226228
driven_any_min1.4949409293843936
driven_lanedir_consec_max6.606493022642767
driven_lanedir_consec_mean4.58154793930551
driven_lanedir_consec_min1.3089278053018647
driven_lanedir_max6.677727170119434
driven_lanedir_mean5.135659023628013
driven_lanedir_median6.277990559545376
driven_lanedir_min1.3089278053018647
get_duckie_state_max1.5065433778532538e-06
get_duckie_state_mean1.390574853641688e-06
get_duckie_state_median1.39080813087889e-06
get_duckie_state_min1.2741397749557186e-06
get_robot_state_max0.0038335367007418337
get_robot_state_mean0.003739750954874701
get_robot_state_median0.0037761897866076775
get_robot_state_min0.0035730875455416166
get_state_dump_max0.0049133290855414066
get_state_dump_mean0.004781098015478035
get_state_dump_median0.004771927115720674
get_state_dump_min0.004667208744929387
get_ui_image_max0.03578574165158909
get_ui_image_mean0.0314216872090416
get_ui_image_median0.031040538955389906
get_ui_image_min0.02781992927379751
in-drivable-lane_max11.999999999999512
in-drivable-lane_mean7.562499999999878
in-drivable-lane_min1.8000000000000176
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.921197772223129, "get_ui_image": 0.029731496386881377, "step_physics": 0.10582540732041486, "survival_time": 59.99999999999873, "driven_lanedir": 6.606493022642767, "get_state_dump": 0.004845341476770761, "get_robot_state": 0.0038335367007418337, "sim_render-ego0": 0.003923804237880278, "get_duckie_state": 1.5065433778532538e-06, "in-drivable-lane": 8.749999999999872, "deviation-heading": 6.839670223597505, "agent_compute-ego0": 0.013007480834147812, "complete-iteration": 0.17564366302521997, "set_robot_commands": 0.0023212283973789135, "deviation-center-line": 3.949581296790671, "driven_lanedir_consec": 6.606493022642767, "sim_compute_sim_state": 0.009971877716661592, "sim_compute_performance-ego0": 0.0020855985811409805}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.4949409293843936, "get_ui_image": 0.03578574165158909, "step_physics": 0.15422636198128767, "survival_time": 12.30000000000004, "driven_lanedir": 1.3089278053018647, "get_state_dump": 0.004667208744929387, "get_robot_state": 0.0035730875455416166, "sim_render-ego0": 0.0037643561961679807, "get_duckie_state": 1.2741397749557186e-06, "in-drivable-lane": 1.8000000000000176, "deviation-heading": 2.0760058475140744, "agent_compute-ego0": 0.012540670541616589, "complete-iteration": 0.22933768550394035, "set_robot_commands": 0.0022405294271615837, "deviation-center-line": 0.952091821456907, "driven_lanedir_consec": 1.3089278053018647, "sim_compute_sim_state": 0.01042621145364244, "sim_compute_performance-ego0": 0.0020213464976322312}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.914313952565608, "get_ui_image": 0.03234958152389844, "step_physics": 0.1247976201460026, "survival_time": 59.99999999999873, "driven_lanedir": 5.949488096447985, "get_state_dump": 0.004698512754670587, "get_robot_state": 0.003744829505011998, "sim_render-ego0": 0.003844160719973955, "get_duckie_state": 1.316959911540188e-06, "in-drivable-lane": 11.999999999999512, "deviation-heading": 10.3417188011292, "agent_compute-ego0": 0.012486755798301727, "complete-iteration": 0.19686511791715217, "set_robot_commands": 0.0022741682225718885, "deviation-center-line": 2.5942057838862285, "driven_lanedir_consec": 3.8402139848587744, "sim_compute_sim_state": 0.010471393623320288, "sim_compute_performance-ego0": 0.0021072500055775256}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920953533886847, "get_ui_image": 0.02781992927379751, "step_physics": 0.10823043299952118, "survival_time": 59.99999999999873, "driven_lanedir": 6.677727170119434, "get_state_dump": 0.0049133290855414066, "get_robot_state": 0.003807550068203357, "sim_render-ego0": 0.003921833959447653, "get_duckie_state": 1.4646563502175922e-06, "in-drivable-lane": 7.700000000000109, "deviation-heading": 8.682247683376282, "agent_compute-ego0": 0.013085618404226436, "complete-iteration": 0.17289134842668544, "set_robot_commands": 0.0022950309400852275, "deviation-center-line": 3.0190633355751824, "driven_lanedir_consec": 6.570556944418636, "sim_compute_sim_state": 0.006615234751387699, "sim_compute_performance-ego0": 0.0021040024705770905}}
set_robot_commands_max0.0023212283973789135
set_robot_commands_mean0.0022827392467994036
set_robot_commands_median0.002284599581328558
set_robot_commands_min0.0022405294271615837
sim_compute_performance-ego0_max0.0021072500055775256
sim_compute_performance-ego0_mean0.0020795493887319568
sim_compute_performance-ego0_median0.0020948005258590355
sim_compute_performance-ego0_min0.0020213464976322312
sim_compute_sim_state_max0.010471393623320288
sim_compute_sim_state_mean0.009371179386253006
sim_compute_sim_state_median0.010199044585152016
sim_compute_sim_state_min0.006615234751387699
sim_render-ego0_max0.003923804237880278
sim_render-ego0_mean0.003863538778367467
sim_render-ego0_median0.003882997339710804
sim_render-ego0_min0.0037643561961679807
simulation-passed1
step_physics_max0.15422636198128767
step_physics_mean0.12326995561180656
step_physics_median0.11651402657276189
step_physics_min0.10582540732041486
survival_time_max59.99999999999873
survival_time_mean48.07499999999906
survival_time_min12.30000000000004
No reset possible
585616836Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:45:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013637277506273256
agent_compute-ego0_mean0.01326826971635334
agent_compute-ego0_median0.013448221498881648
agent_compute-ego0_min0.012539358361376813
complete-iteration_max0.3784651494244553
complete-iteration_mean0.3219387904491949
complete-iteration_median0.3266500715014341
complete-iteration_min0.255989869369456
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.414630137117181e-06
get_duckie_state_mean1.3449011396905168e-06
get_duckie_state_median1.3353227080155373e-06
get_duckie_state_min1.2943290056138114e-06
get_robot_state_max0.003951176120081511
get_robot_state_mean0.00392229685080637
get_robot_state_median0.003917314825605889
get_robot_state_min0.003903381631932191
get_state_dump_max0.004913788651745087
get_state_dump_mean0.004880208258426358
get_state_dump_median0.004890669493949185
get_state_dump_min0.004825705394061975
get_ui_image_max0.03868530811020774
get_ui_image_mean0.03298793044515096
get_ui_image_median0.032743217149046835
get_ui_image_min0.02777997937230246
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.030731931316366205, "step_physics": 0.2345426304949809, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004913788651745087, "get_robot_state": 0.003903381631932191, "sim_render-ego0": 0.0040183708530778595, "get_duckie_state": 1.414630137117181e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.013311763091647158, "complete-iteration": 0.3053096517932901, "set_robot_commands": 0.002425939415416352, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009207086499585002, "sim_compute_performance-ego0": 0.0021607250496310853}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03868530811020774, "step_physics": 0.29627624101980243, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004870098496753905, "get_robot_state": 0.003951176120081511, "sim_render-ego0": 0.004103265535225976, "get_duckie_state": 1.3092177595127434e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013637277506273256, "complete-iteration": 0.3784651494244553, "set_robot_commands": 0.0023795403012824394, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.012263097731298848, "sim_compute_performance-ego0": 0.0022066153654150917}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03475450298172747, "step_physics": 0.27290850376507125, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004825705394061975, "get_robot_state": 0.0039098606220788505, "sim_render-ego0": 0.004007863958709742, "get_duckie_state": 1.2943290056138114e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.01358467990611614, "complete-iteration": 0.34799049120957803, "set_robot_commands": 0.0023812366266433246, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009384719259435192, "sim_compute_performance-ego0": 0.002143131108407077}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02777997937230246, "step_physics": 0.19201358390985976, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004911240491144464, "get_robot_state": 0.0039247690291329285, "sim_render-ego0": 0.00392058211301983, "get_duckie_state": 1.3614276565183312e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.012539358361376813, "complete-iteration": 0.255989869369456, "set_robot_commands": 0.002299406248564327, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00643748982959147, "sim_compute_performance-ego0": 0.0020734193819349355}}
set_robot_commands_max0.002425939415416352
set_robot_commands_mean0.002371530647976611
set_robot_commands_median0.0023803884639628818
set_robot_commands_min0.002299406248564327
sim_compute_performance-ego0_max0.0022066153654150917
sim_compute_performance-ego0_mean0.0021459727263470475
sim_compute_performance-ego0_median0.002151928079019081
sim_compute_performance-ego0_min0.0020734193819349355
sim_compute_sim_state_max0.012263097731298848
sim_compute_sim_state_mean0.009323098329977629
sim_compute_sim_state_median0.009295902879510097
sim_compute_sim_state_min0.00643748982959147
sim_render-ego0_max0.004103265535225976
sim_render-ego0_mean0.004012520615008352
sim_render-ego0_median0.004013117405893801
sim_render-ego0_min0.00392058211301983
simulation-passed1
step_physics_max0.29627624101980243
step_physics_mean0.2489352397974286
step_physics_median0.2537255671300261
step_physics_min0.19201358390985976
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
585376846Daniil Lisusexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:27:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.504840754270347
survival_time_median59.99999999999873
deviation-center-line_median1.216546680069829
in-drivable-lane_median6.350000000000046


other stats
agent_compute-ego0_max0.03360922191661164
agent_compute-ego0_mean0.018005855233487494
agent_compute-ego0_median0.012885236833698755
agent_compute-ego0_min0.012643725349940824
complete-iteration_max0.21255385055743828
complete-iteration_mean0.18694583498150025
complete-iteration_median0.17924625937091024
complete-iteration_min0.17673697062674212
deviation-center-line_max1.8696151790215392
deviation-center-line_mean1.1388641753608
deviation-center-line_min0.2527481622820023
deviation-heading_max9.376568774460342
deviation-heading_mean5.133420742076749
deviation-heading_median4.814821146762741
deviation-heading_min1.5274719003211694
driven_any_max6.19228006790988
driven_any_mean3.903836869838584
driven_any_median4.3920875509474016
driven_any_min0.6388923095496536
driven_lanedir_consec_max5.856121864907712
driven_lanedir_consec_mean2.77182132963326
driven_lanedir_consec_min0.22148194508463437
driven_lanedir_max5.856121864907712
driven_lanedir_mean2.77182132963326
driven_lanedir_median2.504840754270347
driven_lanedir_min0.22148194508463437
get_duckie_state_max1.4773614202113473e-06
get_duckie_state_mean1.3903732847332704e-06
get_duckie_state_median1.3721711922682586e-06
get_duckie_state_min1.3397893341852168e-06
get_robot_state_max0.0041073293709735096
get_robot_state_mean0.0038982782520961393
get_robot_state_median0.0038548519371153418
get_robot_state_min0.003776079763180364
get_state_dump_max0.005022576210600053
get_state_dump_mean0.004929371341841128
get_state_dump_median0.004921446476181225
get_state_dump_min0.004852016204402012
get_ui_image_max0.03636138275186851
get_ui_image_mean0.031205173904510337
get_ui_image_median0.031151778890528743
get_ui_image_min0.02615575508511533
in-drivable-lane_max52.799999999998704
in-drivable-lane_mean17.737499999999663
in-drivable-lane_min5.449999999999857
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.19228006790988, "get_ui_image": 0.02914650235743844, "step_physics": 0.10618111076799658, "survival_time": 59.99999999999873, "driven_lanedir": 5.856121864907712, "get_state_dump": 0.005022576210600053, "get_robot_state": 0.0041073293709735096, "sim_render-ego0": 0.004138564587036438, "get_duckie_state": 1.4773614202113473e-06, "in-drivable-lane": 5.449999999999857, "deviation-heading": 7.665145585116451, "agent_compute-ego0": 0.012643725349940824, "complete-iteration": 0.17673697062674212, "set_robot_commands": 0.0024342616332956994, "deviation-center-line": 1.8696151790215392, "driven_lanedir_consec": 5.856121864907712, "sim_compute_sim_state": 0.010667463226381884, "sim_compute_performance-ego0": 0.0022955018217418713}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6388923095496536, "get_ui_image": 0.03636138275186851, "step_physics": 0.13582155565736154, "survival_time": 9.4, "driven_lanedir": 0.22148194508463437, "get_state_dump": 0.004863843716010846, "get_robot_state": 0.003776079763180364, "sim_render-ego0": 0.0038604698483906096, "get_duckie_state": 1.385098411923363e-06, "in-drivable-lane": 6.350000000000001, "deviation-heading": 1.5274719003211694, "agent_compute-ego0": 0.012670108250209264, "complete-iteration": 0.21255385055743828, "set_robot_commands": 0.002219241762918139, "deviation-center-line": 0.2527481622820023, "driven_lanedir_consec": 0.22148194508463437, "sim_compute_sim_state": 0.010841932246293972, "sim_compute_performance-ego0": 0.0020434957332712}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.124149694540122, "get_ui_image": 0.03315705542361905, "step_physics": 0.1051024731549494, "survival_time": 59.99999999999873, "driven_lanedir": 4.524801239057554, "get_state_dump": 0.004979049236351604, "get_robot_state": 0.0038856671910599606, "sim_render-ego0": 0.003977253276243695, "get_duckie_state": 1.3397893341852168e-06, "in-drivable-lane": 6.35000000000009, "deviation-heading": 9.376568774460342, "agent_compute-ego0": 0.013100365417188252, "complete-iteration": 0.18151831884963823, "set_robot_commands": 0.002339146317887763, "deviation-center-line": 1.8414822001524016, "driven_lanedir_consec": 4.524801239057554, "sim_compute_sim_state": 0.012729516136556936, "sim_compute_performance-ego0": 0.0021456703357553603}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.66002540735468, "get_ui_image": 0.02615575508511533, "step_physics": 0.094111645052971, "survival_time": 59.99999999999873, "driven_lanedir": 0.4848802694831395, "get_state_dump": 0.004852016204402012, "get_robot_state": 0.003824036683170722, "sim_render-ego0": 0.0038447719529506865, "get_duckie_state": 1.3592439726131543e-06, "in-drivable-lane": 52.799999999998704, "deviation-heading": 1.9644967084090297, "agent_compute-ego0": 0.03360922191661164, "complete-iteration": 0.17697419989218224, "set_robot_commands": 0.0022697605558676484, "deviation-center-line": 0.5916111599872568, "driven_lanedir_consec": 0.4848802694831395, "sim_compute_sim_state": 0.006226941806688396, "sim_compute_performance-ego0": 0.001987554945616202}}
set_robot_commands_max0.0024342616332956994
set_robot_commands_mean0.002315602567492312
set_robot_commands_median0.0023044534368777056
set_robot_commands_min0.002219241762918139
sim_compute_performance-ego0_max0.0022955018217418713
sim_compute_performance-ego0_mean0.0021180557090961583
sim_compute_performance-ego0_median0.00209458303451328
sim_compute_performance-ego0_min0.001987554945616202
sim_compute_sim_state_max0.012729516136556936
sim_compute_sim_state_mean0.010116463353980296
sim_compute_sim_state_median0.010754697736337929
sim_compute_sim_state_min0.006226941806688396
sim_render-ego0_max0.004138564587036438
sim_render-ego0_mean0.003955264916155357
sim_render-ego0_median0.003918861562317152
sim_render-ego0_min0.0038447719529506865
simulation-passed1
step_physics_max0.13582155565736154
step_physics_mean0.11030419615831964
step_physics_median0.105641791961473
step_physics_min0.094111645052971
survival_time_max59.99999999999873
survival_time_mean47.34999999999904
survival_time_min9.4
No reset possible
585116852Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:08:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7977062852297826
survival_time_median13.80000000000006
deviation-center-line_median0.7387642617362422
in-drivable-lane_median5.475000000000062


other stats
agent_compute-ego0_max0.013982437275074146
agent_compute-ego0_mean0.0130547123512684
agent_compute-ego0_median0.012794434487513877
agent_compute-ego0_min0.0126475431549717
complete-iteration_max0.21309030409212465
complete-iteration_mean0.18426187741107897
complete-iteration_median0.1772017428882069
complete-iteration_min0.16955371977577746
deviation-center-line_max0.8379408994400002
deviation-center-line_mean0.702472321769424
deviation-center-line_min0.4944198641652112
deviation-heading_max3.423876900832177
deviation-heading_mean2.6199213467073466
deviation-heading_median2.76084418784617
deviation-heading_min1.5341201103048712
driven_any_max3.1885990819105077
driven_any_mean2.4443815602124888
driven_any_median2.5544263020665134
driven_any_min1.4800745548064211
driven_lanedir_consec_max1.2441718805886337
driven_lanedir_consec_mean0.8854596735848215
driven_lanedir_consec_min0.7022542432910871
driven_lanedir_max1.875914348046508
driven_lanedir_mean1.391596169875118
driven_lanedir_median1.4542227047738432
driven_lanedir_min0.782024921906278
get_duckie_state_max1.8252266777886288e-06
get_duckie_state_mean1.6867527801881914e-06
get_duckie_state_median1.6752263190041127e-06
get_duckie_state_min1.571331804955912e-06
get_robot_state_max0.003946876525878907
get_robot_state_mean0.0038305817911656226
get_robot_state_median0.0038440246873745337
get_robot_state_min0.0036874012640345168
get_state_dump_max0.005133487560130932
get_state_dump_mean0.005010483751760888
get_state_dump_median0.0050048991975178685
get_state_dump_min0.004898649051876887
get_ui_image_max0.03647186932740388
get_ui_image_mean0.03042293309989883
get_ui_image_median0.029483232098537905
get_ui_image_min0.026253398875115623
in-drivable-lane_max8.40000000000007
in-drivable-lane_mean5.237500000000047
in-drivable-lane_min1.5999999999999952
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.4800745548064211, "get_ui_image": 0.02783257683361966, "step_physics": 0.10335998593663875, "survival_time": 8.09999999999998, "driven_lanedir": 1.2441718805886337, "get_state_dump": 0.004898649051876887, "get_robot_state": 0.003902795124639031, "sim_render-ego0": 0.0038460222489994727, "get_duckie_state": 1.6689300537109375e-06, "in-drivable-lane": 1.5999999999999952, "deviation-heading": 1.5341201103048712, "agent_compute-ego0": 0.012808910908143211, "complete-iteration": 0.16989363190586582, "set_robot_commands": 0.002214556091402206, "deviation-center-line": 0.661690229482047, "driven_lanedir_consec": 1.2441718805886337, "sim_compute_sim_state": 0.00889661999567886, "sim_compute_performance-ego0": 0.002035788963177453}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.507284818486238, "get_ui_image": 0.03647186932740388, "step_physics": 0.13392720134169966, "survival_time": 13.450000000000056, "driven_lanedir": 0.782024921906278, "get_state_dump": 0.005133487560130932, "get_robot_state": 0.003946876525878907, "sim_render-ego0": 0.004069305349279333, "get_duckie_state": 1.8252266777886288e-06, "in-drivable-lane": 8.40000000000007, "deviation-heading": 2.403207090911923, "agent_compute-ego0": 0.013982437275074146, "complete-iteration": 0.21309030409212465, "set_robot_commands": 0.0023460458826135705, "deviation-center-line": 0.4944198641652112, "driven_lanedir_consec": 0.782024921906278, "sim_compute_sim_state": 0.01089457317634865, "sim_compute_performance-ego0": 0.002209945961281105}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.1885990819105077, "get_ui_image": 0.031133887363456143, "step_physics": 0.11556253377457112, "survival_time": 17.050000000000107, "driven_lanedir": 1.664273528959053, "get_state_dump": 0.005037180164404083, "get_robot_state": 0.0036874012640345168, "sim_render-ego0": 0.003833276486536215, "get_duckie_state": 1.571331804955912e-06, "in-drivable-lane": 7.35000000000009, "deviation-heading": 3.423876900832177, "agent_compute-ego0": 0.012779958066884535, "complete-iteration": 0.184509853870548, "set_robot_commands": 0.002191252875746342, "deviation-center-line": 0.8158382939904374, "driven_lanedir_consec": 0.7022542432910871, "sim_compute_sim_state": 0.00818029621191192, "sim_compute_performance-ego0": 0.0020062065961068136}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6015677856467887, "get_ui_image": 0.026253398875115623, "step_physics": 0.10757974503745496, "survival_time": 14.150000000000066, "driven_lanedir": 1.875914348046508, "get_state_dump": 0.004972618230631653, "get_robot_state": 0.003785254250110035, "sim_render-ego0": 0.003915999976681991, "get_duckie_state": 1.6815225842972877e-06, "in-drivable-lane": 3.6000000000000334, "deviation-heading": 3.1184812847804153, "agent_compute-ego0": 0.0126475431549717, "complete-iteration": 0.16955371977577746, "set_robot_commands": 0.002254187221258459, "deviation-center-line": 0.8379408994400002, "driven_lanedir_consec": 0.8133876485532872, "sim_compute_sim_state": 0.005984542235522203, "sim_compute_performance-ego0": 0.0020594823528343525}}
set_robot_commands_max0.0023460458826135705
set_robot_commands_mean0.0022515105177551443
set_robot_commands_median0.0022343716563303327
set_robot_commands_min0.002191252875746342
sim_compute_performance-ego0_max0.002209945961281105
sim_compute_performance-ego0_mean0.0020778559683499306
sim_compute_performance-ego0_median0.0020476356580059027
sim_compute_performance-ego0_min0.0020062065961068136
sim_compute_sim_state_max0.01089457317634865
sim_compute_sim_state_mean0.008489007904865408
sim_compute_sim_state_median0.008538458103795391
sim_compute_sim_state_min0.005984542235522203
sim_render-ego0_max0.004069305349279333
sim_render-ego0_mean0.003916151015374254
sim_render-ego0_median0.003881011112840732
sim_render-ego0_min0.003833276486536215
simulation-passed1
step_physics_max0.13392720134169966
step_physics_mean0.11510736652259113
step_physics_median0.11157113940601304
step_physics_min0.10335998593663875
survival_time_max17.050000000000107
survival_time_mean13.187500000000052
survival_time_min8.09999999999998
No reset possible
585029236Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:07:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6769108319633372
survival_time_median11.800000000000033
deviation-center-line_median0.17300581352145625
in-drivable-lane_median4.85000000000003


other stats
agent_compute-ego0_max0.014021233705143944
agent_compute-ego0_mean0.013359086522671367
agent_compute-ego0_median0.013553715703913068
agent_compute-ego0_min0.012307680977715386
complete-iteration_max0.24816755078873545
complete-iteration_mean0.1934674120764424
complete-iteration_median0.18296506860278416
complete-iteration_min0.1597719603114658
deviation-center-line_max0.5722637954819846
deviation-center-line_mean0.2504517173865186
deviation-center-line_min0.08353144702117743
deviation-heading_max1.709507309723723
deviation-heading_mean0.925921161446384
deviation-heading_median0.7058374081086349
deviation-heading_min0.5825025198445435
driven_any_max3.1047973641388222
driven_any_mean1.9858379994800468
driven_any_median2.255754202203172
driven_any_min0.32704622937502004
driven_lanedir_consec_max2.0270705761054875
driven_lanedir_consec_mean0.8880972660617822
driven_lanedir_consec_min0.1714968242149668
driven_lanedir_max2.0270705761054875
driven_lanedir_mean0.8880972660617822
driven_lanedir_median0.6769108319633372
driven_lanedir_min0.1714968242149668
get_duckie_state_max1.633802551460864e-06
get_duckie_state_mean1.499320958430119e-06
get_duckie_state_median1.4850285710885731e-06
get_duckie_state_min1.3934241400824652e-06
get_robot_state_max0.00400022428984926
get_robot_state_mean0.003866110003325607
get_robot_state_median0.003853349215319367
get_robot_state_min0.0037575172928144343
get_state_dump_max0.005249388913002134
get_state_dump_mean0.005112076365882748
get_state_dump_median0.005110280227024615
get_state_dump_min0.004978356096479628
get_ui_image_max0.03488036371626944
get_ui_image_mean0.030931178789426583
get_ui_image_median0.031354130210532356
get_ui_image_min0.02613609102037218
in-drivable-lane_max12.150000000000096
in-drivable-lane_mean5.775000000000039
in-drivable-lane_min1.2499999999999982
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.85323619361272, "get_ui_image": 0.02905387781104263, "step_physics": 0.10304247522029748, "survival_time": 14.650000000000071, "driven_lanedir": 2.0270705761054875, "get_state_dump": 0.005150593867918261, "get_robot_state": 0.0039169318011017884, "sim_render-ego0": 0.004018151030248525, "get_duckie_state": 1.5440441313244048e-06, "in-drivable-lane": 4.4000000000000625, "deviation-heading": 1.709507309723723, "agent_compute-ego0": 0.013137767104064526, "complete-iteration": 0.17330113397974548, "set_robot_commands": 0.0024060481259612, "deviation-center-line": 0.5722637954819846, "driven_lanedir_consec": 2.0270705761054875, "sim_compute_sim_state": 0.010281475222840602, "sim_compute_performance-ego0": 0.0021925288803723393}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.32704622937502004, "get_ui_image": 0.03488036371626944, "step_physics": 0.17256341340406886, "survival_time": 2.5999999999999988, "driven_lanedir": 0.1714968242149668, "get_state_dump": 0.00506996658613097, "get_robot_state": 0.0037575172928144343, "sim_render-ego0": 0.0040790135005735004, "get_duckie_state": 1.4260130108527417e-06, "in-drivable-lane": 1.2499999999999982, "deviation-heading": 0.7816936044696271, "agent_compute-ego0": 0.013969664303761608, "complete-iteration": 0.24816755078873545, "set_robot_commands": 0.0024471148005071677, "deviation-center-line": 0.08353144702117743, "driven_lanedir_consec": 0.1714968242149668, "sim_compute_sim_state": 0.00924083871661492, "sim_compute_performance-ego0": 0.002061897853635392}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.1047973641388222, "get_ui_image": 0.033654382610022085, "step_physics": 0.11569366783931335, "survival_time": 15.900000000000093, "driven_lanedir": 0.6837641856517811, "get_state_dump": 0.005249388913002134, "get_robot_state": 0.00400022428984926, "sim_render-ego0": 0.004225047030792715, "get_duckie_state": 1.633802551460864e-06, "in-drivable-lane": 12.150000000000096, "deviation-heading": 0.6299812117476429, "agent_compute-ego0": 0.014021233705143944, "complete-iteration": 0.1926290032258228, "set_robot_commands": 0.0023569836511881, "deviation-center-line": 0.1700007084792843, "driven_lanedir_consec": 0.6837641856517811, "sim_compute_sim_state": 0.01105424602951002, "sim_compute_performance-ego0": 0.002272833103670222}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.658272210793624, "get_ui_image": 0.02613609102037218, "step_physics": 0.09902252753575642, "survival_time": 8.949999999999992, "driven_lanedir": 0.6700574782748934, "get_state_dump": 0.004978356096479628, "get_robot_state": 0.0037897666295369464, "sim_render-ego0": 0.0039144463009304475, "get_duckie_state": 1.3934241400824652e-06, "in-drivable-lane": 5.299999999999997, "deviation-heading": 0.5825025198445435, "agent_compute-ego0": 0.012307680977715386, "complete-iteration": 0.1597719603114658, "set_robot_commands": 0.0022778418329026965, "deviation-center-line": 0.1760109185636282, "driven_lanedir_consec": 0.6700574782748934, "sim_compute_sim_state": 0.005262709988488092, "sim_compute_performance-ego0": 0.0019898136456807454}}
set_robot_commands_max0.0024471148005071677
set_robot_commands_mean0.002371997102639791
set_robot_commands_median0.00238151588857465
set_robot_commands_min0.0022778418329026965
sim_compute_performance-ego0_max0.002272833103670222
sim_compute_performance-ego0_mean0.002129268370839674
sim_compute_performance-ego0_median0.002127213367003866
sim_compute_performance-ego0_min0.0019898136456807454
sim_compute_sim_state_max0.01105424602951002
sim_compute_sim_state_mean0.00895981748936341
sim_compute_sim_state_median0.009761156969727762
sim_compute_sim_state_min0.005262709988488092
sim_render-ego0_max0.004225047030792715
sim_render-ego0_mean0.004059164465636297
sim_render-ego0_median0.004048582265411013
sim_render-ego0_min0.0039144463009304475
simulation-passed1
step_physics_max0.17256341340406886
step_physics_mean0.12258052099985904
step_physics_median0.10936807152980542
step_physics_min0.09902252753575642
survival_time_max15.900000000000093
survival_time_mean10.525000000000038
survival_time_min2.5999999999999988
No reset possible
584939238Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:08:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.008769098915205
survival_time_median11.750000000000032
deviation-center-line_median0.2926372925751593
in-drivable-lane_median4.800000000000029


other stats
agent_compute-ego0_max0.0472389077240566
agent_compute-ego0_mean0.04195415184539141
agent_compute-ego0_median0.04163647725623451
agent_compute-ego0_min0.037304745145040015
complete-iteration_max0.2624190978284152
complete-iteration_mean0.21203511174428932
complete-iteration_median0.20278713476101143
complete-iteration_min0.18014707962671916
deviation-center-line_max0.5974171387161349
deviation-center-line_mean0.31676263408263394
deviation-center-line_min0.08435881246408236
deviation-heading_max1.839428651580268
deviation-heading_mean1.1477496913988772
deviation-heading_median1.092886250108145
deviation-heading_min0.56579761379895
driven_any_max3.859520286481351
driven_any_mean2.169279333761671
driven_any_median2.245275653368239
driven_any_min0.3270457418288548
driven_lanedir_consec_max2.0483678095879325
driven_lanedir_consec_mean1.0591197919579438
driven_lanedir_consec_min0.1705731604134324
driven_lanedir_max2.0483678095879325
driven_lanedir_mean1.0591197919579438
driven_lanedir_median1.008769098915205
driven_lanedir_min0.1705731604134324
get_duckie_state_max2.463386483388404e-06
get_duckie_state_mean2.293391683265368e-06
get_duckie_state_median2.3249419245675193e-06
get_duckie_state_min2.0602964005380307e-06
get_robot_state_max0.003961088712258107
get_robot_state_mean0.003781622291297786
get_robot_state_median0.003813571391040332
get_robot_state_min0.003538257670852373
get_state_dump_max0.005147885178665981
get_state_dump_mean0.004835692677992491
get_state_dump_median0.00487244186336047
get_state_dump_min0.004450001806583045
get_ui_image_max0.03321781670650863
get_ui_image_mean0.03021345103497158
get_ui_image_median0.030714702655499408
get_ui_image_min0.02620658212237888
in-drivable-lane_max12.2500000000001
in-drivable-lane_mean5.7750000000000385
in-drivable-lane_min1.2499999999999982
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.832276250902942, "get_ui_image": 0.028555860258128545, "step_physics": 0.09807017649689766, "survival_time": 14.550000000000072, "driven_lanedir": 2.0483678095879325, "get_state_dump": 0.005094302843694817, "get_robot_state": 0.0039003385256414546, "sim_render-ego0": 0.0039502741539315005, "get_duckie_state": 2.463386483388404e-06, "in-drivable-lane": 4.25000000000006, "deviation-heading": 1.3969720124352298, "agent_compute-ego0": 0.037304745145040015, "complete-iteration": 0.1917669324025716, "set_robot_commands": 0.002389176251137093, "deviation-center-line": 0.5974171387161349, "driven_lanedir_consec": 2.0483678095879325, "sim_compute_sim_state": 0.01022423946694152, "sim_compute_performance-ego0": 0.002164864376799701}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3270457418288548, "get_ui_image": 0.03287354505287027, "step_physics": 0.157376784198689, "survival_time": 2.5999999999999988, "driven_lanedir": 0.1705731604134324, "get_state_dump": 0.004450001806583045, "get_robot_state": 0.003538257670852373, "sim_render-ego0": 0.0037675893531655368, "get_duckie_state": 2.0602964005380307e-06, "in-drivable-lane": 1.2499999999999982, "deviation-heading": 0.7888004877810609, "agent_compute-ego0": 0.0472389077240566, "complete-iteration": 0.2624190978284152, "set_robot_commands": 0.002251368648601028, "deviation-center-line": 0.08435881246408236, "driven_lanedir_consec": 0.1705731604134324, "sim_compute_sim_state": 0.008790232100576724, "sim_compute_performance-ego0": 0.002035514363702738}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.859520286481351, "get_ui_image": 0.03321781670650863, "step_physics": 0.10613592384416427, "survival_time": 19.500000000000146, "driven_lanedir": 1.3565476062411692, "get_state_dump": 0.005147885178665981, "get_robot_state": 0.003961088712258107, "sim_render-ego0": 0.004111540591930185, "get_duckie_state": 2.4604065643856895e-06, "in-drivable-lane": 12.2500000000001, "deviation-heading": 1.839428651580268, "agent_compute-ego0": 0.044947516277927875, "complete-iteration": 0.21380733711945127, "set_robot_commands": 0.002428081029516352, "deviation-center-line": 0.4085378036562056, "driven_lanedir_consec": 1.3565476062411692, "sim_compute_sim_state": 0.011541082426105314, "sim_compute_performance-ego0": 0.002201898018722339}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6582750558335355, "get_ui_image": 0.02620658212237888, "step_physics": 0.09383542670143977, "survival_time": 8.949999999999992, "driven_lanedir": 0.6609905915892409, "get_state_dump": 0.004650580883026123, "get_robot_state": 0.003726804256439209, "sim_render-ego0": 0.003766454590691461, "get_duckie_state": 2.189477284749349e-06, "in-drivable-lane": 5.349999999999997, "deviation-heading": 0.56579761379895, "agent_compute-ego0": 0.038325438234541154, "complete-iteration": 0.18014707962671916, "set_robot_commands": 0.002310666773054335, "deviation-center-line": 0.1767367814941131, "driven_lanedir_consec": 0.6609905915892409, "sim_compute_sim_state": 0.005209534698062472, "sim_compute_performance-ego0": 0.00201724370320638}}
set_robot_commands_max0.002428081029516352
set_robot_commands_mean0.002344823175577202
set_robot_commands_median0.002349921512095714
set_robot_commands_min0.002251368648601028
sim_compute_performance-ego0_max0.002201898018722339
sim_compute_performance-ego0_mean0.0021048801156077898
sim_compute_performance-ego0_median0.0021001893702512196
sim_compute_performance-ego0_min0.00201724370320638
sim_compute_sim_state_max0.011541082426105314
sim_compute_sim_state_mean0.008941272172921507
sim_compute_sim_state_median0.009507235783759125
sim_compute_sim_state_min0.005209534698062472
sim_render-ego0_max0.004111540591930185
sim_render-ego0_mean0.0038989646724296705
sim_render-ego0_median0.003858931753548518
sim_render-ego0_min0.003766454590691461
simulation-passed1
step_physics_max0.157376784198689
step_physics_mean0.11385457781029767
step_physics_median0.10210305017053098
step_physics_min0.09383542670143977
survival_time_max19.500000000000146
survival_time_mean11.400000000000052
survival_time_min2.5999999999999988
No reset possible
584719243Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:08:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6946411742740501
survival_time_median8.949999999999992
deviation-center-line_median0.2490145281345859
in-drivable-lane_median4.725000000000035


other stats
agent_compute-ego0_max0.03625090028986584
agent_compute-ego0_mean0.026304224826030943
agent_compute-ego0_median0.02729881665983253
agent_compute-ego0_min0.014368365694592882
complete-iteration_max0.23043077618050176
complete-iteration_mean0.20331116213856257
complete-iteration_median0.2040423786318229
complete-iteration_min0.1747291151101027
deviation-center-line_max1.2692857390580914
deviation-center-line_mean0.48429665690615753
deviation-center-line_min0.16987183229736666
deviation-heading_max2.805421957517778
deviation-heading_mean1.5469753402969382
deviation-heading_median1.4008306798333383
deviation-heading_min0.5808180440032985
driven_any_max4.928671275017078
driven_any_mean2.376278391277715
driven_any_median1.6582508635711823
driven_any_min1.259940562951416
driven_lanedir_consec_max3.954751948934782
driven_lanedir_consec_mean1.5042740607409275
driven_lanedir_consec_min0.673061945480828
driven_lanedir_max3.954751948934782
driven_lanedir_mean1.5113147508306135
driven_lanedir_median0.7033969510816256
driven_lanedir_min0.6837131522244205
get_duckie_state_max1.6372520606834573e-06
get_duckie_state_mean1.5101590577208847e-06
get_duckie_state_median1.5170711372888502e-06
get_duckie_state_min1.3692418956223814e-06
get_robot_state_max0.004000513703673036
get_robot_state_mean0.00385998955200634
get_robot_state_median0.003874929859509382
get_robot_state_min0.0036895847853335583
get_state_dump_max0.0051451446293117285
get_state_dump_mean0.005013499408202094
get_state_dump_median0.005065172650992578
get_state_dump_min0.00477850770151149
get_ui_image_max0.03488226443029649
get_ui_image_mean0.03125658611549183
get_ui_image_median0.03110982782736762
get_ui_image_min0.02792442437693559
in-drivable-lane_max5.199999999999998
in-drivable-lane_mean4.500000000000014
in-drivable-lane_min3.349999999999988
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.928671275017078, "get_ui_image": 0.028202656323347633, "step_physics": 0.10001232711280264, "survival_time": 24.550000000000217, "driven_lanedir": 3.954751948934782, "get_state_dump": 0.005011474698539672, "get_robot_state": 0.003788884093121784, "sim_render-ego0": 0.003906927942260494, "get_duckie_state": 1.520645327684356e-06, "in-drivable-lane": 5.000000000000071, "deviation-heading": 2.805421957517778, "agent_compute-ego0": 0.01884794235229492, "complete-iteration": 0.1747291151101027, "set_robot_commands": 0.00236691255879596, "deviation-center-line": 1.2692857390580914, "driven_lanedir_consec": 3.954751948934782, "sim_compute_sim_state": 0.010370805980713388, "sim_compute_performance-ego0": 0.002116033216802085}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.6477547497971692, "get_ui_image": 0.03488226443029649, "step_physics": 0.13236257483839323, "survival_time": 8.899999999999991, "driven_lanedir": 0.7012247058395715, "get_state_dump": 0.00477850770151149, "get_robot_state": 0.0036895847853335583, "sim_render-ego0": 0.003850958200806346, "get_duckie_state": 1.3692418956223814e-06, "in-drivable-lane": 4.449999999999999, "deviation-heading": 2.1726931066388384, "agent_compute-ego0": 0.03625090028986584, "complete-iteration": 0.23043077618050176, "set_robot_commands": 0.002399191510077962, "deviation-center-line": 0.32456372962930324, "driven_lanedir_consec": 0.673061945480828, "sim_compute_sim_state": 0.010060651342296069, "sim_compute_performance-ego0": 0.00205314225990679}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.259940562951416, "get_ui_image": 0.034016999331387604, "step_physics": 0.13819114478318006, "survival_time": 7.099999999999983, "driven_lanedir": 0.6837131522244205, "get_state_dump": 0.0051451446293117285, "get_robot_state": 0.004000513703673036, "sim_render-ego0": 0.004088335103921957, "get_duckie_state": 1.6372520606834573e-06, "in-drivable-lane": 3.349999999999988, "deviation-heading": 0.6289682530278384, "agent_compute-ego0": 0.014368365694592882, "complete-iteration": 0.21361932554445068, "set_robot_commands": 0.0024550044453227437, "deviation-center-line": 0.16987183229736666, "driven_lanedir_consec": 0.6837131522244205, "sim_compute_sim_state": 0.009037046165733071, "sim_compute_performance-ego0": 0.002205430210887135}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6687469773451955, "get_ui_image": 0.02792442437693559, "step_physics": 0.10713295778516908, "survival_time": 8.999999999999993, "driven_lanedir": 0.7055691963236796, "get_state_dump": 0.005118870603445485, "get_robot_state": 0.00396097562589698, "sim_render-ego0": 0.004088333298488216, "get_duckie_state": 1.5134969468933442e-06, "in-drivable-lane": 5.199999999999998, "deviation-heading": 0.5808180440032985, "agent_compute-ego0": 0.035749690967370136, "complete-iteration": 0.19446543171919511, "set_robot_commands": 0.0024597131086317872, "deviation-center-line": 0.17346532663986858, "driven_lanedir_consec": 0.7055691963236796, "sim_compute_sim_state": 0.005773265058823054, "sim_compute_performance-ego0": 0.002153334696648529}}
set_robot_commands_max0.0024597131086317872
set_robot_commands_mean0.002420205405707113
set_robot_commands_median0.002427097977700353
set_robot_commands_min0.00236691255879596
sim_compute_performance-ego0_max0.002205430210887135
sim_compute_performance-ego0_mean0.0021319850960611346
sim_compute_performance-ego0_median0.002134683956725307
sim_compute_performance-ego0_min0.00205314225990679
sim_compute_sim_state_max0.010370805980713388
sim_compute_sim_state_mean0.008810442136891396
sim_compute_sim_state_median0.009548848754014568
sim_compute_sim_state_min0.005773265058823054
sim_render-ego0_max0.004088335103921957
sim_render-ego0_mean0.003983638636369254
sim_render-ego0_median0.003997630620374355
sim_render-ego0_min0.003850958200806346
simulation-passed1
step_physics_max0.13819114478318006
step_physics_mean0.11942475112988624
step_physics_median0.11974776631178116
step_physics_min0.10001232711280264
survival_time_max24.550000000000217
survival_time_mean12.387500000000044
survival_time_min7.099999999999983
No reset possible
5843612737Thomas Wiggers 🇳🇱ppo_v1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:32:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.063005359889502
survival_time_median59.349999999998765
deviation-center-line_median1.696852548781674
in-drivable-lane_median18.274999999999352


other stats
agent_compute-ego0_max0.0837852359314346
agent_compute-ego0_mean0.07701833846296238
agent_compute-ego0_median0.07641680244908738
agent_compute-ego0_min0.07145451302224017
complete-iteration_max0.2591541025858934
complete-iteration_mean0.2349681553760767
complete-iteration_median0.23226051116058533
complete-iteration_min0.2161974965972428
deviation-center-line_max2.1253446035450927
deviation-center-line_mean1.427482086272419
deviation-center-line_min0.19087864398123291
deviation-heading_max13.713902864637628
deviation-heading_mean6.880623752735419
deviation-heading_median6.33004457700938
deviation-heading_min1.1485029922852863
driven_any_max8.54357157361525
driven_any_mean6.161415924995966
driven_any_median7.14593274494959
driven_any_min1.810226636469436
driven_lanedir_consec_max6.25793119530719
driven_lanedir_consec_mean3.7832156094261
driven_lanedir_consec_min0.7489205226182056
driven_lanedir_max6.805917043919255
driven_lanedir_mean4.294070439966156
driven_lanedir_median4.81072209666358
driven_lanedir_min0.7489205226182056
get_duckie_state_max1.4162182708664004e-06
get_duckie_state_mean1.3645536474118555e-06
get_duckie_state_median1.3923949697776066e-06
get_duckie_state_min1.257206379225808e-06
get_robot_state_max0.003814206427716194
get_robot_state_mean0.003763798201377095
get_robot_state_median0.0038086116363563504
get_robot_state_min0.003623763105079486
get_state_dump_max0.004792859097744556
get_state_dump_mean0.004686001929214093
get_state_dump_median0.004683900832335816
get_state_dump_min0.004583346954440185
get_ui_image_max0.036356879511443306
get_ui_image_mean0.03149531824245862
get_ui_image_median0.03139174925268751
get_ui_image_min0.026840894953016156
in-drivable-lane_max24.899999999999395
in-drivable-lane_mean17.97499999999955
in-drivable-lane_min10.450000000000106
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.259784671888047, "get_ui_image": 0.02904426386513182, "step_physics": 0.09351943593338864, "survival_time": 59.99999999999873, "driven_lanedir": 6.805917043919255, "get_state_dump": 0.004715971307492474, "get_robot_state": 0.00381085973893673, "sim_render-ego0": 0.0038225613069176978, "get_duckie_state": 1.4162182708664004e-06, "in-drivable-lane": 14.39999999999918, "deviation-heading": 6.536782212919248, "agent_compute-ego0": 0.07811899149447654, "complete-iteration": 0.22742964802534751, "set_robot_commands": 0.002274626994708694, "deviation-center-line": 1.8308324463656276, "driven_lanedir_consec": 6.25793119530719, "sim_compute_sim_state": 0.009963617634515184, "sim_compute_performance-ego0": 0.0020690684910122303}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.032080818011132, "get_ui_image": 0.036356879511443306, "step_physics": 0.11011130128871592, "survival_time": 59.99999999999873, "driven_lanedir": 3.3060129526878246, "get_state_dump": 0.004651830357179157, "get_robot_state": 0.003806363533775971, "sim_render-ego0": 0.003876272188833016, "get_duckie_state": 1.257206379225808e-06, "in-drivable-lane": 24.899999999999395, "deviation-heading": 13.713902864637628, "agent_compute-ego0": 0.0837852359314346, "complete-iteration": 0.2591541025858934, "set_robot_commands": 0.002235909485003037, "deviation-center-line": 2.1253446035450927, "driven_lanedir_consec": 2.424357355678488, "sim_compute_sim_state": 0.012108971733137727, "sim_compute_performance-ego0": 0.0021304605803223672}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.54357157361525, "get_ui_image": 0.033739234640243206, "step_physics": 0.10319575857608876, "survival_time": 58.6999999999988, "driven_lanedir": 6.315431240639336, "get_state_dump": 0.004792859097744556, "get_robot_state": 0.003814206427716194, "sim_render-ego0": 0.003962785639661424, "get_duckie_state": 1.3874946756565824e-06, "in-drivable-lane": 22.14999999999952, "deviation-heading": 6.123306941099512, "agent_compute-ego0": 0.07145451302224017, "complete-iteration": 0.2370913742958231, "set_robot_commands": 0.0022797874694174907, "deviation-center-line": 1.5628726511977205, "driven_lanedir_consec": 5.701653364100515, "sim_compute_sim_state": 0.011645471491712203, "sim_compute_performance-ego0": 0.002109708988920171}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.810226636469436, "get_ui_image": 0.026840894953016156, "step_physics": 0.09317524883400176, "survival_time": 16.100000000000094, "driven_lanedir": 0.7489205226182056, "get_state_dump": 0.004583346954440185, "get_robot_state": 0.003623763105079486, "sim_render-ego0": 0.003746654965191065, "get_duckie_state": 1.397295263898631e-06, "in-drivable-lane": 10.450000000000106, "deviation-heading": 1.1485029922852863, "agent_compute-ego0": 0.07471461340369824, "complete-iteration": 0.2161974965972428, "set_robot_commands": 0.0021538955877439896, "deviation-center-line": 0.19087864398123291, "driven_lanedir_consec": 0.7489205226182056, "sim_compute_sim_state": 0.005276895528976393, "sim_compute_performance-ego0": 0.001991150179883644}}
set_robot_commands_max0.0022797874694174907
set_robot_commands_mean0.002236054884218303
set_robot_commands_median0.0022552682398558656
set_robot_commands_min0.0021538955877439896
sim_compute_performance-ego0_max0.0021304605803223672
sim_compute_performance-ego0_mean0.002075097060034603
sim_compute_performance-ego0_median0.0020893887399662005
sim_compute_performance-ego0_min0.001991150179883644
sim_compute_sim_state_max0.012108971733137727
sim_compute_sim_state_mean0.009748739097085376
sim_compute_sim_state_median0.010804544563113694
sim_compute_sim_state_min0.005276895528976393
sim_render-ego0_max0.003962785639661424
sim_render-ego0_mean0.0038520685251508006
sim_render-ego0_median0.0038494167478753567
sim_render-ego0_min0.003746654965191065
simulation-passed1
step_physics_max0.11011130128871592
step_physics_mean0.10000043615804877
step_physics_median0.0983575972547387
step_physics_min0.09317524883400176
survival_time_max59.99999999999873
survival_time_mean48.69999999999909
survival_time_min16.100000000000094
No reset possible
584199276Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:02:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.