Duckietown Challenges Home Challenges Submissions

Evaluator 4924

ID4924
evaluatornogpu-prod-07
ownerI don't have one πŸ˜€
machinenogpu-prod_62d94014cea0
processnogpu-prod-07_62d94014cea0
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success21 58169
# timeout
# failed13 58255
# error1 58747
# aborted5 58269
# host-error9 59137
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6011810933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6011110933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6010710933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6010511012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:33
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6010211012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6009811772Ehsan AhmadiΒ πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6009611010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6008711010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:01:24
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5994412766Anastasiya NikolskayaΒ πŸ‡·πŸ‡ΊJetBrains Researchaido5-LFP-sim-validationLFP-simsuccessyesnogpu-prod-070:07:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.149999999999986
in-drivable-lane_median0.0
driven_lanedir_consec_median1.6700998441725898
deviation-center-line_median0.3320116784695889


other stats
agent_compute-ego0_max0.03439344373242609
agent_compute-ego0_mean0.03146219902320069
agent_compute-ego0_median0.030859546291017996
agent_compute-ego0_min0.029736259778340657
complete-iteration_max0.33879520893096926
complete-iteration_mean0.2918938402309573
complete-iteration_median0.3018231305258174
complete-iteration_min0.22513389094122524
deviation-center-line_max0.5858437583448596
deviation-center-line_mean0.3495715397118493
deviation-center-line_min0.14841904356335991
deviation-heading_max2.1430259798880575
deviation-heading_mean1.5443303235745387
deviation-heading_median1.7866576025586256
deviation-heading_min0.4609801092928453
driven_any_max2.388939092819927
driven_any_mean1.655287425403806
driven_any_median1.8452474667276169
driven_any_min0.5417156753400634
driven_lanedir_consec_max2.2567264002183403
driven_lanedir_consec_mean1.532318302377878
driven_lanedir_consec_min0.5323471209479919
driven_lanedir_max2.2567264002183403
driven_lanedir_mean1.532318302377878
driven_lanedir_median1.6700998441725898
driven_lanedir_min0.5323471209479919
get_duckie_state_max0.024179946581522622
get_duckie_state_mean0.01726093761517312
get_duckie_state_median0.020449397193575365
get_duckie_state_min0.003965009492019127
get_robot_state_max0.0037878847122192385
get_robot_state_mean0.003579509727870523
get_robot_state_median0.003534885803086858
get_robot_state_min0.0034603825930891365
get_state_dump_max0.008341816266377767
get_state_dump_mean0.0073125302645261105
get_state_dump_median0.007936854223603185
get_state_dump_min0.005034596344520306
get_ui_image_max0.03647085666656494
get_ui_image_mean0.03151126404570064
get_ui_image_median0.032300778407495
get_ui_image_min0.024972642701247643
in-drivable-lane_max0.4999999999999982
in-drivable-lane_mean0.12499999999999956
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.154395577398295, "get_ui_image": 0.030658683776855468, "step_physics": 0.1715819009145101, "survival_time": 7.449999999999981, "driven_lanedir": 2.0258478305146967, "get_state_dump": 0.008341816266377767, "get_robot_state": 0.0035559956232706705, "sim_render-ego0": 0.00366235097249349, "get_duckie_state": 0.024179946581522622, "in-drivable-lane": 0.0, "deviation-heading": 2.1430259798880575, "agent_compute-ego0": 0.029736259778340657, "complete-iteration": 0.28311309655507405, "set_robot_commands": 0.0020417690277099608, "deviation-center-line": 0.5858437583448596, "driven_lanedir_consec": 2.0258478305146967, "sim_compute_sim_state": 0.007408769925435384, "sim_compute_performance-ego0": 0.001847848892211914}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5417156753400634, "get_ui_image": 0.03647085666656494, "step_physics": 0.22165968418121337, "survival_time": 2.4499999999999993, "driven_lanedir": 0.5323471209479919, "get_state_dump": 0.008209733963012696, "get_robot_state": 0.0037878847122192385, "sim_render-ego0": 0.003975296020507812, "get_duckie_state": 0.021148571968078612, "in-drivable-lane": 0.0, "deviation-heading": 0.4609801092928453, "agent_compute-ego0": 0.02994732856750488, "complete-iteration": 0.33879520893096926, "set_robot_commands": 0.0022504377365112306, "deviation-center-line": 0.14841904356335991, "driven_lanedir_consec": 0.5323471209479919, "sim_compute_sim_state": 0.009109349250793456, "sim_compute_performance-ego0": 0.002130708694458008}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.5360993560569387, "get_ui_image": 0.03394287303813453, "step_physics": 0.20390395747805104, "survival_time": 5.09999999999999, "driven_lanedir": 1.314351857830483, "get_state_dump": 0.007663974484193673, "get_robot_state": 0.003513775982903045, "sim_render-ego0": 0.003689115487256096, "get_duckie_state": 0.01975022241907212, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 1.6827025907793602, "agent_compute-ego0": 0.031771764014531106, "complete-iteration": 0.3205331644965607, "set_robot_commands": 0.0021897010432863698, "deviation-center-line": 0.26787037380379725, "driven_lanedir_consec": 1.314351857830483, "sim_compute_sim_state": 0.012198938906771465, "sim_compute_performance-ego0": 0.0018210457366647072}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.388939092819927, "get_ui_image": 0.024972642701247643, "step_physics": 0.1404870395002694, "survival_time": 7.199999999999982, "driven_lanedir": 2.2567264002183403, "get_state_dump": 0.005034596344520306, "get_robot_state": 0.0034603825930891365, "sim_render-ego0": 0.0035464089492271687, "get_duckie_state": 0.003965009492019127, "in-drivable-lane": 0.0, "deviation-heading": 1.8906126143378912, "agent_compute-ego0": 0.03439344373242609, "complete-iteration": 0.22513389094122524, "set_robot_commands": 0.002036612609337116, "deviation-center-line": 0.3961529831353806, "driven_lanedir_consec": 2.2567264002183403, "sim_compute_sim_state": 0.005375934469288793, "sim_compute_performance-ego0": 0.0017804112927667026}}
set_robot_commands_max0.0022504377365112306
set_robot_commands_mean0.002129630104211169
set_robot_commands_median0.0021157350354981653
set_robot_commands_min0.002036612609337116
sim_compute_performance-ego0_max0.002130708694458008
sim_compute_performance-ego0_mean0.0018950036540253327
sim_compute_performance-ego0_median0.0018344473144383104
sim_compute_performance-ego0_min0.0017804112927667026
sim_compute_sim_state_max0.012198938906771465
sim_compute_sim_state_mean0.008523248138072275
sim_compute_sim_state_median0.008259059588114421
sim_compute_sim_state_min0.005375934469288793
sim_render-ego0_max0.003975296020507812
sim_render-ego0_mean0.0037182928573711417
sim_render-ego0_median0.0036757332298747937
sim_render-ego0_min0.0035464089492271687
simulation-passed1
step_physics_max0.22165968418121337
step_physics_mean0.18440814551851095
step_physics_median0.18774292919628055
step_physics_min0.1404870395002694
survival_time_max7.449999999999981
survival_time_mean5.549999999999988
survival_time_min2.4499999999999993
No reset possible
5913710359Charlie GauthierΒ πŸ‡¨πŸ‡¦template-rosaido5-LF-sanitysanity-checkhost-erroryesnogpu-prod-071:02:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

β”‚ container_ids: [f12626e60ebf5edf52c3e3d79c00e69e63191e69aa9e1b840d75ca63d3cbe5ca,
β”‚                 e1c9ba5cca66fa738715a3e318c21be70cd73a4fa652d37319ec05ef95fff0d2,
β”‚                 e4e24fa0a621d4255580bef822d68e4212b428d6868a0c58abc1606cff387dcf]
β”‚      services: dict[4]
β”‚                β”‚ solution:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/velythyl/aido-submissions@sha256:41144424beedd3a99525d1961a7bf461fae284f7f260725a9899f38940dad391
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[12]
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_IN: /fifos/ego-in
β”‚                β”‚ β”‚ β”‚ AIDO_REQUIRE_GPU: 1
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10359
β”‚                β”‚ β”‚ β”‚ submitter_name: Velythyl
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/velythyl/aido-submissions:2020_09_28_20_41_54@sha256:41144424beedd3a99525d1961a7bf461fae284f7f260725a9899f38940dad391
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-07_62d94014cea0}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_57-20080/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚                β”‚ evaluator:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:9f8c352de4d76e7de198d4dea8278469907949f1ca0595b4e2e12c509be34491
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[10]
β”‚                β”‚ β”‚ β”‚ experiment_manager_parameters:
β”‚                β”‚ β”‚ β”‚ |episodes_per_scenario: 1
β”‚                β”‚ β”‚ β”‚ |episode_length_s: 0.5
β”‚                β”‚ β”‚ β”‚ |min_episode_length_s: 0.0
β”‚                β”‚ β”‚ β”‚ |seed: 20200922
β”‚                β”‚ β”‚ β”‚ |physics_dt: 0.05
β”‚                β”‚ β”‚ β”‚ |max_failures: 2
β”‚                β”‚ β”‚ β”‚ |fifo_dir: /fifos
β”‚                β”‚ β”‚ β”‚ |sim_in: /fifos/simulator-in
β”‚                β”‚ β”‚ β”‚ |sim_out: /fifos/simulator-out
β”‚                β”‚ β”‚ β”‚ |sm_in: /fifos/scenario_maker-in
β”‚                β”‚ β”‚ β”‚ |sm_out: /fifos/scenario_maker-out
β”‚                β”‚ β”‚ β”‚ |timeout_initialization: 120
β”‚                β”‚ β”‚ β”‚ |timeout_regular: 120
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ |port: 10123 # visualization port
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10359
β”‚                β”‚ β”‚ β”‚ submitter_name: Velythyl
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/velythyl/aido-submissions:2020_09_28_20_41_54@sha256:41144424beedd3a99525d1961a7bf461fae284f7f260725a9899f38940dad391
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-07_62d94014cea0}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_57-20080/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚                β”‚ simulator:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:af0283a494930b4d3448453526d9c22469233f65218cb6c37753c3aae5162cbb
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[12]
β”‚                β”‚ β”‚ β”‚ AIDONODE_CONFIG:
β”‚                β”‚ β”‚ β”‚ |env_constructor: Simulator
β”‚                β”‚ β”‚ β”‚ |env_parameters:
β”‚                β”‚ β”‚ β”‚ |  max_steps: 500001 # we don't want the gym to reset itself
β”‚                β”‚ β”‚ β”‚ |  domain_rand: 0
β”‚                β”‚ β”‚ β”‚ |  camera_width: 640
β”‚                β”‚ β”‚ β”‚ |  camera_height: 480
β”‚                β”‚ β”‚ β”‚ |  distortion: true
β”‚                β”‚ β”‚ β”‚ |  num_tris_distractors: 0
β”‚                β”‚ β”‚ β”‚ |  color_ground: [0, 0.3, 0] # green
β”‚                β”‚ β”‚ β”‚ |  enable_leds: true
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_IN: /fifos/simulator-in
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10359
β”‚                β”‚ β”‚ β”‚ submitter_name: Velythyl
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/velythyl/aido-submissions:2020_09_28_20_41_54@sha256:41144424beedd3a99525d1961a7bf461fae284f7f260725a9899f38940dad391
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-07_62d94014cea0}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_57-20080/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚                β”‚ scenario_maker:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:e980f12a61e1e1b37982b6b2a5bc22ef89144f627bf1e6ebaeeac554e4bfb877
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[12]
β”‚                β”‚ β”‚ β”‚ AIDONODE_CONFIG:
β”‚                β”‚ β”‚ β”‚ |maps:
β”‚                β”‚ β”‚ β”‚ |- udem1
β”‚                β”‚ β”‚ β”‚ |scenarios_per_map: 1
β”‚                β”‚ β”‚ β”‚ |robots_npcs: []
β”‚                β”‚ β”‚ β”‚ |robots_pcs: [ego]
β”‚                β”‚ β”‚ β”‚ |robots_parked: [parked]
β”‚                β”‚ β”‚ β”‚ |nduckies: 1
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_IN: /fifos/scenario_maker-in
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10359
β”‚                β”‚ β”‚ β”‚ submitter_name: Velythyl
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/velythyl/aido-submissions:2020_09_28_20_41_54@sha256:41144424beedd3a99525d1961a7bf461fae284f7f260725a9899f38940dad391
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-07_62d94014cea0}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10359/sanity-check-nogpu-prod-07_62d94014cea0-job59137-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_57-20080/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚           res: dict[3]
β”‚                β”‚ evaluator: f12626e60ebf5edf52c3e3d79c00e69e63191e69aa9e1b840d75ca63d3cbe5ca
β”‚                β”‚ simulator: e1c9ba5cca66fa738715a3e318c21be70cd73a4fa652d37319ec05ef95fff0d2
β”‚                β”‚ solution: e4e24fa0a621d4255580bef822d68e4212b428d6868a0c58abc1606cff387dcf
β”‚         names: dict[3]
β”‚                β”‚ f12626e60ebf5edf52c3e3d79c00e69e63191e69aa9e1b840d75ca63d3cbe5ca: nogpu-prod-07_62d94014cea0-job59137-459234_evaluator_1
β”‚                β”‚ e1c9ba5cca66fa738715a3e318c21be70cd73a4fa652d37319ec05ef95fff0d2: nogpu-prod-07_62d94014cea0-job59137-459234_simulator_1
β”‚                β”‚ e4e24fa0a621d4255580bef822d68e4212b428d6868a0c58abc1606cff387dcf: nogpu-prod-07_62d94014cea0-job59137-459234_solution_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
β”‚ output: |f12626e60ebf5edf52c3e3d79c00e69e63191e69aa9e1b840d75ca63d3cbe5ca
β”‚         |e1c9ba5cca66fa738715a3e318c21be70cd73a4fa652d37319ec05ef95fff0d2
β”‚         |e4e24fa0a621d4255580bef822d68e4212b428d6868a0c58abc1606cff387dcf
β”‚         |
β”‚  names: dict[3]
β”‚         β”‚ f12626e60ebf5edf52c3e3d79c00e69e63191e69aa9e1b840d75ca63d3cbe5ca: nogpu-prod-07_62d94014cea0-job59137-459234_evaluator_1
β”‚         β”‚ e1c9ba5cca66fa738715a3e318c21be70cd73a4fa652d37319ec05ef95fff0d2: nogpu-prod-07_62d94014cea0-job59137-459234_simulator_1
β”‚         β”‚ e4e24fa0a621d4255580bef822d68e4212b428d6868a0c58abc1606cff387dcf: nogpu-prod-07_62d94014cea0-job59137-459234_solution_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5909512779Thomas WiggersΒ πŸ‡³πŸ‡±ppo_v1aido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesnogpu-prod-070:47:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9075967771138004
survival_time_median22.450000000000184
deviation-center-line_median0.4134319513314788
in-drivable-lane_median16.150000000000148


other stats
agent_compute-ego0_max0.08101010163625082
agent_compute-ego0_mean0.056528832223570705
agent_compute-ego0_median0.05015542543479029
agent_compute-ego0_min0.037675070094170975
agent_compute-ego1_max0.06270090103149414
agent_compute-ego1_mean0.047062601155130605
agent_compute-ego1_median0.043238236466982334
agent_compute-ego1_min0.0371654871468232
complete-iteration_max1.0742355998357136
complete-iteration_mean0.8159477637058418
complete-iteration_median0.8301285621014141
complete-iteration_min0.26491468688037906
deviation-center-line_max1.4614637709352958
deviation-center-line_mean0.5003826453413441
deviation-center-line_min0.198255572192448
deviation-heading_max5.361874023570144
deviation-heading_mean2.3374592517609862
deviation-heading_median2.1348641746248775
deviation-heading_min0.9085832568332964
driven_any_max4.101273107299533
driven_any_mean2.4521668405743924
driven_any_median2.3105641095039764
driven_any_min1.544939587680913
driven_lanedir_consec_max2.4749083751355956
driven_lanedir_consec_mean1.1607565960151955
driven_lanedir_consec_min0.24681941851253697
driven_lanedir_max2.4749083751355956
driven_lanedir_mean1.1607565960151955
driven_lanedir_median0.9075967771138004
driven_lanedir_min0.24681941851253697
get_duckie_state_max1.576346189237488e-06
get_duckie_state_mean1.462483156917084e-06
get_duckie_state_median1.5396542019314235e-06
get_duckie_state_min1.248689455406688e-06
get_robot_state_max0.015346341326757131
get_robot_state_mean0.01375601206508867
get_robot_state_median0.01521022531721327
get_robot_state_min0.007157248202885423
get_state_dump_max0.010059102537668296
get_state_dump_mean0.009222730150689076
get_state_dump_median0.01001835028330485
get_state_dump_min0.006117479823460089
get_ui_image_max0.05376271459791395
get_ui_image_mean0.04501472232622112
get_ui_image_median0.04852765405238582
get_ui_image_min0.029198673283942392
in-drivable-lane_max27.500000000000306
in-drivable-lane_mean15.7535714285716
in-drivable-lane_min2.3000000000000327
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.1107282518616355, "get_ui_image": 0.04066182284950291, "step_physics": 0.5564923363584215, "survival_time": 32.4000000000003, "driven_lanedir": 1.2571455658674062, "get_state_dump": 0.00914336279470858, "get_robot_state": 0.014010851482397236, "sim_render-ego0": 0.0037543443024434, "sim_render-ego1": 0.003649186279814122, "sim_render-ego2": 0.0036426325241112377, "sim_render-ego3": 0.0035186548629784252, "get_duckie_state": 1.3783459303375386e-06, "in-drivable-lane": 24.200000000000315, "deviation-heading": 0.9085832568332964, "agent_compute-ego0": 0.047847850664370965, "agent_compute-ego1": 0.043238236466982334, "agent_compute-ego2": 0.03698813529521548, "agent_compute-ego3": 0.03552925715277485, "complete-iteration": 0.8301285621014141, "set_robot_commands": 0.0021134355953551587, "deviation-center-line": 0.198255572192448, "driven_lanedir_consec": 1.2571455658674062, "sim_compute_sim_state": 0.015390190762253866, "sim_compute_performance-ego0": 0.002008586524998646, "sim_compute_performance-ego1": 0.0018471969845482309, "sim_compute_performance-ego2": 0.0017899945263502594, "sim_compute_performance-ego3": 0.0018280889660992495}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 4.101273107299533, "get_ui_image": 0.04066182284950291, "step_physics": 0.5564923363584215, "survival_time": 32.4000000000003, "driven_lanedir": 2.4749083751355956, "get_state_dump": 0.00914336279470858, "get_robot_state": 0.014010851482397236, "sim_render-ego0": 0.0037543443024434, "sim_render-ego1": 0.003649186279814122, "sim_render-ego2": 0.0036426325241112377, "sim_render-ego3": 0.0035186548629784252, "get_duckie_state": 1.3783459303375386e-06, "in-drivable-lane": 10.650000000000034, "deviation-heading": 5.361874023570144, "agent_compute-ego0": 0.047847850664370965, "agent_compute-ego1": 0.043238236466982334, "agent_compute-ego2": 0.03698813529521548, "agent_compute-ego3": 0.03552925715277485, "complete-iteration": 0.8301285621014141, "set_robot_commands": 0.0021134355953551587, "deviation-center-line": 1.4614637709352958, "driven_lanedir_consec": 2.4749083751355956, "sim_compute_sim_state": 0.015390190762253866, "sim_compute_performance-ego0": 0.002008586524998646, "sim_compute_performance-ego1": 0.0018471969845482309, "sim_compute_performance-ego2": 0.0017899945263502594, "sim_compute_performance-ego3": 0.0018280889660992495}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.8059518699530184, "get_ui_image": 0.04066182284950291, "step_physics": 0.5564923363584215, "survival_time": 32.4000000000003, "driven_lanedir": 0.621071654044125, "get_state_dump": 0.00914336279470858, "get_robot_state": 0.014010851482397236, "sim_render-ego0": 0.0037543443024434, "sim_render-ego1": 0.003649186279814122, "sim_render-ego2": 0.0036426325241112377, "sim_render-ego3": 0.0035186548629784252, "get_duckie_state": 1.3783459303375386e-06, "in-drivable-lane": 27.500000000000306, "deviation-heading": 2.585283291963731, "agent_compute-ego0": 0.047847850664370965, "agent_compute-ego1": 0.043238236466982334, "agent_compute-ego2": 0.03698813529521548, "agent_compute-ego3": 0.03552925715277485, "complete-iteration": 0.8301285621014141, "set_robot_commands": 0.0021134355953551587, "deviation-center-line": 0.4114472906255719, "driven_lanedir_consec": 0.621071654044125, "sim_compute_sim_state": 0.015390190762253866, "sim_compute_performance-ego0": 0.002008586524998646, "sim_compute_performance-ego1": 0.0018471969845482309, "sim_compute_performance-ego2": 0.0017899945263502594, "sim_compute_performance-ego3": 0.0018280889660992495}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 2.010304922531389, "get_ui_image": 0.04066182284950291, "step_physics": 0.5564923363584215, "survival_time": 32.4000000000003, "driven_lanedir": 1.149143085542506, "get_state_dump": 0.00914336279470858, "get_robot_state": 0.014010851482397236, "sim_render-ego0": 0.0037543443024434, "sim_render-ego1": 0.003649186279814122, "sim_render-ego2": 0.0036426325241112377, "sim_render-ego3": 0.0035186548629784252, "get_duckie_state": 1.3783459303375386e-06, "in-drivable-lane": 22.150000000000286, "deviation-heading": 1.3332807907818554, "agent_compute-ego0": 0.047847850664370965, "agent_compute-ego1": 0.043238236466982334, "agent_compute-ego2": 0.03698813529521548, "agent_compute-ego3": 0.03552925715277485, "complete-iteration": 0.8301285621014141, "set_robot_commands": 0.0021134355953551587, "deviation-center-line": 0.69967880067541, "driven_lanedir_consec": 1.149143085542506, "sim_compute_sim_state": 0.015390190762253866, "sim_compute_performance-ego0": 0.002008586524998646, "sim_compute_performance-ego1": 0.0018471969845482309, "sim_compute_performance-ego2": 0.0017899945263502594, "sim_compute_performance-ego3": 0.0018280889660992495}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 2.373812951345048, "get_ui_image": 0.05376271459791395, "step_physics": 0.6746942297617594, "survival_time": 22.450000000000184, "driven_lanedir": 0.25529014552212925, "get_state_dump": 0.01001835028330485, "get_robot_state": 0.01521022531721327, "sim_render-ego0": 0.004168548583984375, "sim_render-ego1": 0.00400056627061632, "sim_render-ego2": 0.0038447835710313585, "sim_render-ego3": 0.003862172762552897, "get_duckie_state": 1.5396542019314235e-06, "in-drivable-lane": 19.550000000000164, "deviation-heading": 2.5537395848337066, "agent_compute-ego0": 0.08101010163625082, "agent_compute-ego1": 0.06270090103149414, "agent_compute-ego2": 0.05578079488542345, "agent_compute-ego3": 0.05724856323666043, "complete-iteration": 1.0742355998357136, "set_robot_commands": 0.002355409198337131, "deviation-center-line": 0.2804450003183821, "driven_lanedir_consec": 0.25529014552212925, "sim_compute_sim_state": 0.030156453450520832, "sim_compute_performance-ego0": 0.0022149409188164603, "sim_compute_performance-ego1": 0.002000792821248372, "sim_compute_performance-ego2": 0.001966223186916775, "sim_compute_performance-ego3": 0.002026714218987359}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 2.854767910004957, "get_ui_image": 0.05376271459791395, "step_physics": 0.6746942297617594, "survival_time": 22.450000000000184, "driven_lanedir": 0.5675129205560778, "get_state_dump": 0.01001835028330485, "get_robot_state": 0.01521022531721327, "sim_render-ego0": 0.004168548583984375, "sim_render-ego1": 0.00400056627061632, "sim_render-ego2": 0.0038447835710313585, "sim_render-ego3": 0.003862172762552897, "get_duckie_state": 1.5396542019314235e-06, "in-drivable-lane": 15.550000000000107, "deviation-heading": 3.99511126118562, "agent_compute-ego0": 0.08101010163625082, "agent_compute-ego1": 0.06270090103149414, "agent_compute-ego2": 0.05578079488542345, "agent_compute-ego3": 0.05724856323666043, "complete-iteration": 1.0742355998357136, "set_robot_commands": 0.002355409198337131, "deviation-center-line": 0.5647234750374569, "driven_lanedir_consec": 0.5675129205560778, "sim_compute_sim_state": 0.030156453450520832, "sim_compute_performance-ego0": 0.0022149409188164603, "sim_compute_performance-ego1": 0.002000792821248372, "sim_compute_performance-ego2": 0.001966223186916775, "sim_compute_performance-ego3": 0.002026714218987359}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 1.544939587680913, "get_ui_image": 0.05376271459791395, "step_physics": 0.6746942297617594, "survival_time": 22.450000000000184, "driven_lanedir": 0.24681941851253697, "get_state_dump": 0.01001835028330485, "get_robot_state": 0.01521022531721327, "sim_render-ego0": 0.004168548583984375, "sim_render-ego1": 0.00400056627061632, "sim_render-ego2": 0.0038447835710313585, "sim_render-ego3": 0.003862172762552897, "get_duckie_state": 1.5396542019314235e-06, "in-drivable-lane": 19.650000000000176, "deviation-heading": 2.597615201358681, "agent_compute-ego0": 0.08101010163625082, "agent_compute-ego1": 0.06270090103149414, "agent_compute-ego2": 0.05578079488542345, "agent_compute-ego3": 0.05724856323666043, "complete-iteration": 1.0742355998357136, "set_robot_commands": 0.002355409198337131, "deviation-center-line": 0.2300032088314247, "driven_lanedir_consec": 0.24681941851253697, "sim_compute_sim_state": 0.030156453450520832, "sim_compute_performance-ego0": 0.0022149409188164603, "sim_compute_performance-ego1": 0.002000792821248372, "sim_compute_performance-ego2": 0.001966223186916775, "sim_compute_performance-ego3": 0.002026714218987359}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.410477726126387, "get_ui_image": 0.05376271459791395, "step_physics": 0.6746942297617594, "survival_time": 22.450000000000184, "driven_lanedir": 0.6660504686850947, "get_state_dump": 0.01001835028330485, "get_robot_state": 0.01521022531721327, "sim_render-ego0": 0.004168548583984375, "sim_render-ego1": 0.00400056627061632, "sim_render-ego2": 0.0038447835710313585, "sim_render-ego3": 0.003862172762552897, "get_duckie_state": 1.5396542019314235e-06, "in-drivable-lane": 16.75000000000019, "deviation-heading": 2.1378171419524685, "agent_compute-ego0": 0.08101010163625082, "agent_compute-ego1": 0.06270090103149414, "agent_compute-ego2": 0.05578079488542345, "agent_compute-ego3": 0.05724856323666043, "complete-iteration": 1.0742355998357136, "set_robot_commands": 0.002355409198337131, "deviation-center-line": 0.43895825515084136, "driven_lanedir_consec": 0.6660504686850947, "sim_compute_sim_state": 0.030156453450520832, "sim_compute_performance-ego0": 0.0022149409188164603, "sim_compute_performance-ego1": 0.002000792821248372, "sim_compute_performance-ego2": 0.001966223186916775, "sim_compute_performance-ego3": 0.002026714218987359}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 2.6883420152890776, "get_ui_image": 0.04852765405238582, "step_physics": 0.5133987411024606, "survival_time": 19.650000000000144, "driven_lanedir": 2.436038708471386, "get_state_dump": 0.010059102537668296, "get_robot_state": 0.015346341326757131, "sim_render-ego0": 0.0041582735661927816, "sim_render-ego1": 0.00398674834198153, "sim_render-ego2": 0.004055428625968507, "sim_render-ego3": 0.004001024410809357, "get_duckie_state": 1.576346189237488e-06, "in-drivable-lane": 2.3000000000000327, "deviation-heading": 2.1319112072972866, "agent_compute-ego0": 0.05015542543479029, "agent_compute-ego1": 0.04019722297106903, "agent_compute-ego2": 0.03640924129389264, "agent_compute-ego3": 0.03738274792124172, "complete-iteration": 0.8189956675931281, "set_robot_commands": 0.0023771705966310454, "deviation-center-line": 0.43521798585758786, "driven_lanedir_consec": 2.436038708471386, "sim_compute_sim_state": 0.03292341401734328, "sim_compute_performance-ego0": 0.002252230789455666, "sim_compute_performance-ego1": 0.0020387451055691327, "sim_compute_performance-ego2": 0.002070418469191808, "sim_compute_performance-ego3": 0.002095239416596853}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 1.8248585908060764, "get_ui_image": 0.04852765405238582, "step_physics": 0.5133987411024606, "survival_time": 19.650000000000144, "driven_lanedir": 1.2535112233305803, "get_state_dump": 0.010059102537668296, "get_robot_state": 0.015346341326757131, "sim_render-ego0": 0.0041582735661927816, "sim_render-ego1": 0.00398674834198153, "sim_render-ego2": 0.004055428625968507, "sim_render-ego3": 0.004001024410809357, "get_duckie_state": 1.576346189237488e-06, "in-drivable-lane": 10.60000000000015, "deviation-heading": 1.7637546876533845, "agent_compute-ego0": 0.05015542543479029, "agent_compute-ego1": 0.04019722297106903, "agent_compute-ego2": 0.03640924129389264, "agent_compute-ego3": 0.03738274792124172, "complete-iteration": 0.8189956675931281, "set_robot_commands": 0.0023771705966310454, "deviation-center-line": 0.29788914521425613, "driven_lanedir_consec": 1.2535112233305803, "sim_compute_sim_state": 0.03292341401734328, "sim_compute_performance-ego0": 0.002252230789455666, "sim_compute_performance-ego1": 0.0020387451055691327, "sim_compute_performance-ego2": 0.002070418469191808, "sim_compute_performance-ego3": 0.002095239416596853}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.8530493828909933, "get_ui_image": 0.04852765405238582, "step_physics": 0.5133987411024606, "survival_time": 19.650000000000144, "driven_lanedir": 0.6463363841639935, "get_state_dump": 0.010059102537668296, "get_robot_state": 0.015346341326757131, "sim_render-ego0": 0.0041582735661927816, "sim_render-ego1": 0.00398674834198153, "sim_render-ego2": 0.004055428625968507, "sim_render-ego3": 0.004001024410809357, "get_duckie_state": 1.576346189237488e-06, "in-drivable-lane": 15.200000000000152, "deviation-heading": 1.6909610342417762, "agent_compute-ego0": 0.05015542543479029, "agent_compute-ego1": 0.04019722297106903, "agent_compute-ego2": 0.03640924129389264, "agent_compute-ego3": 0.03738274792124172, "complete-iteration": 0.8189956675931281, "set_robot_commands": 0.0023771705966310454, "deviation-center-line": 0.4018426655624288, "driven_lanedir_consec": 0.6463363841639935, "sim_compute_sim_state": 0.03292341401734328, "sim_compute_performance-ego0": 0.002252230789455666, "sim_compute_performance-ego1": 0.0020387451055691327, "sim_compute_performance-ego2": 0.002070418469191808, "sim_compute_performance-ego3": 0.002095239416596853}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.2473152676629047, "get_ui_image": 0.04852765405238582, "step_physics": 0.5133987411024606, "survival_time": 19.650000000000144, "driven_lanedir": 1.856295107123529, "get_state_dump": 0.010059102537668296, "get_robot_state": 0.015346341326757131, "sim_render-ego0": 0.0041582735661927816, "sim_render-ego1": 0.00398674834198153, "sim_render-ego2": 0.004055428625968507, "sim_render-ego3": 0.004001024410809357, "get_duckie_state": 1.576346189237488e-06, "in-drivable-lane": 6.35000000000009, "deviation-heading": 1.4343091479090504, "agent_compute-ego0": 0.05015542543479029, "agent_compute-ego1": 0.04019722297106903, "agent_compute-ego2": 0.03640924129389264, "agent_compute-ego3": 0.03738274792124172, "complete-iteration": 0.8189956675931281, "set_robot_commands": 0.0023771705966310454, "deviation-center-line": 0.2992954873997595, "driven_lanedir_consec": 1.856295107123529, "sim_compute_sim_state": 0.03292341401734328, "sim_compute_performance-ego0": 0.002252230789455666, "sim_compute_performance-ego1": 0.0020387451055691327, "sim_compute_performance-ego2": 0.002070418469191808, "sim_compute_performance-ego3": 0.002095239416596853}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 2.9991511324006854, "get_ui_image": 0.029198673283942392, "step_physics": 0.1236694906359521, "survival_time": 26.700000000000244, "driven_lanedir": 2.181933881901564, "get_state_dump": 0.006117479823460089, "get_robot_state": 0.007157248202885423, "sim_render-ego0": 0.003766509082829841, "sim_render-ego1": 0.0036778302950279734, "get_duckie_state": 1.248689455406688e-06, "in-drivable-lane": 8.050000000000114, "deviation-heading": 2.408788199437072, "agent_compute-ego0": 0.037675070094170975, "agent_compute-ego1": 0.0371654871468232, "complete-iteration": 0.26491468688037906, "set_robot_commands": 0.002094090541946554, "deviation-center-line": 0.870719764940569, "driven_lanedir_consec": 2.181933881901564, "sim_compute_sim_state": 0.008408496535827066, "sim_compute_performance-ego0": 0.001944762969685492, "sim_compute_performance-ego1": 0.001848137935745382}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 3.5053630521888683, "get_ui_image": 0.029198673283942392, "step_physics": 0.1236694906359521, "survival_time": 26.700000000000244, "driven_lanedir": 0.6385354053562109, "get_state_dump": 0.006117479823460089, "get_robot_state": 0.007157248202885423, "sim_render-ego0": 0.003766509082829841, "sim_render-ego1": 0.0036778302950279734, "get_duckie_state": 1.248689455406688e-06, "in-drivable-lane": 22.050000000000253, "deviation-heading": 1.8214006956357336, "agent_compute-ego0": 0.037675070094170975, "agent_compute-ego1": 0.0371654871468232, "complete-iteration": 0.26491468688037906, "set_robot_commands": 0.002094090541946554, "deviation-center-line": 0.41541661203738567, "driven_lanedir_consec": 0.6385354053562109, "sim_compute_sim_state": 0.008408496535827066, "sim_compute_performance-ego0": 0.001944762969685492, "sim_compute_performance-ego1": 0.001848137935745382}}
set_robot_commands_max0.0023771705966310454
set_robot_commands_mean0.002255160188941889
set_robot_commands_median0.002355409198337131
set_robot_commands_min0.002094090541946554
sim_compute_performance-ego0_max0.002252230789455666
sim_compute_performance-ego0_mean0.0021280399194610047
sim_compute_performance-ego0_median0.0022149409188164603
sim_compute_performance-ego0_min0.001944762969685492
sim_compute_performance-ego1_max0.0020387451055691327
sim_compute_performance-ego1_mean0.0019459439654966931
sim_compute_performance-ego1_median0.002000792821248372
sim_compute_performance-ego1_min0.0018471969845482309
sim_compute_sim_state_max0.03292341401734328
sim_compute_sim_state_mean0.023621230428009
sim_compute_sim_state_median0.030156453450520832
sim_compute_sim_state_min0.008408496535827066
sim_render-ego0_max0.004168548583984375
sim_render-ego0_mean0.003989834569724421
sim_render-ego0_median0.0041582735661927816
sim_render-ego0_min0.0037543443024434
sim_render-ego1_max0.00400056627061632
sim_render-ego1_mean0.003850118868550274
sim_render-ego1_median0.00398674834198153
sim_render-ego1_min0.003649186279814122
simulation-passed1
step_physics_max0.6746942297617594
step_physics_mean0.516120015011605
step_physics_median0.5564923363584215
step_physics_min0.1236694906359521
survival_time_max32.4000000000003
survival_time_mean25.100000000000215
survival_time_min19.650000000000144
No reset possible
5902712792Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesnogpu-prod-071:35:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.473467837984988
survival_time_median59.99999999999873
deviation-center-line_median3.102259236213401
in-drivable-lane_median5.150000000000006


other stats
agent_compute-ego0_max0.014387388487119932
agent_compute-ego0_mean0.013359566699639096
agent_compute-ego0_median0.013553423845797751
agent_compute-ego0_min0.012407968284486237
agent_compute-ego1_max0.014284776828019366
agent_compute-ego1_mean0.013494309245780793
agent_compute-ego1_median0.013786391949871994
agent_compute-ego1_min0.012135063579537092
complete-iteration_max1.2420102128862691
complete-iteration_mean1.0353576275290035
complete-iteration_median1.157199922151907
complete-iteration_min0.5074327443097089
deviation-center-line_max6.382123514300493
deviation-center-line_mean2.7186293534837307
deviation-center-line_min0.08249049450010255
deviation-heading_max33.5414002574734
deviation-heading_mean11.062085616378846
deviation-heading_median10.635150955911026
deviation-heading_min0.8810969047076987
driven_any_max16.674867115266423
driven_any_mean7.732733659830941
driven_any_median7.269598890667819
driven_any_min0.6455725053178668
driven_lanedir_consec_max15.338966243641597
driven_lanedir_consec_mean5.5963854038201815
driven_lanedir_consec_min0.0867289967724445
driven_lanedir_max15.338966243641597
driven_lanedir_mean6.089188176807332
driven_lanedir_median4.545709249857182
driven_lanedir_min0.1045373479882219
get_duckie_state_max1.9105705055030618e-06
get_duckie_state_mean1.7012355290773662e-06
get_duckie_state_median1.7729439041986928e-06
get_duckie_state_min1.4237619061751926e-06
get_robot_state_max0.01559989041432453
get_robot_state_mean0.013977026196515622
get_robot_state_median0.015277964422475927
get_robot_state_min0.008019962826290646
get_state_dump_max0.010210108286174451
get_state_dump_mean0.00947738368029557
get_state_dump_median0.010181461940895607
get_state_dump_min0.007026292182303764
get_ui_image_max0.05052066148932575
get_ui_image_mean0.045054503316421766
get_ui_image_median0.04969845246911347
get_ui_image_min0.03447814567669018
in-drivable-lane_max55.999999999998735
in-drivable-lane_mean9.964285714285609
in-drivable-lane_min0.30000000000000027
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 16.67459515562513, "get_ui_image": 0.04023257481069192, "step_physics": 0.7952392137020852, "survival_time": 59.99999999999873, "driven_lanedir": 13.301119220569555, "get_state_dump": 0.009266126562812544, "get_robot_state": 0.014031755437858891, "sim_render-ego0": 0.003824106362538969, "sim_render-ego1": 0.003985705125540321, "sim_render-ego2": 0.004199817714643518, "sim_render-ego3": 0.003984817358774507, "get_duckie_state": 1.4237619061751926e-06, "in-drivable-lane": 8.499999999999813, "deviation-heading": 16.145531009658406, "agent_compute-ego0": 0.012407968284486237, "agent_compute-ego1": 0.012135063579537092, "agent_compute-ego2": 0.018340214007502294, "agent_compute-ego3": 0.016693143026715613, "complete-iteration": 0.9708251891584816, "set_robot_commands": 0.002254549013784188, "deviation-center-line": 3.957731338189476, "driven_lanedir_consec": 12.51929634793704, "sim_compute_sim_state": 0.019370585456676623, "sim_compute_performance-ego0": 0.002000270735512765, "sim_compute_performance-ego1": 0.001917235162434828, "sim_compute_performance-ego2": 0.001953154181957642, "sim_compute_performance-ego3": 0.001980821655552949}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 16.674867115266423, "get_ui_image": 0.04023257481069192, "step_physics": 0.7952392137020852, "survival_time": 59.99999999999873, "driven_lanedir": 12.745887708461913, "get_state_dump": 0.009266126562812544, "get_robot_state": 0.014031755437858891, "sim_render-ego0": 0.003824106362538969, "sim_render-ego1": 0.003985705125540321, "sim_render-ego2": 0.004199817714643518, "sim_render-ego3": 0.003984817358774507, "get_duckie_state": 1.4237619061751926e-06, "in-drivable-lane": 11.249999999999693, "deviation-heading": 14.4050200455332, "agent_compute-ego0": 0.012407968284486237, "agent_compute-ego1": 0.012135063579537092, "agent_compute-ego2": 0.018340214007502294, "agent_compute-ego3": 0.016693143026715613, "complete-iteration": 0.9708251891584816, "set_robot_commands": 0.002254549013784188, "deviation-center-line": 3.4249074728415736, "driven_lanedir_consec": 12.745887708461913, "sim_compute_sim_state": 0.019370585456676623, "sim_compute_performance-ego0": 0.002000270735512765, "sim_compute_performance-ego1": 0.001917235162434828, "sim_compute_performance-ego2": 0.001953154181957642, "sim_compute_performance-ego3": 0.001980821655552949}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.1766455832772191, "get_ui_image": 0.04023257481069192, "step_physics": 0.7952392137020852, "survival_time": 59.99999999999873, "driven_lanedir": 0.9423753708305256, "get_state_dump": 0.009266126562812544, "get_robot_state": 0.014031755437858891, "sim_render-ego0": 0.003824106362538969, "sim_render-ego1": 0.003985705125540321, "sim_render-ego2": 0.004199817714643518, "sim_render-ego3": 0.003984817358774507, "get_duckie_state": 1.4237619061751926e-06, "in-drivable-lane": 55.999999999998735, "deviation-heading": 1.4761691987470416, "agent_compute-ego0": 0.012407968284486237, "agent_compute-ego1": 0.012135063579537092, "agent_compute-ego2": 0.018340214007502294, "agent_compute-ego3": 0.016693143026715613, "complete-iteration": 0.9708251891584816, "set_robot_commands": 0.002254549013784188, "deviation-center-line": 0.34128729523482976, "driven_lanedir_consec": 0.9423753708305256, "sim_compute_sim_state": 0.019370585456676623, "sim_compute_performance-ego0": 0.002000270735512765, "sim_compute_performance-ego1": 0.001917235162434828, "sim_compute_performance-ego2": 0.001953154181957642, "sim_compute_performance-ego3": 0.001980821655552949}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 7.059920197211196, "get_ui_image": 0.04023257481069192, "step_physics": 0.7952392137020852, "survival_time": 59.99999999999873, "driven_lanedir": 4.198062806478481, "get_state_dump": 0.009266126562812544, "get_robot_state": 0.014031755437858891, "sim_render-ego0": 0.003824106362538969, "sim_render-ego1": 0.003985705125540321, "sim_render-ego2": 0.004199817714643518, "sim_render-ego3": 0.003984817358774507, "get_duckie_state": 1.4237619061751926e-06, "in-drivable-lane": 8.8, "deviation-heading": 33.5414002574734, "agent_compute-ego0": 0.012407968284486237, "agent_compute-ego1": 0.012135063579537092, "agent_compute-ego2": 0.018340214007502294, "agent_compute-ego3": 0.016693143026715613, "complete-iteration": 0.9708251891584816, "set_robot_commands": 0.002254549013784188, "deviation-center-line": 6.382123514300493, "driven_lanedir_consec": 4.198062806478481, "sim_compute_sim_state": 0.019370585456676623, "sim_compute_performance-ego0": 0.002000270735512765, "sim_compute_performance-ego1": 0.001917235162434828, "sim_compute_performance-ego2": 0.001953154181957642, "sim_compute_performance-ego3": 0.001980821655552949}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 7.479277584124441, "get_ui_image": 0.05052066148932575, "step_physics": 1.0506754062762167, "survival_time": 27.80000000000026, "driven_lanedir": 4.893355693235883, "get_state_dump": 0.010210108286174451, "get_robot_state": 0.015277964422475927, "sim_render-ego0": 0.004301774437594457, "sim_render-ego1": 0.0043983754820626775, "sim_render-ego2": 0.004510484007145387, "sim_render-ego3": 0.004395188292224275, "get_duckie_state": 1.7729439041986928e-06, "in-drivable-lane": 7.150000000000093, "deviation-heading": 7.646644820255594, "agent_compute-ego0": 0.013603397074892876, "agent_compute-ego1": 0.014284776828019366, "agent_compute-ego2": 0.014643445263217123, "agent_compute-ego3": 0.013037020685000737, "complete-iteration": 1.2420102128862691, "set_robot_commands": 0.0025363062613742355, "deviation-center-line": 1.728499262430977, "driven_lanedir_consec": 4.748872869491496, "sim_compute_sim_state": 0.023037100180689267, "sim_compute_performance-ego0": 0.0022129948306126484, "sim_compute_performance-ego1": 0.0021823218737727222, "sim_compute_performance-ego2": 0.002177487583947995, "sim_compute_performance-ego3": 0.002221697322770124}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.9591093111536857, "get_ui_image": 0.05052066148932575, "step_physics": 1.0506754062762167, "survival_time": 27.80000000000026, "driven_lanedir": 1.219550796852962, "get_state_dump": 0.010210108286174451, "get_robot_state": 0.015277964422475927, "sim_render-ego0": 0.004301774437594457, "sim_render-ego1": 0.0043983754820626775, "sim_render-ego2": 0.004510484007145387, "sim_render-ego3": 0.004395188292224275, "get_duckie_state": 1.7729439041986928e-06, "in-drivable-lane": 1.6499999999999988, "deviation-heading": 4.752192370702666, "agent_compute-ego0": 0.013603397074892876, "agent_compute-ego1": 0.014284776828019366, "agent_compute-ego2": 0.014643445263217123, "agent_compute-ego3": 0.013037020685000737, "complete-iteration": 1.2420102128862691, "set_robot_commands": 0.0025363062613742355, "deviation-center-line": 2.779610999585228, "driven_lanedir_consec": 1.219550796852962, "sim_compute_sim_state": 0.023037100180689267, "sim_compute_performance-ego0": 0.0022129948306126484, "sim_compute_performance-ego1": 0.0021823218737727222, "sim_compute_performance-ego2": 0.002177487583947995, "sim_compute_performance-ego3": 0.002221697322770124}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.6455725053178668, "get_ui_image": 0.05052066148932575, "step_physics": 1.0506754062762167, "survival_time": 27.80000000000026, "driven_lanedir": 0.1045373479882219, "get_state_dump": 0.010210108286174451, "get_robot_state": 0.015277964422475927, "sim_render-ego0": 0.004301774437594457, "sim_render-ego1": 0.0043983754820626775, "sim_render-ego2": 0.004510484007145387, "sim_render-ego3": 0.004395188292224275, "get_duckie_state": 1.7729439041986928e-06, "in-drivable-lane": 26.70000000000026, "deviation-heading": 1.040002795236692, "agent_compute-ego0": 0.013603397074892876, "agent_compute-ego1": 0.014284776828019366, "agent_compute-ego2": 0.014643445263217123, "agent_compute-ego3": 0.013037020685000737, "complete-iteration": 1.2420102128862691, "set_robot_commands": 0.0025363062613742355, "deviation-center-line": 0.08249049450010255, "driven_lanedir_consec": 0.0867289967724445, "sim_compute_sim_state": 0.023037100180689267, "sim_compute_performance-ego0": 0.0022129948306126484, "sim_compute_performance-ego1": 0.0021823218737727222, "sim_compute_performance-ego2": 0.002177487583947995, "sim_compute_performance-ego3": 0.002221697322770124}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.959167556805801, "get_ui_image": 0.05052066148932575, "step_physics": 1.0506754062762167, "survival_time": 27.80000000000026, "driven_lanedir": 1.080346846763416, "get_state_dump": 0.010210108286174451, "get_robot_state": 0.015277964422475927, "sim_render-ego0": 0.004301774437594457, "sim_render-ego1": 0.0043983754820626775, "sim_render-ego2": 0.004510484007145387, "sim_render-ego3": 0.004395188292224275, "get_duckie_state": 1.7729439041986928e-06, "in-drivable-lane": 2.849999999999994, "deviation-heading": 3.777731256617123, "agent_compute-ego0": 0.013603397074892876, "agent_compute-ego1": 0.014284776828019366, "agent_compute-ego2": 0.014643445263217123, "agent_compute-ego3": 0.013037020685000737, "complete-iteration": 1.2420102128862691, "set_robot_commands": 0.0025363062613742355, "deviation-center-line": 1.5385249868974396, "driven_lanedir_consec": 1.080346846763416, "sim_compute_sim_state": 0.023037100180689267, "sim_compute_performance-ego0": 0.0022129948306126484, "sim_compute_performance-ego1": 0.0021823218737727222, "sim_compute_performance-ego2": 0.002177487583947995, "sim_compute_performance-ego3": 0.002221697322770124}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 13.195040146172389, "get_ui_image": 0.04969845246911347, "step_physics": 0.9540307438443046, "survival_time": 59.99999999999873, "driven_lanedir": 10.496381491590778, "get_state_dump": 0.010181461940895607, "get_robot_state": 0.01559989041432453, "sim_render-ego0": 0.004232512227105261, "sim_render-ego1": 0.004323760238317129, "sim_render-ego2": 0.00430899476330048, "sim_render-ego3": 0.0043212801689510045, "get_duckie_state": 1.802333288645367e-06, "in-drivable-lane": 6.749999999999989, "deviation-heading": 18.78078703716115, "agent_compute-ego0": 0.013553423845797751, "agent_compute-ego1": 0.013786391949871994, "agent_compute-ego2": 0.013337620489801793, "agent_compute-ego3": 0.013125289588248502, "complete-iteration": 1.157199922151907, "set_robot_commands": 0.0023798110780866816, "deviation-center-line": 3.6768290598310145, "driven_lanedir_consec": 7.297747930978954, "sim_compute_sim_state": 0.03759184804784567, "sim_compute_performance-ego0": 0.0023440113671117776, "sim_compute_performance-ego1": 0.0022080927268353034, "sim_compute_performance-ego2": 0.0022719960526363936, "sim_compute_performance-ego3": 0.0021847628435425516}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 11.65742065055351, "get_ui_image": 0.04969845246911347, "step_physics": 0.9540307438443046, "survival_time": 59.99999999999873, "driven_lanedir": 9.897554698448513, "get_state_dump": 0.010181461940895607, "get_robot_state": 0.01559989041432453, "sim_render-ego0": 0.004232512227105261, "sim_render-ego1": 0.004323760238317129, "sim_render-ego2": 0.00430899476330048, "sim_render-ego3": 0.0043212801689510045, "get_duckie_state": 1.802333288645367e-06, "in-drivable-lane": 3.550000000000022, "deviation-heading": 20.811153987120395, "agent_compute-ego0": 0.013553423845797751, "agent_compute-ego1": 0.013786391949871994, "agent_compute-ego2": 0.013337620489801793, "agent_compute-ego3": 0.013125289588248502, "complete-iteration": 1.157199922151907, "set_robot_commands": 0.0023798110780866816, "deviation-center-line": 4.355665880160116, "driven_lanedir_consec": 7.576497643348985, "sim_compute_sim_state": 0.03759184804784567, "sim_compute_performance-ego0": 0.0023440113671117776, "sim_compute_performance-ego1": 0.0022080927268353034, "sim_compute_performance-ego2": 0.0022719960526363936, "sim_compute_performance-ego3": 0.0021847628435425516}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 11.657577176537572, "get_ui_image": 0.04969845246911347, "step_physics": 0.9540307438443046, "survival_time": 59.99999999999873, "driven_lanedir": 10.11572208855264, "get_state_dump": 0.010181461940895607, "get_robot_state": 0.01559989041432453, "sim_render-ego0": 0.004232512227105261, "sim_render-ego1": 0.004323760238317129, "sim_render-ego2": 0.00430899476330048, "sim_render-ego3": 0.0043212801689510045, "get_duckie_state": 1.802333288645367e-06, "in-drivable-lane": 2.949999999999843, "deviation-heading": 13.62365709156646, "agent_compute-ego0": 0.013553423845797751, "agent_compute-ego1": 0.013786391949871994, "agent_compute-ego2": 0.013337620489801793, "agent_compute-ego3": 0.013125289588248502, "complete-iteration": 1.157199922151907, "set_robot_commands": 0.0023798110780866816, "deviation-center-line": 5.101032904807404, "driven_lanedir_consec": 10.11572208855264, "sim_compute_sim_state": 0.03759184804784567, "sim_compute_performance-ego0": 0.0023440113671117776, "sim_compute_performance-ego1": 0.0022080927268353034, "sim_compute_performance-ego2": 0.0022719960526363936, "sim_compute_performance-ego3": 0.0021847628435425516}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 16.660463953551083, "get_ui_image": 0.04969845246911347, "step_physics": 0.9540307438443046, "survival_time": 59.99999999999873, "driven_lanedir": 15.338966243641597, "get_state_dump": 0.010181461940895607, "get_robot_state": 0.01559989041432453, "sim_render-ego0": 0.004232512227105261, "sim_render-ego1": 0.004323760238317129, "sim_render-ego2": 0.00430899476330048, "sim_render-ego3": 0.0043212801689510045, "get_duckie_state": 1.802333288645367e-06, "in-drivable-lane": 1.4500000000000206, "deviation-heading": 16.492475029957017, "agent_compute-ego0": 0.013553423845797751, "agent_compute-ego1": 0.013786391949871994, "agent_compute-ego2": 0.013337620489801793, "agent_compute-ego3": 0.013125289588248502, "complete-iteration": 1.157199922151907, "set_robot_commands": 0.0023798110780866816, "deviation-center-line": 4.274562737428306, "driven_lanedir_consec": 15.338966243641597, "sim_compute_sim_state": 0.03759184804784567, "sim_compute_performance-ego0": 0.0023440113671117776, "sim_compute_performance-ego1": 0.0022080927268353034, "sim_compute_performance-ego2": 0.0022719960526363936, "sim_compute_performance-ego3": 0.0021847628435425516}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 0.7292998297775959, "get_ui_image": 0.03447814567669018, "step_physics": 0.4000845180975424, "survival_time": 3.649999999999995, "driven_lanedir": 0.401255794605804, "get_state_dump": 0.007026292182303764, "get_robot_state": 0.008019962826290646, "sim_render-ego0": 0.004381025159681165, "sim_render-ego1": 0.0044133663177490234, "get_duckie_state": 1.9105705055030618e-06, "in-drivable-lane": 1.5999999999999956, "deviation-heading": 0.8810969047076987, "agent_compute-ego0": 0.014387388487119932, "agent_compute-ego1": 0.014047700005608637, "complete-iteration": 0.5074327443097089, "set_robot_commands": 0.002711379850232923, "deviation-center-line": 0.17070156850554713, "driven_lanedir_consec": 0.1955285616296547, "sim_compute_sim_state": 0.010620281503007218, "sim_compute_performance-ego0": 0.00225503058046908, "sim_compute_performance-ego1": 0.0023378391523618956}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 0.7293144722592511, "get_ui_image": 0.03447814567669018, "step_physics": 0.4000845180975424, "survival_time": 3.649999999999995, "driven_lanedir": 0.5135183672823647, "get_state_dump": 0.007026292182303764, "get_robot_state": 0.008019962826290646, "sim_render-ego0": 0.004381025159681165, "sim_render-ego1": 0.0044133663177490234, "get_duckie_state": 1.9105705055030618e-06, "in-drivable-lane": 0.30000000000000027, "deviation-heading": 1.4953368245669745, "agent_compute-ego0": 0.014387388487119932, "agent_compute-ego1": 0.014047700005608637, "complete-iteration": 0.5074327443097089, "set_robot_commands": 0.002711379850232923, "deviation-center-line": 0.24684343405971995, "driven_lanedir_consec": 0.28381144174244644, "sim_compute_sim_state": 0.010620281503007218, "sim_compute_performance-ego0": 0.00225503058046908, "sim_compute_performance-ego1": 0.0023378391523618956}}
set_robot_commands_max0.002711379850232923
set_robot_commands_mean0.00243610179381759
set_robot_commands_median0.0023798110780866816
set_robot_commands_min0.002254549013784188
sim_compute_performance-ego0_max0.0023440113671117776
sim_compute_performance-ego0_mean0.002195654920991923
sim_compute_performance-ego0_median0.0022129948306126484
sim_compute_performance-ego0_min0.002000270735512765
sim_compute_performance-ego1_max0.0023378391523618956
sim_compute_performance-ego1_mean0.0021361626683496578
sim_compute_performance-ego1_median0.0021823218737727222
sim_compute_performance-ego1_min0.001917235162434828
sim_compute_sim_state_max0.03759184804784567
sim_compute_sim_state_mean0.024374192696204333
sim_compute_sim_state_median0.023037100180689267
sim_compute_sim_state_min0.010620281503007218
sim_render-ego0_max0.004381025159681165
sim_render-ego0_mean0.004156830173451221
sim_render-ego0_median0.004232512227105261
sim_render-ego0_min0.003824106362538969
sim_render-ego1_max0.0044133663177490234
sim_render-ego1_mean0.004261292572798468
sim_render-ego1_median0.004323760238317129
sim_render-ego1_min0.003985705125540321
simulation-passed1
step_physics_max1.0506754062762167
step_physics_mean0.857139320820394
step_physics_median0.9540307438443046
step_physics_min0.4000845180975424
survival_time_max59.99999999999873
survival_time_mean42.74999999999935
survival_time_min3.649999999999995
No reset possible
5900212771Anastasiya NikolskayaΒ πŸ‡·πŸ‡ΊJetBrains Researchaido5-LFVI_multi-sim-validationLFVIv-simsuccessyesnogpu-prod-070:25:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.37426325650891
survival_time_median14.025000000000064
deviation-center-line_median0.8592875017104415
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.07245763259775498
agent_compute-ego0_mean0.07046542329449856
agent_compute-ego0_median0.07046542329449856
agent_compute-ego0_min0.06847321399124214
agent_compute-ego1_max0.05089265776322027
agent_compute-ego1_mean0.04753485095120458
agent_compute-ego1_median0.04753485095120458
agent_compute-ego1_min0.04417704413918888
agent_compute-ego2_max0.05520859427516236
agent_compute-ego2_mean0.05376344198791938
agent_compute-ego2_median0.05376344198791938
agent_compute-ego2_min0.05231828970067641
agent_compute-ego3_max0.05322014269807414
agent_compute-ego3_mean0.050829532046772125
agent_compute-ego3_median0.050829532046772125
agent_compute-ego3_min0.04843892139547011
complete-iteration_max1.7344178957097671
complete-iteration_mean1.70066785258311
complete-iteration_median1.70066785258311
complete-iteration_min1.6669178094564532
deviation-center-line_max1.8897093965926235
deviation-center-line_mean0.947999853789872
deviation-center-line_min0.5156198978120006
deviation-heading_max5.3373499459132985
deviation-heading_mean3.485271097567628
deviation-heading_median3.3199815891104754
deviation-heading_min2.2141833965834214
driven_any_max6.852306051733557
driven_any_mean2.8474597680564373
driven_any_median2.911124247946466
driven_any_min0.07852088040883592
driven_lanedir_consec_max6.089293695663062
driven_lanedir_consec_mean2.371882593741857
driven_lanedir_consec_min0.07683731957692785
driven_lanedir_max6.4390916402177085
driven_lanedir_mean2.616871830644529
driven_lanedir_median2.6795414815333105
driven_lanedir_min0.07683731957692785
get_duckie_state_max1.9641483531278723e-06
get_duckie_state_mean1.926126218477298e-06
get_duckie_state_median1.926126218477298e-06
get_duckie_state_min1.8881040838267237e-06
get_robot_state_max0.01587843681130174
get_robot_state_mean0.01568658560538034
get_robot_state_median0.01568658560538034
get_robot_state_min0.01549473439945894
get_state_dump_max0.01025293784983018
get_state_dump_mean0.010205390863071422
get_state_dump_median0.010205390863071422
get_state_dump_min0.010157843876312666
get_ui_image_max0.05764316977941402
get_ui_image_mean0.057426138266634105
get_ui_image_median0.057426138266634105
get_ui_image_min0.05720910675385419
in-drivable-lane_max2.9500000000000144
in-drivable-lane_mean0.4937500000000026
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 4.01756092963324, "get_ui_image": 0.05764316977941402, "step_physics": 1.280844850925052, "survival_time": 11.100000000000025, "driven_lanedir": 3.882510373278359, "get_state_dump": 0.010157843876312666, "get_robot_state": 0.01587843681130174, "sim_render-ego0": 0.004227534537892705, "sim_render-ego1": 0.0040441799591475, "sim_render-ego2": 0.00416171818036135, "sim_render-ego3": 0.003976541784312159, "get_duckie_state": 1.8881040838267237e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.350893197938481, "agent_compute-ego0": 0.06847321399124214, "agent_compute-ego1": 0.05089265776322027, "agent_compute-ego2": 0.05520859427516236, "agent_compute-ego3": 0.05322014269807414, "complete-iteration": 1.6669178094564532, "set_robot_commands": 0.0023993793624398955, "deviation-center-line": 0.5612397687338413, "driven_lanedir_consec": 3.2439126986847335, "sim_compute_sim_state": 0.03880173956866756, "sim_compute_performance-ego0": 0.00232973120137715, "sim_compute_performance-ego1": 0.002197605612032082, "sim_compute_performance-ego2": 0.0023586664499188753, "sim_compute_performance-ego3": 0.002204921748071508}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 2.923072857769204, "get_ui_image": 0.05764316977941402, "step_physics": 1.280844850925052, "survival_time": 11.100000000000025, "driven_lanedir": 2.7832916635144405, "get_state_dump": 0.010157843876312666, "get_robot_state": 0.01587843681130174, "sim_render-ego0": 0.004227534537892705, "sim_render-ego1": 0.0040441799591475, "sim_render-ego2": 0.00416171818036135, "sim_render-ego3": 0.003976541784312159, "get_duckie_state": 1.8881040838267237e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.936535384847721, "agent_compute-ego0": 0.06847321399124214, "agent_compute-ego1": 0.05089265776322027, "agent_compute-ego2": 0.05520859427516236, "agent_compute-ego3": 0.05322014269807414, "complete-iteration": 1.6669178094564532, "set_robot_commands": 0.0023993793624398955, "deviation-center-line": 1.0538458025245925, "driven_lanedir_consec": 2.3779213556222545, "sim_compute_sim_state": 0.03880173956866756, "sim_compute_performance-ego0": 0.00232973120137715, "sim_compute_performance-ego1": 0.002197605612032082, "sim_compute_performance-ego2": 0.0023586664499188753, "sim_compute_performance-ego3": 0.002204921748071508}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 2.8991756381237277, "get_ui_image": 0.05764316977941402, "step_physics": 1.280844850925052, "survival_time": 11.100000000000025, "driven_lanedir": 2.8014859612358047, "get_state_dump": 0.010157843876312666, "get_robot_state": 0.01587843681130174, "sim_render-ego0": 0.004227534537892705, "sim_render-ego1": 0.0040441799591475, "sim_render-ego2": 0.00416171818036135, "sim_render-ego3": 0.003976541784312159, "get_duckie_state": 1.8881040838267237e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.889032439267994, "agent_compute-ego0": 0.06847321399124214, "agent_compute-ego1": 0.05089265776322027, "agent_compute-ego2": 0.05520859427516236, "agent_compute-ego3": 0.05322014269807414, "complete-iteration": 1.6669178094564532, "set_robot_commands": 0.0023993793624398955, "deviation-center-line": 0.8323618528615205, "driven_lanedir_consec": 2.477837971920734, "sim_compute_sim_state": 0.03880173956866756, "sim_compute_performance-ego0": 0.00232973120137715, "sim_compute_performance-ego1": 0.002197605612032082, "sim_compute_performance-ego2": 0.0023586664499188753, "sim_compute_performance-ego3": 0.002204921748071508}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 3.389804425218106, "get_ui_image": 0.05764316977941402, "step_physics": 1.280844850925052, "survival_time": 11.100000000000025, "driven_lanedir": 2.575791299552181, "get_state_dump": 0.010157843876312666, "get_robot_state": 0.01587843681130174, "sim_render-ego0": 0.004227534537892705, "sim_render-ego1": 0.0040441799591475, "sim_render-ego2": 0.00416171818036135, "sim_render-ego3": 0.003976541784312159, "get_duckie_state": 1.8881040838267237e-06, "in-drivable-lane": 2.9500000000000144, "deviation-heading": 2.966802639828065, "agent_compute-ego0": 0.06847321399124214, "agent_compute-ego1": 0.05089265776322027, "agent_compute-ego2": 0.05520859427516236, "agent_compute-ego3": 0.05322014269807414, "complete-iteration": 1.6669178094564532, "set_robot_commands": 0.0023993793624398955, "deviation-center-line": 0.5156198978120006, "driven_lanedir_consec": 2.370605157395566, "sim_compute_sim_state": 0.03880173956866756, "sim_compute_performance-ego0": 0.00232973120137715, "sim_compute_performance-ego1": 0.002197605612032082, "sim_compute_performance-ego2": 0.0023586664499188753, "sim_compute_performance-ego3": 0.002204921748071508}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 0.07852088040883592, "get_ui_image": 0.05720910675385419, "step_physics": 1.3771786240970387, "survival_time": 16.950000000000106, "driven_lanedir": 0.07683731957692785, "get_state_dump": 0.01025293784983018, "get_robot_state": 0.01549473439945894, "sim_render-ego0": 0.004231377910165226, "sim_render-ego1": 0.004080130773432115, "sim_render-ego2": 0.00420908998040592, "sim_render-ego3": 0.003910269456751206, "get_duckie_state": 1.9641483531278723e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.3373499459132985, "agent_compute-ego0": 0.07245763259775498, "agent_compute-ego1": 0.04417704413918888, "agent_compute-ego2": 0.05231828970067641, "agent_compute-ego3": 0.04843892139547011, "complete-iteration": 1.7344178957097671, "set_robot_commands": 0.002564865701338824, "deviation-center-line": 0.8131645581161442, "driven_lanedir_consec": 0.07683731957692785, "sim_compute_sim_state": 0.020742478791405172, "sim_compute_performance-ego0": 0.0022383738966549145, "sim_compute_performance-ego1": 0.002161571558784036, "sim_compute_performance-ego2": 0.0022596247055951288, "sim_compute_performance-ego3": 0.0021367690142463235}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 6.852306051733557, "get_ui_image": 0.05720910675385419, "step_physics": 1.3771786240970387, "survival_time": 16.950000000000106, "driven_lanedir": 6.4390916402177085, "get_state_dump": 0.01025293784983018, "get_robot_state": 0.01549473439945894, "sim_render-ego0": 0.004231377910165226, "sim_render-ego1": 0.004080130773432115, "sim_render-ego2": 0.00420908998040592, "sim_render-ego3": 0.003910269456751206, "get_duckie_state": 1.9641483531278723e-06, "in-drivable-lane": 0.5500000000000078, "deviation-heading": 3.673160538392886, "agent_compute-ego0": 0.07245763259775498, "agent_compute-ego1": 0.04417704413918888, "agent_compute-ego2": 0.05231828970067641, "agent_compute-ego3": 0.04843892139547011, "complete-iteration": 1.7344178957097671, "set_robot_commands": 0.002564865701338824, "deviation-center-line": 0.8862131505593625, "driven_lanedir_consec": 6.089293695663062, "sim_compute_sim_state": 0.020742478791405172, "sim_compute_performance-ego0": 0.0022383738966549145, "sim_compute_performance-ego1": 0.002161571558784036, "sim_compute_performance-ego2": 0.0022596247055951288, "sim_compute_performance-ego3": 0.0021367690142463235}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.8876668821898546, "get_ui_image": 0.05720910675385419, "step_physics": 1.3771786240970387, "survival_time": 16.950000000000106, "driven_lanedir": 0.8502943029830949, "get_state_dump": 0.01025293784983018, "get_robot_state": 0.01549473439945894, "sim_render-ego0": 0.004231377910165226, "sim_render-ego1": 0.004080130773432115, "sim_render-ego2": 0.00420908998040592, "sim_render-ego3": 0.003910269456751206, "get_duckie_state": 1.9641483531278723e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.2141833965834214, "agent_compute-ego0": 0.07245763259775498, "agent_compute-ego1": 0.04417704413918888, "agent_compute-ego2": 0.05231828970067641, "agent_compute-ego3": 0.04843892139547011, "complete-iteration": 1.7344178957097671, "set_robot_commands": 0.002564865701338824, "deviation-center-line": 1.8897093965926235, "driven_lanedir_consec": 0.8315615534354952, "sim_compute_sim_state": 0.020742478791405172, "sim_compute_performance-ego0": 0.0022383738966549145, "sim_compute_performance-ego1": 0.002161571558784036, "sim_compute_performance-ego2": 0.0022596247055951288, "sim_compute_performance-ego3": 0.0021367690142463235}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.7315704793749742, "get_ui_image": 0.05720910675385419, "step_physics": 1.3771786240970387, "survival_time": 16.950000000000106, "driven_lanedir": 1.525672084797716, "get_state_dump": 0.01025293784983018, "get_robot_state": 0.01549473439945894, "sim_render-ego0": 0.004231377910165226, "sim_render-ego1": 0.004080130773432115, "sim_render-ego2": 0.00420908998040592, "sim_render-ego3": 0.003910269456751206, "get_duckie_state": 1.9641483531278723e-06, "in-drivable-lane": 0.4499999999999984, "deviation-heading": 4.514211237769154, "agent_compute-ego0": 0.07245763259775498, "agent_compute-ego1": 0.04417704413918888, "agent_compute-ego2": 0.05231828970067641, "agent_compute-ego3": 0.04843892139547011, "complete-iteration": 1.7344178957097671, "set_robot_commands": 0.002564865701338824, "deviation-center-line": 1.0318444031188905, "driven_lanedir_consec": 1.5070909976360798, "sim_compute_sim_state": 0.020742478791405172, "sim_compute_performance-ego0": 0.0022383738966549145, "sim_compute_performance-ego1": 0.002161571558784036, "sim_compute_performance-ego2": 0.0022596247055951288, "sim_compute_performance-ego3": 0.0021367690142463235}}
set_robot_commands_max0.002564865701338824
set_robot_commands_mean0.0024821225318893596
set_robot_commands_median0.0024821225318893596
set_robot_commands_min0.0023993793624398955
sim_compute_performance-ego0_max0.00232973120137715
sim_compute_performance-ego0_mean0.002284052549016032
sim_compute_performance-ego0_median0.002284052549016032
sim_compute_performance-ego0_min0.0022383738966549145
sim_compute_performance-ego1_max0.002197605612032082
sim_compute_performance-ego1_mean0.0021795885854080594
sim_compute_performance-ego1_median0.0021795885854080594
sim_compute_performance-ego1_min0.002161571558784036
sim_compute_performance-ego2_max0.0023586664499188753
sim_compute_performance-ego2_mean0.0023091455777570023
sim_compute_performance-ego2_median0.0023091455777570023
sim_compute_performance-ego2_min0.0022596247055951288
sim_compute_performance-ego3_max0.002204921748071508
sim_compute_performance-ego3_mean0.002170845381158915
sim_compute_performance-ego3_median0.002170845381158915
sim_compute_performance-ego3_min0.0021367690142463235
sim_compute_sim_state_max0.03880173956866756
sim_compute_sim_state_mean0.02977210918003637
sim_compute_sim_state_median0.02977210918003637
sim_compute_sim_state_min0.020742478791405172
sim_render-ego0_max0.004231377910165226
sim_render-ego0_mean0.004229456224028965
sim_render-ego0_median0.004229456224028965
sim_render-ego0_min0.004227534537892705
sim_render-ego1_max0.004080130773432115
sim_render-ego1_mean0.004062155366289807
sim_render-ego1_median0.004062155366289807
sim_render-ego1_min0.0040441799591475
sim_render-ego2_max0.00420908998040592
sim_render-ego2_mean0.004185404080383635
sim_render-ego2_median0.004185404080383635
sim_render-ego2_min0.00416171818036135
sim_render-ego3_max0.003976541784312159
sim_render-ego3_mean0.003943405620531682
sim_render-ego3_median0.003943405620531682
sim_render-ego3_min0.003910269456751206
simulation-passed1
step_physics_max1.3771786240970387
step_physics_mean1.3290117375110455
step_physics_median1.3290117375110455
step_physics_min1.280844850925052
survival_time_max16.950000000000106
survival_time_mean14.025000000000064
survival_time_min11.100000000000025
No reset possible
5898012816Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LFVI-sim-testingLFVIt-simsuccessyesnogpu-prod-070:18:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.244797847221183
survival_time_median15.82500000000009
deviation-center-line_median0.916026237734522
in-drivable-lane_median0.274999999999999


other stats
agent_compute-ego0_max0.013712803522745768
agent_compute-ego0_mean0.013366754645100648
agent_compute-ego0_median0.013366754645100648
agent_compute-ego0_min0.01302070576745553
agent_compute-npc0_max0.051221739593429946
agent_compute-npc0_mean0.04886061107264968
agent_compute-npc0_median0.04886061107264968
agent_compute-npc0_min0.046499482551869406
agent_compute-npc1_max0.0449728835281448
agent_compute-npc1_mean0.041282221610329295
agent_compute-npc1_median0.041282221610329295
agent_compute-npc1_min0.037591559692513786
agent_compute-npc2_max0.044926343272574505
agent_compute-npc2_mean0.039071854461105615
agent_compute-npc2_median0.039071854461105615
agent_compute-npc2_min0.033217365649636725
complete-iteration_max1.308302015807498
complete-iteration_mean1.2198824120690903
complete-iteration_median1.2198824120690903
complete-iteration_min1.1314628083306832
deviation-center-line_max1.1057711044441143
deviation-center-line_mean0.916026237734522
deviation-center-line_min0.7262813710249294
deviation-heading_max5.725693303638807
deviation-heading_mean5.035242124334255
deviation-heading_median5.035242124334255
deviation-heading_min4.344790945029702
driven_any_max3.625700170231009
driven_any_mean2.8127184972025843
driven_any_median2.8127184972025843
driven_any_min1.999736824174159
driven_lanedir_consec_max3.113330296396851
driven_lanedir_consec_mean2.244797847221183
driven_lanedir_consec_min1.3762653980455146
driven_lanedir_max3.410624612560299
driven_lanedir_mean2.5761271981271454
driven_lanedir_median2.5761271981271454
driven_lanedir_min1.7416297836939918
get_duckie_state_max1.7899185863893424e-06
get_duckie_state_mean1.68695920832175e-06
get_duckie_state_median1.68695920832175e-06
get_duckie_state_min1.5839998302541578e-06
get_robot_state_max0.015627874070732156
get_robot_state_mean0.015176092990602947
get_robot_state_median0.015176092990602947
get_robot_state_min0.014724311910473738
get_state_dump_max0.010274664679569985
get_state_dump_mean0.010117651899103306
get_state_dump_median0.010117651899103306
get_state_dump_min0.009960639118636629
get_ui_image_max0.05601796344738102
get_ui_image_mean0.05472579932575805
get_ui_image_median0.05472579932575805
get_ui_image_min0.05343363520413509
in-drivable-lane_max0.549999999999998
in-drivable-lane_mean0.274999999999999
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 1.999736824174159, "get_ui_image": 0.05343363520413509, "step_physics": 0.8485166412566353, "survival_time": 11.60000000000003, "driven_lanedir": 1.7416297836939918, "get_state_dump": 0.009960639118636629, "get_robot_state": 0.014724311910473738, "sim_render-ego0": 0.004098349886390784, "sim_render-npc0": 0.0041741843898920545, "sim_render-npc1": 0.004069944308039457, "sim_render-npc2": 0.0040146762209388835, "get_duckie_state": 1.5839998302541578e-06, "in-drivable-lane": 0.549999999999998, "deviation-heading": 4.344790945029702, "agent_compute-ego0": 0.01302070576745553, "agent_compute-npc0": 0.046499482551869406, "agent_compute-npc1": 0.037591559692513786, "agent_compute-npc2": 0.033217365649636725, "complete-iteration": 1.1314628083306832, "set_robot_commands": 0.002390022441552944, "deviation-center-line": 0.7262813710249294, "driven_lanedir_consec": 1.3762653980455146, "sim_compute_sim_state": 0.039908000839626326, "sim_compute_performance-ego0": 0.002208267670332618, "sim_compute_performance-npc0": 0.0020517095475749395, "sim_compute_performance-npc1": 0.002098008798427336, "sim_compute_performance-npc2": 0.002101644425944709}, "LFVI-norm-udem1-000-ego0": {"driven_any": 3.625700170231009, "get_ui_image": 0.05601796344738102, "step_physics": 0.9876649842333438, "survival_time": 20.05000000000015, "driven_lanedir": 3.410624612560299, "get_state_dump": 0.010274664679569985, "get_robot_state": 0.015627874070732156, "sim_render-ego0": 0.004285273267262017, "sim_render-npc0": 0.004443872034253173, "sim_render-npc1": 0.004346401537235697, "sim_render-npc2": 0.004350191918178577, "get_duckie_state": 1.7899185863893424e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.725693303638807, "agent_compute-ego0": 0.013712803522745768, "agent_compute-npc0": 0.051221739593429946, "agent_compute-npc1": 0.0449728835281448, "agent_compute-npc2": 0.044926343272574505, "complete-iteration": 1.308302015807498, "set_robot_commands": 0.0025773321218158477, "deviation-center-line": 1.1057711044441143, "driven_lanedir_consec": 3.113330296396851, "sim_compute_sim_state": 0.046825581522130254, "sim_compute_performance-ego0": 0.0023426879104690174, "sim_compute_performance-npc0": 0.002232910388737769, "sim_compute_performance-npc1": 0.0022693771628004996, "sim_compute_performance-npc2": 0.0022775373648648237}}
set_robot_commands_max0.0025773321218158477
set_robot_commands_mean0.0024836772816843955
set_robot_commands_median0.0024836772816843955
set_robot_commands_min0.002390022441552944
sim_compute_performance-ego0_max0.0023426879104690174
sim_compute_performance-ego0_mean0.0022754777904008174
sim_compute_performance-ego0_median0.0022754777904008174
sim_compute_performance-ego0_min0.002208267670332618
sim_compute_performance-npc0_max0.002232910388737769
sim_compute_performance-npc0_mean0.002142309968156354
sim_compute_performance-npc0_median0.002142309968156354
sim_compute_performance-npc0_min0.0020517095475749395
sim_compute_performance-npc1_max0.0022693771628004996
sim_compute_performance-npc1_mean0.002183692980613918
sim_compute_performance-npc1_median0.002183692980613918
sim_compute_performance-npc1_min0.002098008798427336
sim_compute_performance-npc2_max0.0022775373648648237
sim_compute_performance-npc2_mean0.0021895908954047663
sim_compute_performance-npc2_median0.0021895908954047663
sim_compute_performance-npc2_min0.002101644425944709
sim_compute_sim_state_max0.046825581522130254
sim_compute_sim_state_mean0.043366791180878286
sim_compute_sim_state_median0.043366791180878286
sim_compute_sim_state_min0.039908000839626326
sim_render-ego0_max0.004285273267262017
sim_render-ego0_mean0.004191811576826401
sim_render-ego0_median0.004191811576826401
sim_render-ego0_min0.004098349886390784
sim_render-npc0_max0.004443872034253173
sim_render-npc0_mean0.004309028212072614
sim_render-npc0_median0.004309028212072614
sim_render-npc0_min0.0041741843898920545
sim_render-npc1_max0.004346401537235697
sim_render-npc1_mean0.004208172922637577
sim_render-npc1_median0.004208172922637577
sim_render-npc1_min0.004069944308039457
sim_render-npc2_max0.004350191918178577
sim_render-npc2_mean0.004182434069558731
sim_render-npc2_median0.004182434069558731
sim_render-npc2_min0.0040146762209388835
simulation-passed1
step_physics_max0.9876649842333438
step_physics_mean0.9180908127449896
step_physics_median0.9180908127449896
step_physics_min0.8485166412566353
survival_time_max20.05000000000015
survival_time_mean15.82500000000009
survival_time_min11.60000000000003
No reset possible
5896812812Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LFI-sim-validationLFVIv-simsuccessyesnogpu-prod-070:15:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.879839920755538
survival_time_median38.4749999999995
deviation-center-line_median2.651193687660204
in-drivable-lane_median2.824999999999982


other stats
agent_compute-ego0_max0.013794804278227126
agent_compute-ego0_mean0.013590361324482271
agent_compute-ego0_median0.013590361324482271
agent_compute-ego0_min0.01338591837073742
complete-iteration_max0.28709091281143867
complete-iteration_mean0.28112437503487314
complete-iteration_median0.28112437503487314
complete-iteration_min0.2751578372583076
deviation-center-line_max3.7375019500454822
deviation-center-line_mean2.651193687660204
deviation-center-line_min1.5648854252749256
deviation-heading_max16.77281071775747
deviation-heading_mean11.347528772888602
deviation-heading_median11.347528772888602
deviation-heading_min5.922246828019733
driven_any_max11.429606136243816
driven_any_mean7.237370504580571
driven_any_median7.237370504580571
driven_any_min3.045134872917327
driven_lanedir_consec_max9.753630784981633
driven_lanedir_consec_mean5.879839920755538
driven_lanedir_consec_min2.0060490565294424
driven_lanedir_max10.184761070548872
driven_lanedir_mean6.364658187237648
driven_lanedir_median6.364658187237648
driven_lanedir_min2.5445553039264235
get_duckie_state_max1.5992097381512115e-06
get_duckie_state_mean1.5982453425945705e-06
get_duckie_state_median1.5982453425945705e-06
get_duckie_state_min1.597280947037929e-06
get_robot_state_max0.004077126942767998
get_robot_state_mean0.004025714164137006
get_robot_state_median0.004025714164137006
get_robot_state_min0.003974301385506015
get_state_dump_max0.005270494080578107
get_state_dump_mean0.005227460511604602
get_state_dump_median0.005227460511604602
get_state_dump_min0.005184426942631096
get_ui_image_max0.04129390580666498
get_ui_image_mean0.040855965295939295
get_ui_image_median0.040855965295939295
get_ui_image_min0.04041802478521362
in-drivable-lane_max2.899999999999934
in-drivable-lane_mean2.824999999999982
in-drivable-lane_min2.7500000000000293
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 3.045134872917327, "get_ui_image": 0.04041802478521362, "step_physics": 0.2032996991907025, "survival_time": 19.100000000000136, "driven_lanedir": 2.5445553039264235, "get_state_dump": 0.005184426942631096, "get_robot_state": 0.003974301385506015, "sim_render-ego0": 0.004217058809245535, "get_duckie_state": 1.5992097381512115e-06, "in-drivable-lane": 2.7500000000000293, "deviation-heading": 5.922246828019733, "agent_compute-ego0": 0.01338591837073742, "complete-iteration": 0.28709091281143867, "set_robot_commands": 0.0023721440965139523, "deviation-center-line": 1.5648854252749256, "driven_lanedir_consec": 2.0060490565294424, "sim_compute_sim_state": 0.011916116385796052, "sim_compute_performance-ego0": 0.0022205036551771837}, "LFI-norm-udem1-000-ego0": {"driven_any": 11.429606136243816, "get_ui_image": 0.04129390580666498, "step_physics": 0.18717103671533455, "survival_time": 57.84999999999885, "driven_lanedir": 10.184761070548872, "get_state_dump": 0.005270494080578107, "get_robot_state": 0.004077126942767998, "sim_render-ego0": 0.004268853157913129, "get_duckie_state": 1.597280947037929e-06, "in-drivable-lane": 2.899999999999934, "deviation-heading": 16.77281071775747, "agent_compute-ego0": 0.013794804278227126, "complete-iteration": 0.2751578372583076, "set_robot_commands": 0.0024781344468111817, "deviation-center-line": 3.7375019500454822, "driven_lanedir_consec": 9.753630784981633, "sim_compute_sim_state": 0.014398832807063233, "sim_compute_performance-ego0": 0.00229903885737602}}
set_robot_commands_max0.0024781344468111817
set_robot_commands_mean0.002425139271662567
set_robot_commands_median0.002425139271662567
set_robot_commands_min0.0023721440965139523
sim_compute_performance-ego0_max0.00229903885737602
sim_compute_performance-ego0_mean0.0022597712562766018
sim_compute_performance-ego0_median0.0022597712562766018
sim_compute_performance-ego0_min0.0022205036551771837
sim_compute_sim_state_max0.014398832807063233
sim_compute_sim_state_mean0.013157474596429642
sim_compute_sim_state_median0.013157474596429642
sim_compute_sim_state_min0.011916116385796052
sim_render-ego0_max0.004268853157913129
sim_render-ego0_mean0.004242955983579332
sim_render-ego0_median0.004242955983579332
sim_render-ego0_min0.004217058809245535
simulation-passed1
step_physics_max0.2032996991907025
step_physics_mean0.19523536795301857
step_physics_median0.19523536795301857
step_physics_min0.18717103671533455
survival_time_max57.84999999999885
survival_time_mean38.4749999999995
survival_time_min19.100000000000136
No reset possible
5889012848Raphael Jeanexercise_state_estimationaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesnogpu-prod-071:53:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.793491061002037
survival_time_median59.99999999999873
deviation-center-line_median2.832891030800841
in-drivable-lane_median0.39999999999997726


other stats
agent_compute-ego0_max0.01265458004560002
agent_compute-ego0_mean0.012482446222335446
agent_compute-ego0_median0.012562019441844425
agent_compute-ego0_min0.012101759189551536
agent_compute-ego1_max0.013603949208207795
agent_compute-ego1_mean0.013428983425016937
agent_compute-ego1_median0.013394974153504383
agent_compute-ego1_min0.013230190388268972
complete-iteration_max0.8536739325543228
complete-iteration_mean0.7167808244573194
complete-iteration_median0.7615731038419928
complete-iteration_min0.31115600877537164
deviation-center-line_max3.2219619150488223
deviation-center-line_mean2.6841379364849316
deviation-center-line_min1.470900002173385
deviation-heading_max14.0581177238736
deviation-heading_mean11.292188999663583
deviation-heading_median11.570473009987378
deviation-heading_min6.734227259330157
driven_any_max13.15675454546058
driven_any_mean11.976233511566637
driven_any_median12.317259903620512
driven_any_min9.605020699484449
driven_lanedir_consec_max12.67169577979376
driven_lanedir_consec_mean11.49087961772119
driven_lanedir_consec_min9.189551847815316
driven_lanedir_max12.67169577979376
driven_lanedir_mean11.49087961772119
driven_lanedir_median11.793491061002037
driven_lanedir_min9.189551847815316
get_duckie_state_max1.9883434540226894e-06
get_duckie_state_mean1.8633825459082016e-06
get_duckie_state_median1.8706230398618016e-06
get_duckie_state_min1.6504063044574326e-06
get_robot_state_max0.015876032728438176
get_robot_state_mean0.014423203391496149
get_robot_state_median0.015609581206462268
get_robot_state_min0.007723593174066758
get_state_dump_max0.010372359786402873
get_state_dump_mean0.0096878273271955
get_state_dump_median0.010327658387246875
get_state_dump_min0.006613391184667397
get_ui_image_max0.05320540097829801
get_ui_image_mean0.04661870970133549
get_ui_image_median0.04835869847090417
get_ui_image_min0.0332816907935274
in-drivable-lane_max17.999999999998977
in-drivable-lane_mean2.107142857142744
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 9.605020699484449, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 9.189551847815316, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 17.999999999998977, "deviation-heading": 6.734227259330157, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 1.470900002173385, "driven_lanedir_consec": 9.189551847815316, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 12.729893485875111, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 12.391834096800164, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.0335919919765, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 2.5491723741911403, "driven_lanedir_consec": 12.391834096800164, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 13.15675454546058, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 12.67169577979376, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 1.6499999999999062, "deviation-heading": 9.667137337377063, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 2.1142253492938843, "driven_lanedir_consec": 12.67169577979376, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 10.066989486085204, "get_ui_image": 0.04496053910870834, "step_physics": 0.5551639452862005, "survival_time": 59.99999999999873, "driven_lanedir": 9.79623364235938, "get_state_dump": 0.009900681879200804, "get_robot_state": 0.015133801348302684, "sim_render-ego0": 0.004137507882543051, "sim_render-ego1": 0.004180781747975219, "sim_render-ego2": 0.004254054268829828, "sim_render-ego3": 0.004309099977161366, "get_duckie_state": 1.8376692645654988e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.935090231739808, "agent_compute-ego0": 0.012421082695953852, "agent_compute-ego1": 0.013230190388268972, "agent_compute-ego2": 0.012418467833735762, "agent_compute-ego3": 0.012357788419445587, "complete-iteration": 0.7379078448166161, "set_robot_commands": 0.002418304065383543, "deviation-center-line": 2.791749835640689, "driven_lanedir_consec": 9.79623364235938, "sim_compute_sim_state": 0.027150975774468032, "sim_compute_performance-ego0": 0.0021768301154652006, "sim_compute_performance-ego1": 0.002091392093058133, "sim_compute_performance-ego2": 0.0021085463197503262, "sim_compute_performance-ego3": 0.00212197200543279}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 11.761823474414404, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.404529564159846, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.900609269709186, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 2.901641841880598, "driven_lanedir_consec": 11.404529564159846, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 12.358442570695937, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.883958952039952, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.843112176195133, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 3.045032350778056, "driven_lanedir_consec": 11.883958952039952, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 11.758261731301484, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.053653688726538, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 1.54999999999995, "deviation-heading": 14.0581177238736, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 3.1799253068445967, "driven_lanedir_consec": 11.053653688726538, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 12.124884855342724, "get_ui_image": 0.05320540097829801, "step_physics": 0.6351948385929486, "survival_time": 59.99999999999873, "driven_lanedir": 11.70302316996412, "get_state_dump": 0.010372359786402873, "get_robot_state": 0.015609581206462268, "sim_render-ego0": 0.004245964315511305, "sim_render-ego1": 0.004260746267415602, "sim_render-ego2": 0.0043643799352209136, "sim_render-ego3": 0.004316865752678331, "get_duckie_state": 1.8706230398618016e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.30770068006252, "agent_compute-ego0": 0.012562019441844425, "agent_compute-ego1": 0.013394974153504383, "agent_compute-ego2": 0.012887336133818742, "agent_compute-ego3": 0.012452240689013225, "complete-iteration": 0.8536739325543228, "set_robot_commands": 0.0023841113472461302, "deviation-center-line": 3.0233654414533175, "driven_lanedir_consec": 11.70302316996412, "sim_compute_sim_state": 0.05218466513361363, "sim_compute_performance-ego0": 0.002351885731273845, "sim_compute_performance-ego1": 0.0021622482684133053, "sim_compute_performance-ego2": 0.002175770036187597, "sim_compute_performance-ego3": 0.0021725407647252776}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 12.292330237289017, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 10.92939381711261, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 5.499999999999687, "deviation-heading": 11.240336750265568, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 2.6329031186280676, "driven_lanedir_consec": 10.92939381711261, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 12.555697899878016, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 12.079467342239806, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 0.7999999999999545, "deviation-heading": 11.933219922184197, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 3.2219619150488223, "driven_lanedir_consec": 12.079467342239806, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 12.34218956995201, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 12.059791441374523, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.480699278883648, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 2.7957626803214253, "driven_lanedir_consec": 12.059791441374523, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.579073254667296, "get_ui_image": 0.04835869847090417, "step_physics": 0.5515930958334155, "survival_time": 59.99999999999873, "driven_lanedir": 12.028819150422938, "get_state_dump": 0.010327658387246875, "get_robot_state": 0.015876032728438176, "sim_render-ego0": 0.0042936708607542624, "sim_render-ego1": 0.004372762303666012, "sim_render-ego2": 0.004455478860377074, "sim_render-ego3": 0.0044139892632121544, "get_duckie_state": 1.9883434540226894e-06, "in-drivable-lane": 1.1999999999999886, "deviation-heading": 11.909416689255572, "agent_compute-ego0": 0.01265458004560002, "agent_compute-ego1": 0.01357430284168202, "agent_compute-ego2": 0.012943507630461756, "agent_compute-ego3": 0.01263751396033091, "complete-iteration": 0.7615731038419928, "set_robot_commands": 0.0024433360310220204, "deviation-center-line": 2.8700193812802564, "driven_lanedir_consec": 12.028819150422938, "sim_compute_sim_state": 0.04655727240366304, "sim_compute_performance-ego0": 0.002496616131657863, "sim_compute_performance-ego1": 0.0022743147279102537, "sim_compute_performance-ego2": 0.0023180979872424834, "sim_compute_performance-ego3": 0.002277597003336453}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 13.08244984908215, "get_ui_image": 0.0332816907935274, "step_physics": 0.20965059419024856, "survival_time": 59.79999999999874, "driven_lanedir": 12.64016487002798, "get_state_dump": 0.006613391184667397, "get_robot_state": 0.007723593174066758, "sim_render-ego0": 0.0040952278956235605, "sim_render-ego1": 0.004197808833747679, "get_duckie_state": 1.6504063044574326e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.823345842066242, "agent_compute-ego0": 0.012101759189551536, "agent_compute-ego1": 0.013603949208207795, "complete-iteration": 0.31115600877537164, "set_robot_commands": 0.0024421549679940206, "deviation-center-line": 2.940878034606406, "driven_lanedir_consec": 12.64016487002798, "sim_compute_sim_state": 0.010699498025994552, "sim_compute_performance-ego0": 0.002120696412789991, "sim_compute_performance-ego1": 0.0021022748429275298}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 11.25345750240458, "get_ui_image": 0.0332816907935274, "step_physics": 0.20965059419024856, "survival_time": 59.79999999999874, "driven_lanedir": 11.04019728525973, "get_state_dump": 0.006613391184667397, "get_robot_state": 0.007723593174066758, "sim_render-ego0": 0.0040952278956235605, "sim_render-ego1": 0.004197808833747679, "get_duckie_state": 1.6504063044574326e-06, "in-drivable-lane": 0.7999999999999545, "deviation-heading": 9.224040842370997, "agent_compute-ego0": 0.012101759189551536, "agent_compute-ego1": 0.013603949208207795, "complete-iteration": 0.31115600877537164, "set_robot_commands": 0.0024421549679940206, "deviation-center-line": 2.0403934786483973, "driven_lanedir_consec": 11.04019728525973, "sim_compute_sim_state": 0.010699498025994552, "sim_compute_performance-ego0": 0.002120696412789991, "sim_compute_performance-ego1": 0.0021022748429275298}}
set_robot_commands_max0.0024433360310220204
set_robot_commands_mean0.002419093979328201
set_robot_commands_median0.002418304065383543
set_robot_commands_min0.0023841113472461302
sim_compute_performance-ego0_max0.002496616131657863
sim_compute_performance-ego0_mean0.002310194338511973
sim_compute_performance-ego0_median0.002351885731273845
sim_compute_performance-ego0_min0.002120696412789991
sim_compute_performance-ego1_max0.0022743147279102537
sim_compute_performance-ego1_mean0.0021654550030987016
sim_compute_performance-ego1_median0.0021622482684133053
sim_compute_performance-ego1_min0.002091392093058133
sim_compute_sim_state_max0.05218466513361363
sim_compute_sim_state_mean0.03749790352135485
sim_compute_sim_state_median0.04655727240366304
sim_compute_sim_state_min0.010699498025994552
sim_render-ego0_max0.0042936708607542624
sim_render-ego0_mean0.004207073430462971
sim_render-ego0_median0.004245964315511305
sim_render-ego0_min0.0040952278956235605
sim_render-ego1_max0.004372762303666012
sim_render-ego1_mean0.004260912781694478
sim_render-ego1_median0.004260746267415602
sim_render-ego1_min0.004180781747975219
simulation-passed1
step_physics_max0.6351948385929486
step_physics_mean0.5276506219450541
step_physics_median0.5551639452862005
step_physics_min0.20965059419024856
survival_time_max59.99999999999873
survival_time_mean59.971428571427296
survival_time_min59.79999999999874
No reset possible
5885812843Raphael Jeanexercise_state_estimationaido5-LFV-sim-testingLFVv-simsuccessyesnogpu-prod-070:41:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4549460701429
survival_time_median13.600000000000067
deviation-center-line_median0.6792106551046603
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012950465626960252
agent_compute-ego0_mean0.01248895950074756
agent_compute-ego0_median0.01251617235197177
agent_compute-ego0_min0.011973027672086444
agent_compute-npc0_max0.028293682710967796
agent_compute-npc0_mean0.024317688493637208
agent_compute-npc0_median0.023306048183636824
agent_compute-npc0_min0.02236497489630739
agent_compute-npc1_max0.0338656593117912
agent_compute-npc1_mean0.031233563632173517
agent_compute-npc1_median0.03035596165343793
agent_compute-npc1_min0.029479069931291423
agent_compute-npc2_max0.03648021273369337
agent_compute-npc2_mean0.033310485993477024
agent_compute-npc2_median0.03432366550874565
agent_compute-npc2_min0.029127579737992043
agent_compute-npc3_max0.05068307549413974
agent_compute-npc3_mean0.04729384797343568
agent_compute-npc3_median0.04729384797343568
agent_compute-npc3_min0.04390462045273163
complete-iteration_max1.4626252459783624
complete-iteration_mean1.0421628713186992
complete-iteration_median1.154597839195421
complete-iteration_min0.3968305609055928
deviation-center-line_max2.133958036436802
deviation-center-line_mean0.9118703937436404
deviation-center-line_min0.15510222832843967
deviation-heading_max8.312333671287861
deviation-heading_mean3.716950081592371
deviation-heading_median2.8403192807397155
deviation-heading_min0.8748280936021909
driven_any_max11.828492424318682
driven_any_mean4.479934772810512
driven_any_median2.5422845135611705
driven_any_min1.0066776398010222
driven_lanedir_consec_max11.558593051907078
driven_lanedir_consec_mean4.365517176849893
driven_lanedir_consec_min0.99358351520669
driven_lanedir_max11.558593051907078
driven_lanedir_mean4.365517176849893
driven_lanedir_median2.4549460701429
driven_lanedir_min0.99358351520669
get_duckie_state_max1.9752196151844777e-06
get_duckie_state_mean1.7168113237504423e-06
get_duckie_state_median1.729692733947255e-06
get_duckie_state_min1.4326402119227815e-06
get_robot_state_max0.01960301747287277
get_robot_state_mean0.015217497623318648
get_robot_state_median0.016934936345501358
get_robot_state_min0.007397100329399109
get_state_dump_max0.012310057660959065
get_state_dump_mean0.01011502250764512
get_state_dump_median0.010909031392441955
get_state_dump_min0.006331969584737506
get_ui_image_max0.060677476172899675
get_ui_image_mean0.04859007892855752
get_ui_image_median0.050222456971865434
get_ui_image_min0.033237925597599575
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 11.828492424318682, "get_ui_image": 0.046446462291110734, "step_physics": 0.6771285792372993, "survival_time": 49.299999999999336, "driven_lanedir": 11.558593051907078, "get_state_dump": 0.01011370767092874, "get_robot_state": 0.015557901716763727, "sim_render-ego0": 0.00419814946562082, "sim_render-npc0": 0.004358190895938583, "sim_render-npc1": 0.004224100856916279, "sim_render-npc2": 0.004166491488192944, "get_duckie_state": 1.7070963510747135e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.312333671287861, "agent_compute-ego0": 0.012788725237474374, "agent_compute-npc0": 0.02241821129633663, "agent_compute-npc1": 0.0338656593117912, "agent_compute-npc2": 0.03432366550874565, "complete-iteration": 0.925399368898726, "set_robot_commands": 0.0024501528541850948, "deviation-center-line": 2.133958036436802, "driven_lanedir_consec": 11.558593051907078, "sim_compute_sim_state": 0.03693454219698302, "sim_compute_performance-ego0": 0.002333190303443051, "sim_compute_performance-npc0": 0.0021382808202185044, "sim_compute_performance-npc1": 0.002209193076043868, "sim_compute_performance-npc2": 0.0021657332581710427}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.071014710236497, "get_ui_image": 0.060677476172899675, "step_physics": 1.0969702919034192, "survival_time": 6.799999999999984, "driven_lanedir": 0.99358351520669, "get_state_dump": 0.012310057660959065, "get_robot_state": 0.01960301747287277, "sim_render-ego0": 0.004403984459647297, "sim_render-npc0": 0.004423155401744982, "sim_render-npc1": 0.004364363468476456, "sim_render-npc2": 0.004326461875525704, "sim_render-npc3": 0.004121984008454928, "get_duckie_state": 1.9752196151844777e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.095380064104783, "agent_compute-ego0": 0.012950465626960252, "agent_compute-npc0": 0.028293682710967796, "agent_compute-npc1": 0.03035596165343793, "agent_compute-npc2": 0.03648021273369337, "agent_compute-npc3": 0.05068307549413974, "complete-iteration": 1.4626252459783624, "set_robot_commands": 0.002789398179437122, "deviation-center-line": 0.457152634137058, "driven_lanedir_consec": 0.99358351520669, "sim_compute_sim_state": 0.06815142005029386, "sim_compute_performance-ego0": 0.002360310867755082, "sim_compute_performance-npc0": 0.0022348905131764655, "sim_compute_performance-npc1": 0.002232114764025612, "sim_compute_performance-npc2": 0.0022569677255449504, "sim_compute_performance-npc3": 0.0021671900784012176}, "LFV-norm-techtrack-000-ego0": {"driven_any": 4.013554316885844, "get_ui_image": 0.05399845165262013, "step_physics": 1.065828330359424, "survival_time": 20.400000000000155, "driven_lanedir": 3.9153266141782455, "get_state_dump": 0.011704355113955171, "get_robot_state": 0.018311970974238985, "sim_render-ego0": 0.004119702831165715, "sim_render-npc0": 0.004157632370741268, "sim_render-npc1": 0.0040412252281580695, "sim_render-npc2": 0.004005781304282489, "sim_render-npc3": 0.004007830887960047, "get_duckie_state": 1.7522891168197969e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.585258497374648, "agent_compute-ego0": 0.012243619466469166, "agent_compute-npc0": 0.02236497489630739, "agent_compute-npc1": 0.029479069931291423, "agent_compute-npc2": 0.029127579737992043, "agent_compute-npc3": 0.04390462045273163, "complete-iteration": 1.383796309492116, "set_robot_commands": 0.002294025094701492, "deviation-center-line": 0.9012686760722626, "driven_lanedir_consec": 3.9153266141782455, "sim_compute_sim_state": 0.054287473263542343, "sim_compute_performance-ego0": 0.002196162720472714, "sim_compute_performance-npc0": 0.002044225380298269, "sim_compute_performance-npc1": 0.002033372380039803, "sim_compute_performance-npc2": 0.002040569823062216, "sim_compute_performance-npc3": 0.002040146615511048}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.0066776398010222, "get_ui_image": 0.033237925597599575, "step_physics": 0.2865377366542816, "survival_time": 5.549999999999988, "driven_lanedir": 0.9945655261075548, "get_state_dump": 0.006331969584737506, "get_robot_state": 0.007397100329399109, "sim_render-ego0": 0.003857372062546866, "sim_render-npc0": 0.004132317645209176, "get_duckie_state": 1.4326402119227815e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.8748280936021909, "agent_compute-ego0": 0.011973027672086444, "agent_compute-npc0": 0.024193885070937025, "complete-iteration": 0.3968305609055928, "set_robot_commands": 0.002376518079212734, "deviation-center-line": 0.15510222832843967, "driven_lanedir_consec": 0.9945655261075548, "sim_compute_sim_state": 0.010358382548604692, "sim_compute_performance-ego0": 0.0020252402339662823, "sim_compute_performance-npc0": 0.002008042165211269}}
set_robot_commands_max0.002789398179437122
set_robot_commands_mean0.0024775235518841106
set_robot_commands_median0.0024133354666989143
set_robot_commands_min0.002294025094701492
sim_compute_performance-ego0_max0.002360310867755082
sim_compute_performance-ego0_mean0.002228726031409282
sim_compute_performance-ego0_median0.002264676511957882
sim_compute_performance-ego0_min0.0020252402339662823
sim_compute_performance-npc0_max0.0022348905131764655
sim_compute_performance-npc0_mean0.002106359719726127
sim_compute_performance-npc0_median0.002091253100258387
sim_compute_performance-npc0_min0.002008042165211269
sim_compute_performance-npc1_max0.002232114764025612
sim_compute_performance-npc1_mean0.0021582267400364276
sim_compute_performance-npc1_median0.002209193076043868
sim_compute_performance-npc1_min0.002033372380039803
sim_compute_performance-npc2_max0.0022569677255449504
sim_compute_performance-npc2_mean0.002154423602259403
sim_compute_performance-npc2_median0.0021657332581710427
sim_compute_performance-npc2_min0.002040569823062216
sim_compute_performance-npc3_max0.0021671900784012176
sim_compute_performance-npc3_mean0.0021036683469561326
sim_compute_performance-npc3_median0.0021036683469561326
sim_compute_performance-npc3_min0.002040146615511048
sim_compute_sim_state_max0.06815142005029386
sim_compute_sim_state_mean0.04243295451485598
sim_compute_sim_state_median0.04561100773026268
sim_compute_sim_state_min0.010358382548604692
sim_render-ego0_max0.004403984459647297
sim_render-ego0_mean0.004144802204745175
sim_render-ego0_median0.004158926148393267
sim_render-ego0_min0.003857372062546866
sim_render-npc0_max0.004423155401744982
sim_render-npc0_mean0.004267824078408503
sim_render-npc0_median0.004257911633339925
sim_render-npc0_min0.004132317645209176
sim_render-npc1_max0.004364363468476456
sim_render-npc1_mean0.004209896517850268
sim_render-npc1_median0.004224100856916279
sim_render-npc1_min0.0040412252281580695
sim_render-npc2_max0.004326461875525704
sim_render-npc2_mean0.004166244889333713
sim_render-npc2_median0.004166491488192944
sim_render-npc2_min0.004005781304282489
sim_render-npc3_max0.004121984008454928
sim_render-npc3_mean0.004064907448207488
sim_render-npc3_median0.004064907448207488
sim_render-npc3_min0.004007830887960047
simulation-passed1
step_physics_max1.0969702919034192
step_physics_mean0.781616234538606
step_physics_median0.8714784547983616
step_physics_min0.2865377366542816
survival_time_max49.299999999999336
survival_time_mean20.512499999999868
survival_time_min5.549999999999988
No reset possible
5883112874Raphael Jeansim-exercise-2aido5-LFVI-sim-validationLFVIv-simsuccessyesnogpu-prod-070:39:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.355654379514442
survival_time_median37.24999999999946
deviation-center-line_median1.5988195518496573
in-drivable-lane_median2.3749999999999583


other stats
agent_compute-ego0_max0.012994239204808286
agent_compute-ego0_mean0.012889533484944413
agent_compute-ego0_median0.012889533484944413
agent_compute-ego0_min0.01278482776508054
agent_compute-npc0_max0.04430883291748673
agent_compute-npc0_mean0.04410334009525955
agent_compute-npc0_median0.04410334009525955
agent_compute-npc0_min0.04389784727303237
agent_compute-npc1_max0.0449859600377144
agent_compute-npc1_mean0.04446018770309361
agent_compute-npc1_median0.04446018770309361
agent_compute-npc1_min0.043934415368472826
agent_compute-npc2_max0.04415232447908922
agent_compute-npc2_mean0.04022835784229229
agent_compute-npc2_median0.04022835784229229
agent_compute-npc2_min0.036304391205495355
complete-iteration_max1.2293093359507274
complete-iteration_mean1.1520922521532344
complete-iteration_median1.1520922521532344
complete-iteration_min1.0748751683557412
deviation-center-line_max2.4736770036450277
deviation-center-line_mean1.5988195518496573
deviation-center-line_min0.723962100054287
deviation-heading_max9.283157806622578
deviation-heading_mean5.839468735176641
deviation-heading_median5.839468735176641
deviation-heading_min2.395779663730703
driven_any_max17.95988966815339
driven_any_mean10.766802727164508
driven_any_median10.766802727164508
driven_any_min3.5737157861756232
driven_lanedir_consec_max15.952273258657945
driven_lanedir_consec_mean9.355654379514442
driven_lanedir_consec_min2.7590355003709415
driven_lanedir_max17.314204333713832
driven_lanedir_mean10.036619917042389
driven_lanedir_median10.036619917042389
driven_lanedir_min2.7590355003709415
get_duckie_state_max1.5626381794365567e-06
get_duckie_state_mean1.4911701286943162e-06
get_duckie_state_median1.4911701286943162e-06
get_duckie_state_min1.4197020779520758e-06
get_robot_state_max0.015100859267054696
get_robot_state_mean0.014969264868026612
get_robot_state_median0.014969264868026612
get_robot_state_min0.014837670468998526
get_state_dump_max0.00987398292258059
get_state_dump_mean0.00975291684243109
get_state_dump_median0.00975291684243109
get_state_dump_min0.00963185076228159
get_ui_image_max0.05458256408526063
get_ui_image_mean0.05383726920039486
get_ui_image_median0.05383726920039486
get_ui_image_min0.053091974315529096
in-drivable-lane_max3.4999999999999876
in-drivable-lane_mean2.3749999999999583
in-drivable-lane_min1.249999999999929
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 17.95988966815339, "get_ui_image": 0.053091974315529096, "step_physics": 0.7745589298300503, "survival_time": 58.39999999999882, "driven_lanedir": 17.314204333713832, "get_state_dump": 0.00963185076228159, "get_robot_state": 0.014837670468998526, "sim_render-ego0": 0.004039574526027291, "sim_render-npc0": 0.004154659928777873, "sim_render-npc1": 0.004060723008611857, "sim_render-npc2": 0.004036729411246738, "get_duckie_state": 1.4197020779520758e-06, "in-drivable-lane": 1.249999999999929, "deviation-heading": 9.283157806622578, "agent_compute-ego0": 0.01278482776508054, "agent_compute-npc0": 0.04430883291748673, "agent_compute-npc1": 0.0449859600377144, "agent_compute-npc2": 0.04415232447908922, "complete-iteration": 1.0748751683557412, "set_robot_commands": 0.0024337999019182267, "deviation-center-line": 2.4736770036450277, "driven_lanedir_consec": 15.952273258657945, "sim_compute_sim_state": 0.04190980888412384, "sim_compute_performance-ego0": 0.0022119250024252206, "sim_compute_performance-npc0": 0.0020762065009646584, "sim_compute_performance-npc1": 0.002107020827620533, "sim_compute_performance-npc2": 0.002117258753911158}, "LFVI-norm-udem1-000-ego0": {"driven_any": 3.5737157861756232, "get_ui_image": 0.05458256408526063, "step_physics": 0.933612721623282, "survival_time": 16.100000000000094, "driven_lanedir": 2.7590355003709415, "get_state_dump": 0.00987398292258059, "get_robot_state": 0.015100859267054696, "sim_render-ego0": 0.004075734607944547, "sim_render-npc0": 0.004283036240852285, "sim_render-npc1": 0.004197003302559395, "sim_render-npc2": 0.004137112998371892, "get_duckie_state": 1.5626381794365567e-06, "in-drivable-lane": 3.4999999999999876, "deviation-heading": 2.395779663730703, "agent_compute-ego0": 0.012994239204808286, "agent_compute-npc0": 0.04389784727303237, "agent_compute-npc1": 0.043934415368472826, "agent_compute-npc2": 0.036304391205495355, "complete-iteration": 1.2293093359507274, "set_robot_commands": 0.002540093826435668, "deviation-center-line": 0.723962100054287, "driven_lanedir_consec": 2.7590355003709415, "sim_compute_sim_state": 0.04350428389321909, "sim_compute_performance-ego0": 0.0022444053331026723, "sim_compute_performance-npc0": 0.002108749590421978, "sim_compute_performance-npc1": 0.0021575737294766925, "sim_compute_performance-npc2": 0.002208418890418652}}
set_robot_commands_max0.002540093826435668
set_robot_commands_mean0.0024869468641769473
set_robot_commands_median0.0024869468641769473
set_robot_commands_min0.0024337999019182267
sim_compute_performance-ego0_max0.0022444053331026723
sim_compute_performance-ego0_mean0.0022281651677639467
sim_compute_performance-ego0_median0.0022281651677639467
sim_compute_performance-ego0_min0.0022119250024252206
sim_compute_performance-npc0_max0.002108749590421978
sim_compute_performance-npc0_mean0.002092478045693318
sim_compute_performance-npc0_median0.002092478045693318
sim_compute_performance-npc0_min0.0020762065009646584
sim_compute_performance-npc1_max0.0021575737294766925
sim_compute_performance-npc1_mean0.002132297278548613
sim_compute_performance-npc1_median0.002132297278548613
sim_compute_performance-npc1_min0.002107020827620533
sim_compute_performance-npc2_max0.002208418890418652
sim_compute_performance-npc2_mean0.002162838822164905
sim_compute_performance-npc2_median0.002162838822164905
sim_compute_performance-npc2_min0.002117258753911158
sim_compute_sim_state_max0.04350428389321909
sim_compute_sim_state_mean0.04270704638867147
sim_compute_sim_state_median0.04270704638867147
sim_compute_sim_state_min0.04190980888412384
sim_render-ego0_max0.004075734607944547
sim_render-ego0_mean0.004057654566985919
sim_render-ego0_median0.004057654566985919
sim_render-ego0_min0.004039574526027291
sim_render-npc0_max0.004283036240852285
sim_render-npc0_mean0.004218848084815079
sim_render-npc0_median0.004218848084815079
sim_render-npc0_min0.004154659928777873
sim_render-npc1_max0.004197003302559395
sim_render-npc1_mean0.004128863155585626
sim_render-npc1_median0.004128863155585626
sim_render-npc1_min0.004060723008611857
sim_render-npc2_max0.004137112998371892
sim_render-npc2_mean0.004086921204809316
sim_render-npc2_median0.004086921204809316
sim_render-npc2_min0.004036729411246738
simulation-passed1
step_physics_max0.933612721623282
step_physics_mean0.8540858257266661
step_physics_median0.8540858257266661
step_physics_min0.7745589298300503
survival_time_max58.39999999999882
survival_time_mean37.24999999999946
survival_time_min16.100000000000094
No reset possible
5882212841Raphael Jeanexercise_state_estimationaido5-LFP-sim-testingLFP-simsuccessyesnogpu-prod-070:14:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8846654603782507
survival_time_median16.950000000000127
deviation-center-line_median0.7717239311801183
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01367514518501319
agent_compute-ego0_mean0.013092819661081103
agent_compute-ego0_median0.013050135917830883
agent_compute-ego0_min0.012595861623649462
complete-iteration_max0.30998887829057153
complete-iteration_mean0.2739040445225345
complete-iteration_median0.2836281623449988
complete-iteration_min0.2183709751095688
deviation-center-line_max1.4873629692195598
deviation-center-line_mean0.7887785974173877
deviation-center-line_min0.12430355808975406
deviation-heading_max6.864919866523777
deviation-heading_mean3.751650973358172
deviation-heading_median3.620220090731565
deviation-heading_min0.9012438454457804
driven_any_max5.9777793204937915
driven_any_mean3.071397996002476
driven_any_median2.975316750155098
driven_any_min0.3571791632059191
driven_lanedir_consec_max5.763857547021798
driven_lanedir_consec_mean2.967831159571064
driven_lanedir_consec_min0.33813617050595446
driven_lanedir_max5.763857547021798
driven_lanedir_mean2.967831159571064
driven_lanedir_median2.8846654603782507
driven_lanedir_min0.33813617050595446
get_duckie_state_max0.02738405466079712
get_duckie_state_mean0.01980774300262412
get_duckie_state_median0.02363212123496129
get_duckie_state_min0.0045826748797768045
get_robot_state_max0.004452726385916232
get_robot_state_mean0.004182567780491376
get_robot_state_median0.0041190437057562045
get_robot_state_min0.004039457324536866
get_state_dump_max0.009636529286702474
get_state_dump_mean0.00833706743521469
get_state_dump_median0.008896670062350145
get_state_dump_min0.0059184003294559945
get_ui_image_max0.04401611970649458
get_ui_image_mean0.03729949307282544
get_ui_image_median0.03730050912313383
get_ui_image_min0.030580834338539524
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 0.3571791632059191, "get_ui_image": 0.03542192776997884, "step_physics": 0.18321621417999268, "survival_time": 2.9499999999999975, "driven_lanedir": 0.33813617050595446, "get_state_dump": 0.009636529286702474, "get_robot_state": 0.00413295030593872, "sim_render-ego0": 0.0042571504910786945, "get_duckie_state": 0.02738405466079712, "in-drivable-lane": 0.0, "deviation-heading": 0.9012438454457804, "agent_compute-ego0": 0.012946840127309164, "complete-iteration": 0.28856370051701863, "set_robot_commands": 0.0025008042653401692, "deviation-center-line": 0.12430355808975406, "driven_lanedir_consec": 0.33813617050595446, "sim_compute_sim_state": 0.00681538979212443, "sim_compute_performance-ego0": 0.0021509250005086263}, "LFP-norm-zigzag-000-ego0": {"driven_any": 5.9777793204937915, "get_ui_image": 0.04401611970649458, "step_physics": 0.18657799996131785, "survival_time": 30.6000000000003, "driven_lanedir": 5.763857547021798, "get_state_dump": 0.00925388460641584, "get_robot_state": 0.004452726385916232, "sim_render-ego0": 0.004584344720762666, "get_duckie_state": 0.02448153340213645, "in-drivable-lane": 0.0, "deviation-heading": 6.864919866523777, "agent_compute-ego0": 0.01367514518501319, "complete-iteration": 0.30998887829057153, "set_robot_commands": 0.002635128151923175, "deviation-center-line": 1.4873629692195598, "driven_lanedir_consec": 5.763857547021798, "sim_compute_sim_state": 0.01772516508864734, "sim_compute_performance-ego0": 0.0024708278027483145}, "LFP-norm-techtrack-000-ego0": {"driven_any": 5.046609439702182, "get_ui_image": 0.039179090476288814, "step_physics": 0.16876094290729968, "survival_time": 28.250000000000263, "driven_lanedir": 4.882564619691772, "get_state_dump": 0.008539455518284451, "get_robot_state": 0.004039457324536866, "sim_render-ego0": 0.004121984272879341, "get_duckie_state": 0.02278270906778612, "in-drivable-lane": 0.0, "deviation-heading": 6.069977923236526, "agent_compute-ego0": 0.012595861623649462, "complete-iteration": 0.278692624172979, "set_robot_commands": 0.002409130018928447, "deviation-center-line": 1.3511808744564784, "driven_lanedir_consec": 4.882564619691772, "sim_compute_sim_state": 0.013973030942910133, "sim_compute_performance-ego0": 0.002195035189706108}, "LFP-norm-small_loop-000-ego0": {"driven_any": 0.9040240606080132, "get_ui_image": 0.030580834338539524, "step_physics": 0.14451779817280017, "survival_time": 5.649999999999988, "driven_lanedir": 0.8867663010647296, "get_state_dump": 0.0059184003294559945, "get_robot_state": 0.004105137105573688, "sim_render-ego0": 0.004129748595388312, "get_duckie_state": 0.0045826748797768045, "in-drivable-lane": 0.0, "deviation-heading": 1.1704622582266049, "agent_compute-ego0": 0.013153431708352608, "complete-iteration": 0.2183709751095688, "set_robot_commands": 0.00241273327877647, "deviation-center-line": 0.19226698790375824, "driven_lanedir_consec": 0.8867663010647296, "sim_compute_sim_state": 0.006732622782389323, "sim_compute_performance-ego0": 0.0021467146120573346}}
set_robot_commands_max0.002635128151923175
set_robot_commands_mean0.0024894489287420655
set_robot_commands_median0.00245676877205832
set_robot_commands_min0.002409130018928447
sim_compute_performance-ego0_max0.0024708278027483145
sim_compute_performance-ego0_mean0.0022408756512550957
sim_compute_performance-ego0_median0.002172980095107367
sim_compute_performance-ego0_min0.0021467146120573346
sim_compute_sim_state_max0.01772516508864734
sim_compute_sim_state_mean0.011311552151517806
sim_compute_sim_state_median0.01039421036751728
sim_compute_sim_state_min0.006732622782389323
sim_render-ego0_max0.004584344720762666
sim_render-ego0_mean0.004273307020027254
sim_render-ego0_median0.0041934495432335035
sim_render-ego0_min0.004121984272879341
simulation-passed1
step_physics_max0.18657799996131785
step_physics_mean0.1707682388053526
step_physics_median0.1759885785436462
step_physics_min0.14451779817280017
survival_time_max30.6000000000003
survival_time_mean16.86250000000014
survival_time_min2.9499999999999975
No reset possible
5880312872Raphael Jeansim-exercise-2aido5-LFV-sim-validationLFVv-simsuccessyesnogpu-prod-070:37:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.771276324515667
survival_time_median17.17500000000011
deviation-center-line_median0.9356682929172696
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01361848675785735
agent_compute-ego0_mean0.013310504640101231
agent_compute-ego0_median0.013401148574838498
agent_compute-ego0_min0.01282123465287058
agent_compute-npc0_max0.030628917065072567
agent_compute-npc0_mean0.02476997782770527
agent_compute-npc0_median0.023035933258193912
agent_compute-npc0_min0.022379127729360695
agent_compute-npc1_max0.03138450564295533
agent_compute-npc1_mean0.030476337877106702
agent_compute-npc1_median0.030991511603894704
agent_compute-npc1_min0.029052996384470085
agent_compute-npc2_max0.03806945442003453
agent_compute-npc2_mean0.030882097911425353
agent_compute-npc2_median0.028250752165675543
agent_compute-npc2_min0.02632608714856599
agent_compute-npc3_max0.04604419504110806
agent_compute-npc3_mean0.03899682143685877
agent_compute-npc3_median0.03899682143685877
agent_compute-npc3_min0.03194944783260948
complete-iteration_max1.3592382543764936
complete-iteration_mean0.9906751821464028
complete-iteration_median1.1186078061144007
complete-iteration_min0.3662468619803165
deviation-center-line_max1.4463327823681624
deviation-center-line_mean1.009594731951163
deviation-center-line_min0.7207095596019495
deviation-heading_max6.004327449675906
deviation-heading_mean3.987247956559663
deviation-heading_median3.333422017628235
deviation-heading_min3.277820341306275
driven_any_max5.227685548881521
driven_any_mean4.13848452842385
driven_any_median3.88147666909527
driven_any_min3.5632992266233368
driven_lanedir_consec_max4.908643126453767
driven_lanedir_consec_mean3.9757497829816746
driven_lanedir_consec_min3.4518033564415953
driven_lanedir_max4.908643126453767
driven_lanedir_mean3.9757497829816746
driven_lanedir_median3.771276324515667
driven_lanedir_min3.4518033564415953
get_duckie_state_max1.8310546875e-06
get_duckie_state_mean1.7042839023606012e-06
get_duckie_state_median1.694376307015968e-06
get_duckie_state_min1.5973283079104683e-06
get_robot_state_max0.019513979506568788
get_robot_state_mean0.01529363511099954
get_robot_state_median0.01687861109530387
get_robot_state_min0.007903338746821626
get_state_dump_max0.012036655657588484
get_state_dump_mean0.010003149229092036
get_state_dump_median0.010680094511703824
get_state_dump_min0.006615752235372016
get_ui_image_max0.06051780164432221
get_ui_image_mean0.05034646926441508
get_ui_image_median0.05259570672762618
get_ui_image_min0.03567666195808573
in-drivable-lane_max1.1500000000000163
in-drivable-lane_mean0.2875000000000041
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 3.904095341060964, "get_ui_image": 0.04928863623517886, "step_physics": 0.7341162782773327, "survival_time": 15.500000000000083, "driven_lanedir": 3.783704181075364, "get_state_dump": 0.010087391187907031, "get_robot_state": 0.015406881497987211, "sim_render-ego0": 0.004148385149106335, "sim_render-npc0": 0.00417778039668534, "sim_render-npc1": 0.004192453488659629, "sim_render-npc2": 0.004330489413147954, "get_duckie_state": 1.776256745267911e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.277820341306275, "agent_compute-ego0": 0.013482850464210633, "agent_compute-npc0": 0.022379127729360695, "agent_compute-npc1": 0.03138450564295533, "agent_compute-npc2": 0.03806945442003453, "complete-iteration": 0.9768128349083413, "set_robot_commands": 0.002461438776979109, "deviation-center-line": 0.913975976140524, "driven_lanedir_consec": 3.783704181075364, "sim_compute_sim_state": 0.026533428112410273, "sim_compute_performance-ego0": 0.0022876515649139307, "sim_compute_performance-npc0": 0.0021396948210296142, "sim_compute_performance-npc1": 0.002317847929583485, "sim_compute_performance-npc2": 0.002202203419430846}, "LFV-norm-zigzag-000-ego0": {"driven_any": 5.227685548881521, "get_ui_image": 0.0559027772200735, "step_physics": 0.9497900485992432, "survival_time": 23.7000000000002, "driven_lanedir": 4.908643126453767, "get_state_dump": 0.011272797835500616, "get_robot_state": 0.01835034069262053, "sim_render-ego0": 0.004032984783774928, "sim_render-npc0": 0.004127956189607319, "sim_render-npc1": 0.004077537938168174, "sim_render-npc2": 0.004003921809949373, "sim_render-npc3": 0.0040350698169909025, "get_duckie_state": 1.8310546875e-06, "in-drivable-lane": 1.1500000000000163, "deviation-heading": 6.004327449675906, "agent_compute-ego0": 0.01282123465287058, "agent_compute-npc0": 0.02248320228175113, "agent_compute-npc1": 0.029052996384470085, "agent_compute-npc2": 0.02632608714856599, "agent_compute-npc3": 0.03194944783260948, "complete-iteration": 1.2604027773204602, "set_robot_commands": 0.0023914929440147, "deviation-center-line": 1.4463327823681624, "driven_lanedir_consec": 4.908643126453767, "sim_compute_sim_state": 0.05951244555021587, "sim_compute_performance-ego0": 0.002346969905652498, "sim_compute_performance-npc0": 0.002009155875758121, "sim_compute_performance-npc1": 0.0020781160655774567, "sim_compute_performance-npc2": 0.002078621512965152, "sim_compute_performance-npc3": 0.0020350114922774464}, "LFV-norm-techtrack-000-ego0": {"driven_any": 3.5632992266233368, "get_ui_image": 0.06051780164432221, "step_physics": 1.016922901994504, "survival_time": 15.600000000000088, "driven_lanedir": 3.4518033564415953, "get_state_dump": 0.012036655657588484, "get_robot_state": 0.019513979506568788, "sim_render-ego0": 0.004335622817944414, "sim_render-npc0": 0.0043256709369988485, "sim_render-npc1": 0.00440819423419599, "sim_render-npc2": 0.00420073122262193, "sim_render-npc3": 0.004199985498056625, "get_duckie_state": 1.5973283079104683e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.2810291719235924, "agent_compute-ego0": 0.01361848675785735, "agent_compute-npc0": 0.02358866423463669, "agent_compute-npc1": 0.030991511603894704, "agent_compute-npc2": 0.028250752165675543, "agent_compute-npc3": 0.04604419504110806, "complete-iteration": 1.3592382543764936, "set_robot_commands": 0.0026027843975030577, "deviation-center-line": 0.7207095596019495, "driven_lanedir_consec": 3.4518033564415953, "sim_compute_sim_state": 0.06177321028785584, "sim_compute_performance-ego0": 0.002424144897217187, "sim_compute_performance-npc0": 0.002194781653797284, "sim_compute_performance-npc1": 0.0023079466895935255, "sim_compute_performance-npc2": 0.0022457278193757178, "sim_compute_performance-npc3": 0.0022669508815192567}, "LFV-norm-small_loop-000-ego0": {"driven_any": 3.858857997129576, "get_ui_image": 0.03567666195808573, "step_physics": 0.24280392109079563, "survival_time": 18.75000000000013, "driven_lanedir": 3.7588484679559704, "get_state_dump": 0.006615752235372016, "get_robot_state": 0.007903338746821626, "sim_render-ego0": 0.0041442963671176995, "sim_render-npc0": 0.00430888571637742, "get_duckie_state": 1.612495868764025e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.385814863332879, "agent_compute-ego0": 0.01331944668546636, "agent_compute-npc0": 0.030628917065072567, "complete-iteration": 0.3662468619803165, "set_robot_commands": 0.0026048415518821555, "deviation-center-line": 0.9573606096940152, "driven_lanedir_consec": 3.7588484679559704, "sim_compute_sim_state": 0.011253904154960146, "sim_compute_performance-ego0": 0.0022420990974345105, "sim_compute_performance-npc0": 0.0021374878731179746}}
set_robot_commands_max0.0026048415518821555
set_robot_commands_mean0.0025151394175947552
set_robot_commands_median0.002532111587241083
set_robot_commands_min0.0023914929440147
sim_compute_performance-ego0_max0.002424144897217187
sim_compute_performance-ego0_mean0.0023252163663045316
sim_compute_performance-ego0_median0.002317310735283214
sim_compute_performance-ego0_min0.0022420990974345105
sim_compute_performance-npc0_max0.002194781653797284
sim_compute_performance-npc0_mean0.0021202800559257484
sim_compute_performance-npc0_median0.002138591347073794
sim_compute_performance-npc0_min0.002009155875758121
sim_compute_performance-npc1_max0.002317847929583485
sim_compute_performance-npc1_mean0.0022346368949181556
sim_compute_performance-npc1_median0.0023079466895935255
sim_compute_performance-npc1_min0.0020781160655774567
sim_compute_performance-npc2_max0.0022457278193757178
sim_compute_performance-npc2_mean0.0021755175839239054
sim_compute_performance-npc2_median0.002202203419430846
sim_compute_performance-npc2_min0.002078621512965152
sim_compute_performance-npc3_max0.0022669508815192567
sim_compute_performance-npc3_mean0.0021509811868983516
sim_compute_performance-npc3_median0.0021509811868983516
sim_compute_performance-npc3_min0.0020350114922774464
sim_compute_sim_state_max0.06177321028785584
sim_compute_sim_state_mean0.03976824702636053
sim_compute_sim_state_median0.04302293683131307
sim_compute_sim_state_min0.011253904154960146
sim_render-ego0_max0.004335622817944414
sim_render-ego0_mean0.004165322279485844
sim_render-ego0_median0.004146340758112018
sim_render-ego0_min0.004032984783774928
sim_render-npc0_max0.0043256709369988485
sim_render-npc0_mean0.004235073309917232
sim_render-npc0_median0.0042433330565313804
sim_render-npc0_min0.004127956189607319
sim_render-npc1_max0.00440819423419599
sim_render-npc1_mean0.004226061887007931
sim_render-npc1_median0.004192453488659629
sim_render-npc1_min0.004077537938168174
sim_render-npc2_max0.004330489413147954
sim_render-npc2_mean0.004178380815239752
sim_render-npc2_median0.00420073122262193
sim_render-npc2_min0.004003921809949373
sim_render-npc3_max0.004199985498056625
sim_render-npc3_mean0.004117527657523764
sim_render-npc3_median0.004117527657523764
sim_render-npc3_min0.0040350698169909025
simulation-passed1
step_physics_max1.016922901994504
step_physics_mean0.735908287490469
step_physics_median0.841953163438288
step_physics_min0.24280392109079563
survival_time_max23.7000000000002
survival_time_mean18.387500000000124
survival_time_min15.500000000000083
No reset possible
5879312775Thomas WiggersΒ πŸ‡³πŸ‡±ppo_v1aido5-LF-sim-testingLFt-simsuccessyesnogpu-prod-070:16:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8091968051150191
survival_time_median24.77500000000022
deviation-center-line_median0.8004147069678376
in-drivable-lane_median8.250000000000117


other stats
agent_compute-ego0_max0.09344273079805268
agent_compute-ego0_mean0.08351057105432441
agent_compute-ego0_median0.09197522714831773
agent_compute-ego0_min0.05664909912260952
complete-iteration_max0.2684615816086729
complete-iteration_mean0.24602651452170027
complete-iteration_median0.24156658067670717
complete-iteration_min0.23251131512471385
deviation-center-line_max0.9702136282486312
deviation-center-line_mean0.7390720339398957
deviation-center-line_min0.3852450935752763
deviation-heading_max4.19560090973135
deviation-heading_mean2.5854715210270713
deviation-heading_median2.358852092046509
deviation-heading_min1.4285809902839186
driven_any_max3.106810362690964
driven_any_mean2.75966198838233
driven_any_median2.9907977896137736
driven_any_min1.9502420116108108
driven_lanedir_consec_max2.2528060639072183
driven_lanedir_consec_mean1.718611187848167
driven_lanedir_consec_min1.0032450772554116
driven_lanedir_max2.2528060639072183
driven_lanedir_mean1.718611187848167
driven_lanedir_median1.8091968051150191
driven_lanedir_min1.0032450772554116
get_duckie_state_max1.613944219047293e-06
get_duckie_state_mean1.5819036461696378e-06
get_duckie_state_median1.599552223695921e-06
get_duckie_state_min1.514565918239416e-06
get_robot_state_max0.004010899966915712
get_robot_state_mean0.003932889128175546
get_robot_state_median0.003917305929779978
get_robot_state_min0.003886044686226517
get_state_dump_max0.0050966502814892905
get_state_dump_mean0.004890215636196912
get_state_dump_median0.00483068988137913
get_state_dump_min0.004802832500540095
get_ui_image_max0.03939641870046138
get_ui_image_mean0.03343673324969038
get_ui_image_median0.03274992733872626
get_ui_image_min0.02885065962084763
in-drivable-lane_max12.350000000000154
in-drivable-lane_mean8.162500000000112
in-drivable-lane_min3.800000000000054
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.106810362690964, "get_ui_image": 0.03090921407256179, "step_physics": 0.09678247010136004, "survival_time": 27.05000000000025, "driven_lanedir": 2.2528060639072183, "get_state_dump": 0.004829180196642436, "get_robot_state": 0.003891341800619315, "sim_render-ego0": 0.0041509255271996075, "get_duckie_state": 1.613944219047293e-06, "in-drivable-lane": 8.000000000000114, "deviation-heading": 2.335465205919194, "agent_compute-ego0": 0.09344273079805268, "complete-iteration": 0.246211907960392, "set_robot_commands": 0.002424848915466083, "deviation-center-line": 0.909175256147186, "driven_lanedir_consec": 2.2528060639072183, "sim_compute_sim_state": 0.007548929580463255, "sim_compute_performance-ego0": 0.0021360457163455302}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.9981857532159286, "get_ui_image": 0.03939641870046138, "step_physics": 0.10609605412789828, "survival_time": 22.500000000000185, "driven_lanedir": 1.0032450772554116, "get_state_dump": 0.004832199566115826, "get_robot_state": 0.003886044686226517, "sim_render-ego0": 0.004248289205546919, "get_duckie_state": 1.514565918239416e-06, "in-drivable-lane": 12.350000000000154, "deviation-heading": 4.19560090973135, "agent_compute-ego0": 0.09334724335342712, "complete-iteration": 0.2684615816086729, "set_robot_commands": 0.00227712791933453, "deviation-center-line": 0.6916541577884892, "driven_lanedir_consec": 1.0032450772554116, "sim_compute_sim_state": 0.012132473901211556, "sim_compute_performance-ego0": 0.002149889051517732}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.9502420116108108, "get_ui_image": 0.034590640604890734, "step_physics": 0.10909608578839838, "survival_time": 15.05000000000008, "driven_lanedir": 1.461627638767126, "get_state_dump": 0.0050966502814892905, "get_robot_state": 0.004010899966915712, "sim_render-ego0": 0.00428083006119886, "get_duckie_state": 1.5923519008207006e-06, "in-drivable-lane": 3.800000000000054, "deviation-heading": 1.4285809902839186, "agent_compute-ego0": 0.05664909912260952, "complete-iteration": 0.23251131512471385, "set_robot_commands": 0.0023574544893984763, "deviation-center-line": 0.3852450935752763, "driven_lanedir_consec": 1.461627638767126, "sim_compute_sim_state": 0.014141473549091264, "sim_compute_performance-ego0": 0.00218491917414381}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.983409826011618, "get_ui_image": 0.02885065962084763, "step_physics": 0.092846557819586, "survival_time": 27.75000000000026, "driven_lanedir": 2.1567659714629124, "get_state_dump": 0.004802832500540095, "get_robot_state": 0.00394327005894064, "sim_render-ego0": 0.00417100697112598, "get_duckie_state": 1.6067525465711414e-06, "in-drivable-lane": 8.50000000000012, "deviation-heading": 2.3822389781738247, "agent_compute-ego0": 0.09060321094320832, "complete-iteration": 0.23692125339302228, "set_robot_commands": 0.002331516725553883, "deviation-center-line": 0.9702136282486312, "driven_lanedir_consec": 2.1567659714629124, "sim_compute_sim_state": 0.007130255802072209, "sim_compute_performance-ego0": 0.002144156600073945}}
set_robot_commands_max0.002424848915466083
set_robot_commands_mean0.002347737012438243
set_robot_commands_median0.00234448560747618
set_robot_commands_min0.00227712791933453
sim_compute_performance-ego0_max0.00218491917414381
sim_compute_performance-ego0_mean0.002153752635520254
sim_compute_performance-ego0_median0.002147022825795838
sim_compute_performance-ego0_min0.0021360457163455302
sim_compute_sim_state_max0.014141473549091264
sim_compute_sim_state_mean0.01023828320820957
sim_compute_sim_state_median0.009840701740837406
sim_compute_sim_state_min0.007130255802072209
sim_render-ego0_max0.00428083006119886
sim_render-ego0_mean0.0042127629412678416
sim_render-ego0_median0.004209648088336449
sim_render-ego0_min0.0041509255271996075
simulation-passed1
step_physics_max0.10909608578839838
step_physics_mean0.10120529195931068
step_physics_median0.10143926211462916
step_physics_min0.092846557819586
survival_time_max27.75000000000026
survival_time_mean23.08750000000019
survival_time_min15.05000000000008
No reset possible
5876812741Thomas WiggersΒ πŸ‡³πŸ‡±ppo_v1aido5-LFP-sim-validationLFP-simsuccessnonogpu-prod-070:32:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median46.64999999999949
in-drivable-lane_median24.94999999999996
driven_lanedir_consec_median2.0454448641542737
deviation-center-line_median0.8986681564618777


other stats
agent_compute-ego0_max0.08985944677676473
agent_compute-ego0_mean0.07384526659161661
agent_compute-ego0_median0.07360761782102725
agent_compute-ego0_min0.058306383947647186
complete-iteration_max0.3063776005023413
complete-iteration_mean0.27137769759634633
complete-iteration_median0.2822267360368459
complete-iteration_min0.2146797178093523
deviation-center-line_max2.016729942727011
deviation-center-line_mean1.0701691912709164
deviation-center-line_min0.4666105094328992
deviation-heading_max17.14244730029623
deviation-heading_mean7.00715030117988
deviation-heading_median4.518897894034499
deviation-heading_min1.8483581163542928
driven_any_max7.140361848468016
driven_any_mean5.005428995531474
driven_any_median5.045696872609133
driven_any_min2.789960388439615
driven_lanedir_consec_max3.4764263956997734
driven_lanedir_consec_mean2.296485743567537
driven_lanedir_consec_min1.6186268502618266
driven_lanedir_max3.4764263956997734
driven_lanedir_mean2.322704139036498
driven_lanedir_median2.096949784182823
driven_lanedir_min1.6204905920805734
get_duckie_state_max0.027676849492958615
get_duckie_state_mean0.01967156182578687
get_duckie_state_median0.023186254174160863
get_duckie_state_min0.004636889461867153
get_robot_state_max0.004188307752912635
get_robot_state_mean0.004052646821648824
get_robot_state_median0.004043401581974904
get_robot_state_min0.003935476369732852
get_state_dump_max0.009057917233024324
get_state_dump_mean0.00793867730217058
get_state_dump_median0.0085936367198804
get_state_dump_min0.0055095185358972005
get_ui_image_max0.040198107940966045
get_ui_image_mean0.03601174081618873
get_ui_image_median0.037865582441720086
get_ui_image_min0.02811769044034866
in-drivable-lane_max31.64999999999906
in-drivable-lane_mean23.137499999999783
in-drivable-lane_min11.000000000000156
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.789960388439615, "get_ui_image": 0.03572769303406988, "step_physics": 0.11075271027428764, "survival_time": 22.350000000000183, "driven_lanedir": 1.8948116367432, "get_state_dump": 0.009057917233024324, "get_robot_state": 0.0040487317102296016, "sim_render-ego0": 0.00408215235386576, "get_duckie_state": 0.027676849492958615, "in-drivable-lane": 11.000000000000156, "deviation-heading": 1.8483581163542928, "agent_compute-ego0": 0.08985944677676473, "complete-iteration": 0.2936175497514861, "set_robot_commands": 0.0023834221065044403, "deviation-center-line": 0.4666105094328992, "driven_lanedir_consec": 1.8948116367432, "sim_compute_sim_state": 0.0077368515942777905, "sim_compute_performance-ego0": 0.002185953514916556}, "LFP-norm-zigzag-000-ego0": {"driven_any": 6.324954070845563, "get_ui_image": 0.040198107940966045, "step_physics": 0.11536120217011236, "survival_time": 59.99999999999873, "driven_lanedir": 2.2990879316224464, "get_state_dump": 0.008553481121841417, "get_robot_state": 0.004038071453720207, "sim_render-ego0": 0.0040777170290855645, "get_duckie_state": 0.02266530351376752, "in-drivable-lane": 31.64999999999906, "deviation-heading": 17.14244730029623, "agent_compute-ego0": 0.058306383947647186, "complete-iteration": 0.27083592232220577, "set_robot_commands": 0.0023854487543796916, "deviation-center-line": 2.016729942727011, "driven_lanedir_consec": 2.1960780915653473, "sim_compute_sim_state": 0.01295077731269881, "sim_compute_performance-ego0": 0.002181903408727082}, "LFP-norm-techtrack-000-ego0": {"driven_any": 3.766439674372702, "get_ui_image": 0.0400034718493703, "step_physics": 0.12340964288302642, "survival_time": 36.10000000000009, "driven_lanedir": 1.6204905920805734, "get_state_dump": 0.008633792317919381, "get_robot_state": 0.004188307752912635, "sim_render-ego0": 0.004190718319735916, "get_duckie_state": 0.02370720483455421, "in-drivable-lane": 20.150000000000286, "deviation-heading": 4.8506371602986444, "agent_compute-ego0": 0.08199100144836088, "complete-iteration": 0.3063776005023413, "set_robot_commands": 0.002486055157821043, "deviation-center-line": 0.9268987960366551, "driven_lanedir_consec": 1.6186268502618266, "sim_compute_sim_state": 0.015348140959258232, "sim_compute_performance-ego0": 0.002308211715719347}, "LFP-norm-small_loop-000-ego0": {"driven_any": 7.140361848468016, "get_ui_image": 0.02811769044034866, "step_physics": 0.09209793436475196, "survival_time": 57.19999999999889, "driven_lanedir": 3.4764263956997734, "get_state_dump": 0.0055095185358972005, "get_robot_state": 0.003935476369732852, "sim_render-ego0": 0.004024405250382735, "get_duckie_state": 0.004636889461867153, "in-drivable-lane": 29.74999999999963, "deviation-heading": 4.187158627770353, "agent_compute-ego0": 0.06522423419369361, "complete-iteration": 0.2146797178093523, "set_robot_commands": 0.0023005535508867957, "deviation-center-line": 0.8704375168871002, "driven_lanedir_consec": 3.4764263956997734, "sim_compute_sim_state": 0.006623249803568078, "sim_compute_performance-ego0": 0.002113355195157913}}
set_robot_commands_max0.002486055157821043
set_robot_commands_mean0.0023888698923979924
set_robot_commands_median0.002384435430442066
set_robot_commands_min0.0023005535508867957
sim_compute_performance-ego0_max0.002308211715719347
sim_compute_performance-ego0_mean0.0021973559586302245
sim_compute_performance-ego0_median0.002183928461821819
sim_compute_performance-ego0_min0.002113355195157913
sim_compute_sim_state_max0.015348140959258232
sim_compute_sim_state_mean0.010664754917450728
sim_compute_sim_state_median0.0103438144534883
sim_compute_sim_state_min0.006623249803568078
sim_render-ego0_max0.004190718319735916
sim_render-ego0_mean0.004093748238267494
sim_render-ego0_median0.004079934691475662
sim_render-ego0_min0.004024405250382735
simulation-passed1
step_physics_max0.12340964288302642
step_physics_mean0.1104053724230446
step_physics_median0.1130569562222
step_physics_min0.09209793436475196
survival_time_max59.99999999999873
survival_time_mean43.91249999999947
survival_time_min22.350000000000183
No reset possible
5874712738Dishank BansalΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LF-sim-validationLFv-simerroryesnogpu-prod-070:08:52
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5871511772Ehsan AhmadiΒ πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-070:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586906729Andrea CensiΒ πŸ‡¨πŸ‡­template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:04:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.01205473393201828
agent_compute-ego0_mean0.01147756573000279
agent_compute-ego0_median0.011365817967178784
agent_compute-ego0_min0.011123893053635307
complete-iteration_max0.20485658446947733
complete-iteration_mean0.18707465599601125
complete-iteration_median0.18698700955757808
complete-iteration_min0.16946802039941153
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.5844272661812698e-06
get_duckie_state_mean1.477097877958663e-06
get_duckie_state_median1.4554187295517483e-06
get_duckie_state_min1.413126786549886e-06
get_robot_state_max0.00508646418650945
get_robot_state_mean0.004173749635694392
get_robot_state_median0.003920441647957481
get_robot_state_min0.0037676510603531542
get_state_dump_max0.007296358545621236
get_state_dump_mean0.005586687898248414
get_state_dump_median0.005047583043491455
get_state_dump_min0.00495522696038951
get_ui_image_max0.034041150756504227
get_ui_image_mean0.03097159847526483
get_ui_image_median0.030725760178433523
get_ui_image_min0.02839372278768805
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.02839372278768805, "step_physics": 0.10463331922700134, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.005108813696269748, "get_robot_state": 0.003985065448133251, "sim_render-ego0": 0.0040026118483724475, "get_duckie_state": 1.5844272661812698e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.01118136508555352, "complete-iteration": 0.17209403575221194, "set_robot_commands": 0.002381330803979801, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.01014792315567596, "sim_compute_performance-ego0": 0.0021592982207672504}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.034041150756504227, "step_physics": 0.13014014389203943, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.00495522696038951, "get_robot_state": 0.0037676510603531542, "sim_render-ego0": 0.003962198029393735, "get_duckie_state": 1.4538350312606148e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.011123893053635307, "complete-iteration": 0.20187998336294424, "set_robot_commands": 0.0023220492445904274, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.009371327317279318, "sim_compute_performance-ego0": 0.0021042020424552584}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.03212733401192559, "step_physics": 0.13574842611948648, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004986352390713162, "get_robot_state": 0.0038558178477817113, "sim_render-ego0": 0.003969113032023112, "get_duckie_state": 1.457002427842882e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.01155027084880405, "complete-iteration": 0.20485658446947733, "set_robot_commands": 0.0022844208611382377, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.008105754852294922, "sim_compute_performance-ego0": 0.0021341111924913195}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.029324186344941456, "step_physics": 0.098877248664697, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.007296358545621236, "get_robot_state": 0.00508646418650945, "sim_render-ego0": 0.004051377375920613, "get_duckie_state": 1.413126786549886e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.01205473393201828, "complete-iteration": 0.16946802039941153, "set_robot_commands": 0.003787574668725332, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.006659636894861857, "sim_compute_performance-ego0": 0.00223885973294576}}
set_robot_commands_max0.003787574668725332
set_robot_commands_mean0.0026938438946084494
set_robot_commands_median0.0023516900242851143
set_robot_commands_min0.0022844208611382377
sim_compute_performance-ego0_max0.00223885973294576
sim_compute_performance-ego0_mean0.002159117797164897
sim_compute_performance-ego0_median0.0021467047066292847
sim_compute_performance-ego0_min0.0021042020424552584
sim_compute_sim_state_max0.01014792315567596
sim_compute_sim_state_mean0.008571160555028014
sim_compute_sim_state_median0.00873854108478712
sim_compute_sim_state_min0.006659636894861857
sim_render-ego0_max0.004051377375920613
sim_render-ego0_mean0.003996325071427477
sim_render-ego0_median0.00398586244019778
sim_render-ego0_min0.003962198029393735
simulation-passed1
step_physics_max0.13574842611948648
step_physics_mean0.11734978447580606
step_physics_median0.11738673155952038
step_physics_min0.098877248664697
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
586786757Liam PaullΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:02:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586616757Liam PaullΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:03:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
585896824Anthony CourchesneΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:37:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.002314083215814
survival_time_median59.99999999999873
deviation-center-line_median3.765939027372612
in-drivable-lane_median5.299999999999827


other stats
agent_compute-ego0_max0.027114534854491883
agent_compute-ego0_mean0.016647593365620814
agent_compute-ego0_median0.013285370492419036
agent_compute-ego0_min0.012905097623153292
complete-iteration_max0.22204340665564748
complete-iteration_mean0.19734031765983068
complete-iteration_median0.19285601322895085
complete-iteration_min0.1816058375257735
deviation-center-line_max3.9993801272199616
deviation-center-line_mean3.3470933573017083
deviation-center-line_min1.8571152472416488
deviation-heading_max11.421854622463831
deviation-heading_mean9.846151059516366
deviation-heading_median10.462466891355817
deviation-heading_min7.037815832890002
driven_any_max7.92109796500289
driven_any_mean7.919257990147589
driven_any_median7.920762405552621
driven_any_min7.914409184482228
driven_lanedir_consec_max6.9322005888327265
driven_lanedir_consec_mean5.517380537038701
driven_lanedir_consec_min3.1326933928904506
driven_lanedir_max6.9808572497215104
driven_lanedir_mean5.973649833720918
driven_lanedir_median6.890524346135855
driven_lanedir_min3.1326933928904506
get_duckie_state_max1.6494754152829998e-06
get_duckie_state_mean1.4803888001707969e-06
get_duckie_state_median1.44321654460313e-06
get_duckie_state_min1.385646696193927e-06
get_robot_state_max0.003966866683007081
get_robot_state_mean0.0038710091632172825
get_robot_state_median0.003889221335132354
get_robot_state_min0.0037387272995973407
get_state_dump_max0.0053071370232015925
get_state_dump_mean0.0051262985657494235
get_state_dump_median0.005121611635651219
get_state_dump_min0.0049548339684936625
get_ui_image_max0.03682669989770894
get_ui_image_mean0.03106524575064323
get_ui_image_median0.030718630894733208
get_ui_image_min0.025997021315397568
in-drivable-lane_max33.49999999999849
in-drivable-lane_mean12.074999999999498
in-drivable-lane_min4.19999999999985
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.92109796500289, "get_ui_image": 0.029183531879485396, "step_physics": 0.1116353601936893, "survival_time": 59.99999999999873, "driven_lanedir": 6.9808572497215104, "get_state_dump": 0.0053071370232015925, "get_robot_state": 0.003966866683007081, "sim_render-ego0": 0.004105021812635894, "get_duckie_state": 1.6494754152829998e-06, "in-drivable-lane": 4.19999999999985, "deviation-heading": 9.791800354351734, "agent_compute-ego0": 0.013242144270999349, "complete-iteration": 0.1816058375257735, "set_robot_commands": 0.002399665529185985, "deviation-center-line": 3.884101689042238, "driven_lanedir_consec": 5.155780062992643, "sim_compute_sim_state": 0.009485275124034517, "sim_compute_performance-ego0": 0.002182036613445298}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.920965842274734, "get_ui_image": 0.03682669989770894, "step_physics": 0.14090210670833286, "survival_time": 59.99999999999873, "driven_lanedir": 6.9322005888327265, "get_state_dump": 0.00506213642377639, "get_robot_state": 0.003905086493511978, "sim_render-ego0": 0.004035156831256952, "get_duckie_state": 1.4209826721140586e-06, "in-drivable-lane": 5.19999999999983, "deviation-heading": 11.421854622463831, "agent_compute-ego0": 0.013328596713838728, "complete-iteration": 0.22204340665564748, "set_robot_commands": 0.002337574462509473, "deviation-center-line": 3.9993801272199616, "driven_lanedir_consec": 6.9322005888327265, "sim_compute_sim_state": 0.013361309489838586, "sim_compute_performance-ego0": 0.0021902968941084253}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.914409184482228, "get_ui_image": 0.03225372990998102, "step_physics": 0.12134907724061278, "survival_time": 59.99999999999873, "driven_lanedir": 6.848848103438985, "get_state_dump": 0.0049548339684936625, "get_robot_state": 0.0038733561767527306, "sim_render-ego0": 0.003977697159626601, "get_duckie_state": 1.465450417092202e-06, "in-drivable-lane": 5.3999999999998245, "deviation-heading": 11.133133428359896, "agent_compute-ego0": 0.012905097623153292, "complete-iteration": 0.1972454354526796, "set_robot_commands": 0.002328415893694443, "deviation-center-line": 3.6477763657029856, "driven_lanedir_consec": 6.848848103438985, "sim_compute_sim_state": 0.013261078597107696, "sim_compute_performance-ego0": 0.002248479960661546}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920558968830507, "get_ui_image": 0.025997021315397568, "step_physics": 0.11185973093571214, "survival_time": 59.99999999999873, "driven_lanedir": 3.1326933928904506, "get_state_dump": 0.005181086847526048, "get_robot_state": 0.0037387272995973407, "sim_render-ego0": 0.00381695122444858, "get_duckie_state": 1.385646696193927e-06, "in-drivable-lane": 33.49999999999849, "deviation-heading": 7.037815832890002, "agent_compute-ego0": 0.027114534854491883, "complete-iteration": 0.1884665910052221, "set_robot_commands": 0.0022771620532058856, "deviation-center-line": 1.8571152472416488, "driven_lanedir_consec": 3.1326933928904506, "sim_compute_sim_state": 0.006387949783935039, "sim_compute_performance-ego0": 0.002002149497738091}}
set_robot_commands_max0.002399665529185985
set_robot_commands_mean0.002335704484648947
set_robot_commands_median0.002332995178101958
set_robot_commands_min0.0022771620532058856
sim_compute_performance-ego0_max0.002248479960661546
sim_compute_performance-ego0_mean0.00215574074148834
sim_compute_performance-ego0_median0.002186166753776862
sim_compute_performance-ego0_min0.002002149497738091
sim_compute_sim_state_max0.013361309489838586
sim_compute_sim_state_mean0.01062390324872896
sim_compute_sim_state_median0.011373176860571106
sim_compute_sim_state_min0.006387949783935039
sim_render-ego0_max0.004105021812635894
sim_render-ego0_mean0.0039837067569920065
sim_render-ego0_median0.004006426995441776
sim_render-ego0_min0.00381695122444858
simulation-passed1
step_physics_max0.14090210670833286
step_physics_mean0.12143656876958678
step_physics_median0.11660440408816246
step_physics_min0.1116353601936893
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
585566838Himanshu AroraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:45:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01334281070941096
agent_compute-ego0_mean0.012681178258519488
agent_compute-ego0_median0.012697727753657484
agent_compute-ego0_min0.011986446817352015
complete-iteration_max0.3699000564641897
complete-iteration_mean0.31169622873485736
complete-iteration_median0.311216535516623
complete-iteration_min0.25445178744199376
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.4690237180279454e-06
get_duckie_state_mean1.4143819912188656e-06
get_duckie_state_median1.4200893468801226e-06
get_duckie_state_min1.348325553087271e-06
get_robot_state_max0.003866280643866521
get_robot_state_mean0.0038399002037874178
get_robot_state_median0.003851447871682249
get_robot_state_min0.0037904244279186494
get_state_dump_max0.004851795850844308
get_state_dump_mean0.004775505578091103
get_state_dump_median0.004770343746372702
get_state_dump_min0.004709538968774699
get_ui_image_max0.037291504759077825
get_ui_image_mean0.031746185242782325
get_ui_image_median0.031245584491885373
get_ui_image_min0.027202067228280735
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.029377726095105885, "step_physics": 0.2301380979726952, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.0047799659509841445, "get_robot_state": 0.0037904244279186494, "sim_render-ego0": 0.00391189660954535, "get_duckie_state": 1.4134390368052664e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.011986446817352015, "complete-iteration": 0.297294145222012, "set_robot_commands": 0.0023024334300070577, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008852341689237648, "sim_compute_performance-ego0": 0.0020645498534622637}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.037291504759077825, "step_physics": 0.28971411107878803, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004851795850844308, "get_robot_state": 0.003866280643866521, "sim_render-ego0": 0.00406614469548844, "get_duckie_state": 1.426739656954979e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.01334281070941096, "complete-iteration": 0.3699000564641897, "set_robot_commands": 0.0023250633433498412, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.012202226946891891, "sim_compute_performance-ego0": 0.002146086228280937}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.033113442888664864, "step_physics": 0.2536727929492477, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004709538968774699, "get_robot_state": 0.0038582877652234182, "sim_render-ego0": 0.003925981569250458, "get_duckie_state": 1.348325553087271e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012136733303657676, "complete-iteration": 0.325138925811234, "set_robot_commands": 0.002339996564993751, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009131656300515358, "sim_compute_performance-ego0": 0.002161417078912308}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.027202067228280735, "step_physics": 0.1906479804541646, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.00476072154176126, "get_robot_state": 0.00384460797814108, "sim_render-ego0": 0.0038967208004712464, "get_duckie_state": 1.4690237180279454e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.013258722203657291, "complete-iteration": 0.25445178744199376, "set_robot_commands": 0.0023524937879830774, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006293492154415998, "sim_compute_performance-ego0": 0.0021053208201056613}}
set_robot_commands_max0.0023524937879830774
set_robot_commands_mean0.002329996781583432
set_robot_commands_median0.002332529954171796
set_robot_commands_min0.0023024334300070577
sim_compute_performance-ego0_max0.002161417078912308
sim_compute_performance-ego0_mean0.0021193434951902925
sim_compute_performance-ego0_median0.002125703524193299
sim_compute_performance-ego0_min0.0020645498534622637
sim_compute_sim_state_max0.012202226946891891
sim_compute_sim_state_mean0.009119929272765224
sim_compute_sim_state_median0.008991998994876502
sim_compute_sim_state_min0.006293492154415998
sim_render-ego0_max0.00406614469548844
sim_render-ego0_mean0.003950185918688873
sim_render-ego0_median0.003918939089397904
sim_render-ego0_min0.0038967208004712464
simulation-passed1
step_physics_max0.28971411107878803
step_physics_mean0.24104324561372387
step_physics_median0.24190544546097145
step_physics_min0.1906479804541646
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
585466842Himanshu AroraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:20:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.369809816459718
survival_time_median38.79999999999993
deviation-center-line_median0.9757756004173964
in-drivable-lane_median26.97499999999979


other stats
agent_compute-ego0_max0.013187305086609945
agent_compute-ego0_mean0.012778584672878174
agent_compute-ego0_median0.01268754199795101
agent_compute-ego0_min0.012551949609000728
complete-iteration_max0.17992923052414603
complete-iteration_mean0.17280386029607137
complete-iteration_median0.17404510254348848
complete-iteration_min0.16319600557316247
deviation-center-line_max2.85943674679007
deviation-center-line_mean1.3253461977998249
deviation-center-line_min0.49039684357443686
deviation-heading_max6.737338443463686
deviation-heading_mean3.717919967894424
deviation-heading_median2.7954353768650764
deviation-heading_min2.543470674383859
driven_any_max7.25501758244321
driven_any_mean5.017088138792421
driven_any_median5.273899010405366
driven_any_min2.2655369519157462
driven_lanedir_consec_max3.5455711447493834
driven_lanedir_consec_mean1.7513336228236152
driven_lanedir_consec_min0.7201437136256412
driven_lanedir_max3.5455711447493834
driven_lanedir_mean1.7513336228236152
driven_lanedir_median1.369809816459718
driven_lanedir_min0.7201437136256412
get_duckie_state_max2.176775408618023e-06
get_duckie_state_mean2.0824851748588395e-06
get_duckie_state_median2.11062866838897e-06
get_duckie_state_min1.931907954039397e-06
get_robot_state_max0.003833086504412524
get_robot_state_mean0.003708110540313848
get_robot_state_median0.003696670668013524
get_robot_state_min0.003606014320815819
get_state_dump_max0.004878664292352048
get_state_dump_mean0.004679044399894286
get_state_dump_median0.004665826682774526
get_state_dump_min0.004505859941676043
get_ui_image_max0.03521759751914204
get_ui_image_mean0.03103338344636485
get_ui_image_median0.030220155644404313
get_ui_image_min0.02847562497750872
in-drivable-lane_max28.649999999999608
in-drivable-lane_mean23.212499999999828
in-drivable-lane_min10.250000000000128
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.25501758244321, "get_ui_image": 0.02877092721327296, "step_physics": 0.10490713704307124, "survival_time": 52.94999999999913, "driven_lanedir": 3.5455711447493834, "get_state_dump": 0.004717687615808451, "get_robot_state": 0.003718326451643458, "sim_render-ego0": 0.003798641348784825, "get_duckie_state": 2.1131533496784713e-06, "in-drivable-lane": 25.69999999999938, "deviation-heading": 6.737338443463686, "agent_compute-ego0": 0.012551949609000728, "complete-iteration": 0.17264916267035144, "set_robot_commands": 0.0022672695933647876, "deviation-center-line": 2.85943674679007, "driven_lanedir_consec": 3.5455711447493834, "sim_compute_sim_state": 0.009846558210984716, "sim_compute_performance-ego0": 0.0019870758056640624}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.669430088706166, "get_ui_image": 0.03521759751914204, "step_physics": 0.10557488600413004, "survival_time": 34.45000000000018, "driven_lanedir": 0.7201437136256412, "get_state_dump": 0.004505859941676043, "get_robot_state": 0.003606014320815819, "sim_render-ego0": 0.00371756380882816, "get_duckie_state": 2.108103987099468e-06, "in-drivable-lane": 28.250000000000195, "deviation-heading": 2.543470674383859, "agent_compute-ego0": 0.012745545221411664, "complete-iteration": 0.17992923052414603, "set_robot_commands": 0.0021875982699186905, "deviation-center-line": 0.4996437211347808, "driven_lanedir_consec": 0.7201437136256412, "sim_compute_sim_state": 0.010347349056299185, "sim_compute_performance-ego0": 0.0019444648770318516}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.878367932104565, "get_ui_image": 0.03166938407553567, "step_physics": 0.10242625519081398, "survival_time": 43.149999999999686, "driven_lanedir": 1.9030394355120637, "get_state_dump": 0.004613965749740601, "get_robot_state": 0.00367501488438359, "sim_render-ego0": 0.00373961141815892, "get_duckie_state": 1.931907954039397e-06, "in-drivable-lane": 28.649999999999608, "deviation-heading": 2.995115020731234, "agent_compute-ego0": 0.012629538774490356, "complete-iteration": 0.17544104241662556, "set_robot_commands": 0.0021635625097486707, "deviation-center-line": 1.4519074797000118, "driven_lanedir_consec": 1.9030394355120637, "sim_compute_sim_state": 0.012423444401334834, "sim_compute_performance-ego0": 0.002018600426338337}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.2655369519157462, "get_ui_image": 0.02847562497750872, "step_physics": 0.09846804045528346, "survival_time": 17.25000000000011, "driven_lanedir": 0.8365801974073721, "get_state_dump": 0.004878664292352048, "get_robot_state": 0.003833086504412524, "sim_render-ego0": 0.003973663886847524, "get_duckie_state": 2.176775408618023e-06, "in-drivable-lane": 10.250000000000128, "deviation-heading": 2.595755732998919, "agent_compute-ego0": 0.013187305086609945, "complete-iteration": 0.16319600557316247, "set_robot_commands": 0.002320306838592353, "deviation-center-line": 0.49039684357443686, "driven_lanedir_consec": 0.8365801974073721, "sim_compute_sim_state": 0.005898206909267889, "sim_compute_performance-ego0": 0.002073449206490048}}
set_robot_commands_max0.002320306838592353
set_robot_commands_mean0.0022346843029061253
set_robot_commands_median0.002227433931641739
set_robot_commands_min0.0021635625097486707
sim_compute_performance-ego0_max0.002073449206490048
sim_compute_performance-ego0_mean0.0020058975788810746
sim_compute_performance-ego0_median0.0020028381160012
sim_compute_performance-ego0_min0.0019444648770318516
sim_compute_sim_state_max0.012423444401334834
sim_compute_sim_state_mean0.009628889644471656
sim_compute_sim_state_median0.01009695363364195
sim_compute_sim_state_min0.005898206909267889
sim_render-ego0_max0.003973663886847524
sim_render-ego0_mean0.0038073701156548577
sim_render-ego0_median0.003769126383471872
sim_render-ego0_min0.00371756380882816
simulation-passed1
step_physics_max0.10557488600413004
step_physics_mean0.10284407967332468
step_physics_median0.1036666961169426
step_physics_min0.09846804045528346
survival_time_max52.94999999999913
survival_time_mean36.949999999999775
survival_time_min17.25000000000011
No reset possible
585176852Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:11:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5240190696856952
survival_time_median19.475000000000147
deviation-center-line_median0.8513289698196783
in-drivable-lane_median7.150000000000059


other stats
agent_compute-ego0_max0.013531981952606685
agent_compute-ego0_mean0.012720114649187916
agent_compute-ego0_median0.01268763880603122
agent_compute-ego0_min0.011973199032082542
complete-iteration_max0.21073509235771337
complete-iteration_mean0.18926134044556173
complete-iteration_median0.191713508524512
complete-iteration_min0.16288325237550946
deviation-center-line_max1.872857122116128
deviation-center-line_mean0.9509368884469848
deviation-center-line_min0.22823249203245383
deviation-heading_max8.592933225157614
deviation-heading_mean4.734570651683564
deviation-heading_median4.859731153875548
deviation-heading_min0.625887073825545
driven_any_max7.161183210697387
driven_any_mean3.897188872646371
driven_any_median3.678140197237401
driven_any_min1.071291885413297
driven_lanedir_consec_max2.5565599558454064
driven_lanedir_consec_mean1.5395192168775471
driven_lanedir_consec_min0.5534787722933927
driven_lanedir_max3.5382427218958483
driven_lanedir_mean1.7849399083901578
driven_lanedir_median1.5240190696856952
driven_lanedir_min0.5534787722933927
get_duckie_state_max1.404020521375868e-06
get_duckie_state_mean1.321567945579272e-06
get_duckie_state_median1.313490601258453e-06
get_duckie_state_min1.255270058424315e-06
get_robot_state_max0.0037592875092563567
get_robot_state_mean0.0036881118760337074
get_robot_state_median0.0036793564258435457
get_robot_state_min0.003634447143191383
get_state_dump_max0.005276980043268528
get_state_dump_mean0.00480875822400765
get_state_dump_median0.0046781514745214406
get_state_dump_min0.00460174990371919
get_ui_image_max0.03589555844157732
get_ui_image_mean0.031061219197455636
get_ui_image_median0.030911358783848996
get_ui_image_min0.02652660078054723
in-drivable-lane_max20.94999999999998
in-drivable-lane_mean9.575000000000022
in-drivable-lane_min3.049999999999989
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.161183210697387, "get_ui_image": 0.028805210892583283, "step_physics": 0.11696816531705184, "survival_time": 35.450000000000124, "driven_lanedir": 2.3467882866669756, "get_state_dump": 0.00460174990371919, "get_robot_state": 0.003685435107056524, "sim_render-ego0": 0.003789747265023245, "get_duckie_state": 1.2921615385673415e-06, "in-drivable-lane": 20.94999999999998, "deviation-heading": 8.592933225157614, "agent_compute-ego0": 0.01265436998555358, "complete-iteration": 0.1850913675738053, "set_robot_commands": 0.0021881872499492807, "deviation-center-line": 1.3378200799834203, "driven_lanedir_consec": 2.3467882866669756, "sim_compute_sim_state": 0.010292949139232366, "sim_compute_performance-ego0": 0.002013985539825869}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2746908710611196, "get_ui_image": 0.03589555844157732, "step_physics": 0.13547427638047407, "survival_time": 7.299999999999982, "driven_lanedir": 0.7012498527044149, "get_state_dump": 0.005276980043268528, "get_robot_state": 0.0036732777446305672, "sim_render-ego0": 0.003727434443778732, "get_duckie_state": 1.334819663949564e-06, "in-drivable-lane": 3.049999999999989, "deviation-heading": 1.7829688026092236, "agent_compute-ego0": 0.012720907626508855, "complete-iteration": 0.21073509235771337, "set_robot_commands": 0.0022104094628574086, "deviation-center-line": 0.36483785965593635, "driven_lanedir_consec": 0.7012498527044149, "sim_compute_sim_state": 0.009733766114630667, "sim_compute_performance-ego0": 0.0019354804032513885}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.071291885413297, "get_ui_image": 0.03301750667511471, "step_physics": 0.12691700080084423, "survival_time": 6.249999999999986, "driven_lanedir": 0.5534787722933927, "get_state_dump": 0.0047326333939083035, "get_robot_state": 0.003634447143191383, "sim_render-ego0": 0.0038782623079088, "get_duckie_state": 1.404020521375868e-06, "in-drivable-lane": 3.149999999999989, "deviation-heading": 0.625887073825545, "agent_compute-ego0": 0.013531981952606685, "complete-iteration": 0.19833564947521876, "set_robot_commands": 0.0022142784936087473, "deviation-center-line": 0.22823249203245383, "driven_lanedir_consec": 0.5534787722933927, "sim_compute_sim_state": 0.00829764207204183, "sim_compute_performance-ego0": 0.0020144364190480065}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.081589523413682, "get_ui_image": 0.02652660078054723, "step_physics": 0.10153586029630354, "survival_time": 31.650000000000315, "driven_lanedir": 3.5382427218958483, "get_state_dump": 0.004623669555134578, "get_robot_state": 0.0037592875092563567, "sim_render-ego0": 0.0038193558292810097, "get_duckie_state": 1.255270058424315e-06, "in-drivable-lane": 11.15000000000013, "deviation-heading": 7.936493505141872, "agent_compute-ego0": 0.011973199032082542, "complete-iteration": 0.16288325237550946, "set_robot_commands": 0.0022271615849684466, "deviation-center-line": 1.872857122116128, "driven_lanedir_consec": 2.5565599558454064, "sim_compute_sim_state": 0.006254818913312365, "sim_compute_performance-ego0": 0.0020752347982268228}}
set_robot_commands_max0.0022271615849684466
set_robot_commands_mean0.0022100091978459707
set_robot_commands_median0.002212343978233078
set_robot_commands_min0.0021881872499492807
sim_compute_performance-ego0_max0.0020752347982268228
sim_compute_performance-ego0_mean0.002009784290088022
sim_compute_performance-ego0_median0.0020142109794369376
sim_compute_performance-ego0_min0.0019354804032513885
sim_compute_sim_state_max0.010292949139232366
sim_compute_sim_state_mean0.008644794059804306
sim_compute_sim_state_median0.009015704093336248
sim_compute_sim_state_min0.006254818913312365
sim_render-ego0_max0.0038782623079088
sim_render-ego0_mean0.003803699961497947
sim_render-ego0_median0.003804551547152127
sim_render-ego0_min0.003727434443778732
simulation-passed1
step_physics_max0.13547427638047407
step_physics_mean0.12022382569866844
step_physics_median0.12194258305894803
step_physics_min0.10153586029630354
survival_time_max35.450000000000124
survival_time_mean20.1625000000001
survival_time_min6.249999999999986
No reset possible
584649255Jerome LabonteΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:30:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.90973020276577
survival_time_median59.99999999999873
deviation-center-line_median3.653488213488563
in-drivable-lane_median3.124999999999913


other stats
agent_compute-ego0_max0.013101722278960242
agent_compute-ego0_mean0.012883695866303134
agent_compute-ego0_median0.012943441788536526
agent_compute-ego0_min0.01254617760917924
complete-iteration_max0.2143140952851155
complete-iteration_mean0.1850799464633769
complete-iteration_median0.1822185486719368
complete-iteration_min0.1615685932245183
deviation-center-line_max4.129043031955287
deviation-center-line_mean3.268425385313492
deviation-center-line_min1.6376820823215548
deviation-heading_max19.106087575170715
deviation-heading_mean11.968858912280428
deviation-heading_median11.269202423626776
deviation-heading_min6.230943226697443
driven_any_max12.125958105800242
driven_any_mean8.918270907805367
driven_any_median9.807232750025149
driven_any_min3.932660025370928
driven_lanedir_consec_max11.748658582789458
driven_lanedir_consec_mean7.207295131600916
driven_lanedir_consec_min3.2610615380826644
driven_lanedir_max11.748658582789458
driven_lanedir_mean8.28063082147185
driven_lanedir_median9.050339843128151
driven_lanedir_min3.273185016841635
get_duckie_state_max1.5833693479717425e-06
get_duckie_state_mean1.5101486711527471e-06
get_duckie_state_median1.5345982199107452e-06
get_duckie_state_min1.388028896817756e-06
get_robot_state_max0.004087995033677075
get_robot_state_mean0.003875225495591072
get_robot_state_median0.003842781993677215
get_robot_state_min0.00372734296133278
get_state_dump_max0.005101583680939813
get_state_dump_mean0.004956541002683074
get_state_dump_median0.00496673145032738
get_state_dump_min0.004791117429137726
get_ui_image_max0.037129590751527254
get_ui_image_mean0.031152512659078
get_ui_image_median0.03035044501591357
get_ui_image_min0.026779569852957617
in-drivable-lane_max3.5000000000000355
in-drivable-lane_mean2.8624999999999714
in-drivable-lane_min1.7000000000000242
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.125958105800242, "get_ui_image": 0.028943443179229814, "step_physics": 0.10347260960333551, "survival_time": 59.99999999999873, "driven_lanedir": 11.748658582789458, "get_state_dump": 0.005029663654489382, "get_robot_state": 0.0038747932392790554, "sim_render-ego0": 0.004014793383291024, "get_duckie_state": 1.496816058639285e-06, "in-drivable-lane": 1.7000000000000242, "deviation-heading": 8.655546972646226, "agent_compute-ego0": 0.01307113422740012, "complete-iteration": 0.17281216824680046, "set_robot_commands": 0.0023068806015383095, "deviation-center-line": 3.364791070243221, "driven_lanedir_consec": 11.748658582789458, "sim_compute_sim_state": 0.009806687587703098, "sim_compute_performance-ego0": 0.002192325933489772}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.40271898745405, "get_ui_image": 0.037129590751527254, "step_physics": 0.13394319762993018, "survival_time": 59.99999999999873, "driven_lanedir": 8.49121372275058, "get_state_dump": 0.005101583680939813, "get_robot_state": 0.004087995033677075, "sim_render-ego0": 0.004165697058074977, "get_duckie_state": 1.5833693479717425e-06, "in-drivable-lane": 3.0999999999998984, "deviation-heading": 19.106087575170715, "agent_compute-ego0": 0.013101722278960242, "complete-iteration": 0.2143140952851155, "set_robot_commands": 0.0024039598428438743, "deviation-center-line": 4.129043031955287, "driven_lanedir_consec": 5.793953531456659, "sim_compute_sim_state": 0.011942933342240437, "sim_compute_performance-ego0": 0.002335228788961876}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.932660025370928, "get_ui_image": 0.03175744685259732, "step_physics": 0.11915145481913544, "survival_time": 24.150000000000208, "driven_lanedir": 3.273185016841635, "get_state_dump": 0.004903799246165378, "get_robot_state": 0.003810770748075375, "sim_render-ego0": 0.003871083259582519, "get_duckie_state": 1.5723803811822055e-06, "in-drivable-lane": 3.5000000000000355, "deviation-heading": 6.230943226697443, "agent_compute-ego0": 0.012815749349672933, "complete-iteration": 0.19162492909707313, "set_robot_commands": 0.0022959068786999413, "deviation-center-line": 1.6376820823215548, "driven_lanedir_consec": 3.2610615380826644, "sim_compute_sim_state": 0.010845384321922114, "sim_compute_performance-ego0": 0.002074668230104052}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.211746512596248, "get_ui_image": 0.026779569852957617, "step_physics": 0.09923003932816302, "survival_time": 59.99999999999873, "driven_lanedir": 9.609465963505723, "get_state_dump": 0.004791117429137726, "get_robot_state": 0.00372734296133278, "sim_render-ego0": 0.0038425860853616048, "get_duckie_state": 1.388028896817756e-06, "in-drivable-lane": 3.1499999999999275, "deviation-heading": 13.882857874607328, "agent_compute-ego0": 0.01254617760917924, "complete-iteration": 0.1615685932245183, "set_robot_commands": 0.0022376850185346644, "deviation-center-line": 3.942185356733906, "driven_lanedir_consec": 8.025506874074882, "sim_compute_sim_state": 0.006294693180563845, "sim_compute_performance-ego0": 0.002027747831574884}}
set_robot_commands_max0.0024039598428438743
set_robot_commands_mean0.0023111080854041973
set_robot_commands_median0.002301393740119126
set_robot_commands_min0.0022376850185346644
sim_compute_performance-ego0_max0.002335228788961876
sim_compute_performance-ego0_mean0.002157492696032646
sim_compute_performance-ego0_median0.002133497081796912
sim_compute_performance-ego0_min0.002027747831574884
sim_compute_sim_state_max0.011942933342240437
sim_compute_sim_state_mean0.009722424608107372
sim_compute_sim_state_median0.010326035954812605
sim_compute_sim_state_min0.006294693180563845
sim_render-ego0_max0.004165697058074977
sim_render-ego0_mean0.003973539946577531
sim_render-ego0_median0.003942938321436771
sim_render-ego0_min0.0038425860853616048
simulation-passed1
step_physics_max0.13394319762993018
step_physics_mean0.11394932534514104
step_physics_median0.11131203221123548
step_physics_min0.09923003932816302
survival_time_max59.99999999999873
survival_time_mean51.0374999999991
survival_time_min24.150000000000208
No reset possible
5842512737Thomas WiggersΒ πŸ‡³πŸ‡±ppo_v1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:27:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.005842514583398
survival_time_median48.84999999999936
deviation-center-line_median1.4327743733040914
in-drivable-lane_median16.224999999999604


other stats
agent_compute-ego0_max0.08254542761291099
agent_compute-ego0_mean0.06769732685991768
agent_compute-ego0_median0.07910213998513456
agent_compute-ego0_min0.030039599856490608
complete-iteration_max0.2702517648406376
complete-iteration_mean0.22847649819711888
complete-iteration_median0.22402530268368176
complete-iteration_min0.19560362258047428
deviation-center-line_max1.727448202272121
deviation-center-line_mean1.206958210469721
deviation-center-line_min0.23483589299857993
deviation-heading_max8.242515626645647
deviation-heading_mean5.68190415981711
deviation-heading_median6.4589238912184825
deviation-heading_min1.567253230185828
driven_any_max8.257641686220643
driven_any_mean5.158522104789978
driven_any_median5.65968531786957
driven_any_min1.05707609720013
driven_lanedir_consec_max6.234609611855749
driven_lanedir_consec_mean3.2280041590129795
driven_lanedir_consec_min0.665721995029373
driven_lanedir_max6.412127692860614
driven_lanedir_mean3.746936079760564
driven_lanedir_median3.953638465950234
driven_lanedir_min0.6683396942811742
get_duckie_state_max1.6254548923260564e-06
get_duckie_state_mean1.459765131108965e-06
get_duckie_state_median1.455370203796969e-06
get_duckie_state_min1.3028652245158656e-06
get_robot_state_max0.003976332746594157
get_robot_state_mean0.003884169178249125
get_robot_state_median0.003922969269070429
get_robot_state_min0.003714405428261483
get_state_dump_max0.005045066963723061
get_state_dump_mean0.00490692857439917
get_state_dump_median0.004906278894079576
get_state_dump_min0.004770089545714468
get_ui_image_max0.03841703332812581
get_ui_image_mean0.03198304348199626
get_ui_image_median0.031097978323379516
get_ui_image_min0.0273191839531002
in-drivable-lane_max17.84999999999985
in-drivable-lane_mean13.46249999999976
in-drivable-lane_min3.5499999999999874
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.257641686220643, "get_ui_image": 0.030570448884161983, "step_physics": 0.09646465498442255, "survival_time": 59.99999999999873, "driven_lanedir": 6.412127692860614, "get_state_dump": 0.005045066963723061, "get_robot_state": 0.003939396137996677, "sim_render-ego0": 0.004081560511275394, "get_duckie_state": 1.6254548923260564e-06, "in-drivable-lane": 16.949999999999037, "deviation-heading": 7.185590887937301, "agent_compute-ego0": 0.07698949389811062, "complete-iteration": 0.2321008264174767, "set_robot_commands": 0.002402496576110687, "deviation-center-line": 1.727448202272121, "driven_lanedir_consec": 6.234609611855749, "sim_compute_sim_state": 0.01027501631934478, "sim_compute_performance-ego0": 0.002231095454575716}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.813859977277248, "get_ui_image": 0.03841703332812581, "step_physics": 0.11945498352808669, "survival_time": 37.7, "driven_lanedir": 2.019043075749777, "get_state_dump": 0.004920721369863346, "get_robot_state": 0.003976332746594157, "sim_render-ego0": 0.004162138503118856, "get_duckie_state": 1.4232483920672082e-06, "in-drivable-lane": 17.84999999999985, "deviation-heading": 8.242515626645647, "agent_compute-ego0": 0.08254542761291099, "complete-iteration": 0.2702517648406376, "set_robot_commands": 0.002324953773953267, "deviation-center-line": 1.2840388783336976, "driven_lanedir_consec": 1.4861844484571298, "sim_compute_sim_state": 0.012108769322073222, "sim_compute_performance-ego0": 0.002248742880410706}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.05707609720013, "get_ui_image": 0.031625507762597045, "step_physics": 0.1084520771818341, "survival_time": 7.89999999999998, "driven_lanedir": 0.6683396942811742, "get_state_dump": 0.004891836418295806, "get_robot_state": 0.0039065424001441815, "sim_render-ego0": 0.003885769994003967, "get_duckie_state": 1.4874920155267297e-06, "in-drivable-lane": 3.5499999999999874, "deviation-heading": 1.567253230185828, "agent_compute-ego0": 0.030039599856490608, "complete-iteration": 0.19560362258047428, "set_robot_commands": 0.002206324031517941, "deviation-center-line": 0.23483589299857993, "driven_lanedir_consec": 0.665721995029373, "sim_compute_sim_state": 0.008454540240689644, "sim_compute_performance-ego0": 0.0020466930461379715}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.505510658461892, "get_ui_image": 0.0273191839531002, "step_physics": 0.08494178837880206, "survival_time": 59.99999999999873, "driven_lanedir": 5.888233856150691, "get_state_dump": 0.004770089545714468, "get_robot_state": 0.003714405428261483, "sim_render-ego0": 0.0038422257775172506, "get_duckie_state": 1.3028652245158656e-06, "in-drivable-lane": 15.500000000000174, "deviation-heading": 5.732256894499663, "agent_compute-ego0": 0.0812147860721585, "complete-iteration": 0.21594977894988684, "set_robot_commands": 0.002245128402900537, "deviation-center-line": 1.5815098682744857, "driven_lanedir_consec": 4.525500580709666, "sim_compute_sim_state": 0.005798677719205146, "sim_compute_performance-ego0": 0.002018840187892231}}
set_robot_commands_max0.002402496576110687
set_robot_commands_mean0.002294725696120608
set_robot_commands_median0.002285041088426902
set_robot_commands_min0.002206324031517941
sim_compute_performance-ego0_max0.002248742880410706
sim_compute_performance-ego0_mean0.002136342892254156
sim_compute_performance-ego0_median0.0021388942503568435
sim_compute_performance-ego0_min0.002018840187892231
sim_compute_sim_state_max0.012108769322073222
sim_compute_sim_state_mean0.009159250900328198
sim_compute_sim_state_median0.009364778280017211
sim_compute_sim_state_min0.005798677719205146
sim_render-ego0_max0.004162138503118856
sim_render-ego0_mean0.0039929236964788666
sim_render-ego0_median0.003983665252639681
sim_render-ego0_min0.0038422257775172506
simulation-passed1
step_physics_max0.11945498352808669
step_physics_mean0.10232837601828636
step_physics_median0.10245836608312832
step_physics_min0.08494178837880206
survival_time_max59.99999999999873
survival_time_mean41.39999999999936
survival_time_min7.89999999999998
No reset possible
584089275Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
583989277Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:02:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
583839294Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:03:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
583739295Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:03:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
583639297Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:02:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.