Evaluator 4920

template-pytorch

LFv-sim

host-error

yes

2020-12-07 12:40:36+00:00

2020-12-07 12:41:11+00:00

0:00:35

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60143

11012

template-pytorch

LFv-sim

host-error

yes

2020-12-07 12:39:37+00:00

2020-12-07 12:40:04+00:00

0:00:27

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60138

11010

template-pytorch

LFv-sim

host-error

yes

2020-12-07 12:38:09+00:00

2020-12-07 12:38:37+00:00

0:00:28

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60135

11010

template-pytorch

LFv-sim

host-error

yes

2020-12-07 12:37:13+00:00

2020-12-07 12:37:49+00:00

0:00:36

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60131

template-pytorch

LFv-sim

host-error

yes

2020-12-07 12:36:12+00:00

2020-12-07 12:36:49+00:00

0:00:37

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60125

template-pytorch

LFv-sim

host-error

yes

2020-12-07 12:34:07+00:00

2020-12-07 12:34:41+00:00

0:00:34

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60123

template-pytorch

LFv-sim

host-error

yes

2020-12-07 12:33:11+00:00

2020-12-07 12:33:47+00:00

0:00:36

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

60004

11772

Ehsan Ahmadi 🇨🇦

template-random

LFv-sim

host-error

yes

2020-12-07 11:45:32+00:00

2020-12-07 11:45:55+00:00

0:00:23

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59953

11425

Frank (Chude) Qian 🇨🇦

template-pytorch

LFP-sim

host-error

yes

2020-12-07 10:40:38+00:00

2020-12-07 10:41:19+00:00

0:00:41

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59948

11425

Frank (Chude) Qian 🇨🇦

template-pytorch

LFP-sim

host-error

yes

2020-12-07 10:39:16+00:00

2020-12-07 10:39:57+00:00

0:00:41

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59927

12671

Bea Baselines 🐤

baseline-duckietown

LFP-sim

host-error

yes

2020-12-07 10:35:59+00:00

2020-12-07 10:37:57+00:00

0:01:58

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59135

10357

Liam Paull 🇨🇦

exercise_ros_template

aido5-LF-sanity

sanity-check

host-error

yes

aido5-LFI-sim-validation

2020-12-05 13:02:53+00:00

2020-12-05 14:05:14+00:00

1:02:21

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [e848bc0b768482dc073e839482f2bf9f55bc35c0a536f0e5977c1b5cf729f2bc,
│                 5129649a6980f4a62cf17abbcf0b5f957aff28955d05c17c3425fabb8b4839da,
│                 f8ffc2b1da601a0aa149f57817da0c85da9d1904ca5536e2f96a863d9481fb1e]
│      services: dict[4]
│                │ solution:
│                │ dict[6]
│                │ │ image: docker.io/liampaull/aido-submissions@sha256:0e6149fb63f05b53e2772095f6186214ca66a9ff55fade22eb7d8d822a931cf8
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10357
│                │ │ │ submitter_name: Liam Paull
│                │ │ │ SUBMISSION_CONTAINER: docker.io/liampaull/aido-submissions:2020_10_03_21_36_43@sha256:0e6149fb63f05b53e2772095f6186214ca66a9ff55fade22eb7d8d822a931cf8
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-08_00a1f415cc0e}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_54-19644/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ evaluator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:9f8c352de4d76e7de198d4dea8278469907949f1ca0595b4e2e12c509be34491
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 0.5
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |
│                │ │ │ |port: 10123 # visualization port
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10357
│                │ │ │ submitter_name: Liam Paull
│                │ │ │ SUBMISSION_CONTAINER: docker.io/liampaull/aido-submissions:2020_10_03_21_36_43@sha256:0e6149fb63f05b53e2772095f6186214ca66a9ff55fade22eb7d8d822a931cf8
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-08_00a1f415cc0e}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_54-19644/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:af0283a494930b4d3448453526d9c22469233f65218cb6c37753c3aae5162cbb
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10357
│                │ │ │ submitter_name: Liam Paull
│                │ │ │ SUBMISSION_CONTAINER: docker.io/liampaull/aido-submissions:2020_10_03_21_36_43@sha256:0e6149fb63f05b53e2772095f6186214ca66a9ff55fade22eb7d8d822a931cf8
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-08_00a1f415cc0e}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_54-19644/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ scenario_maker:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:e980f12a61e1e1b37982b6b2a5bc22ef89144f627bf1e6ebaeeac554e4bfb877
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |maps:
│                │ │ │ |- udem1
│                │ │ │ |scenarios_per_map: 1
│                │ │ │ |robots_npcs: []
│                │ │ │ |robots_pcs: [ego]
│                │ │ │ |robots_parked: [parked]
│                │ │ │ |nduckies: 1
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/scenario_maker-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
│                │ │ │ challenge_name: aido5-LF-sanity
│                │ │ │ challenge_step_name: sanity-check
│                │ │ │ submission_id: 10357
│                │ │ │ submitter_name: Liam Paull
│                │ │ │ SUBMISSION_CONTAINER: docker.io/liampaull/aido-submissions:2020_10_03_21_36_43@sha256:0e6149fb63f05b53e2772095f6186214ca66a9ff55fade22eb7d8d822a931cf8
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-08_00a1f415cc0e}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sanity/submission10357/sanity-check-nogpu-prod-08_00a1f415cc0e-job59135-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_54-19644/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[3]
│                │ evaluator: e848bc0b768482dc073e839482f2bf9f55bc35c0a536f0e5977c1b5cf729f2bc
│                │ simulator: 5129649a6980f4a62cf17abbcf0b5f957aff28955d05c17c3425fabb8b4839da
│                │ solution: f8ffc2b1da601a0aa149f57817da0c85da9d1904ca5536e2f96a863d9481fb1e
│         names: dict[3]
│                │ e848bc0b768482dc073e839482f2bf9f55bc35c0a536f0e5977c1b5cf729f2bc: nogpu-prod-08_00a1f415cc0e-job59135-528013_evaluator_1
│                │ 5129649a6980f4a62cf17abbcf0b5f957aff28955d05c17c3425fabb8b4839da: nogpu-prod-08_00a1f415cc0e-job59135-528013_simulator_1
│                │ f8ffc2b1da601a0aa149f57817da0c85da9d1904ca5536e2f96a863d9481fb1e: nogpu-prod-08_00a1f415cc0e-job59135-528013_solution_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |e848bc0b768482dc073e839482f2bf9f55bc35c0a536f0e5977c1b5cf729f2bc
│         |5129649a6980f4a62cf17abbcf0b5f957aff28955d05c17c3425fabb8b4839da
│         |f8ffc2b1da601a0aa149f57817da0c85da9d1904ca5536e2f96a863d9481fb1e
│         |
│  names: dict[3]
│         │ e848bc0b768482dc073e839482f2bf9f55bc35c0a536f0e5977c1b5cf729f2bc: nogpu-prod-08_00a1f415cc0e-job59135-528013_evaluator_1
│         │ 5129649a6980f4a62cf17abbcf0b5f957aff28955d05c17c3425fabb8b4839da: nogpu-prod-08_00a1f415cc0e-job59135-528013_simulator_1
│         │ f8ffc2b1da601a0aa149f57817da0c85da9d1904ca5536e2f96a863d9481fb1e: nogpu-prod-08_00a1f415cc0e-job59135-528013_solution_1

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

59109

12890

Robert Moni 🇭🇺

speedRL

LFVIv-sim

success

yes

aido5-LFV-sim-validation

2020-12-04 20:39:35+00:00

2020-12-04 21:01:39+00:00

0:22:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	17.593795965957504
survival_time_median	59.99999999999873
deviation-center-line_median	2.171310815072931
in-drivable-lane_median	0.900000000000003

other stats

agent_compute-ego0_max	0.02544409984553684
agent_compute-ego0_mean	0.024934060865397456
agent_compute-ego0_median	0.024934060865397456
agent_compute-ego0_min	0.024424021885258072
complete-iteration_max	0.24580511919763265
complete-iteration_mean	0.2437615863091741
complete-iteration_median	0.2437615863091741
complete-iteration_min	0.2417180534207156
deviation-center-line_max	2.315201812251505
deviation-center-line_mean	2.171310815072931
deviation-center-line_min	2.027419817894357
deviation-heading_max	7.358879207793444
deviation-heading_mean	7.230623024595653
deviation-heading_median	7.230623024595653
deviation-heading_min	7.1023668413978625
driven_any_max	19.042290082112377
driven_any_mean	18.79994074809764
driven_any_median	18.79994074809764
driven_any_min	18.557591414082907
driven_lanedir_consec_max	18.61401489607207
driven_lanedir_consec_mean	17.593795965957504
driven_lanedir_consec_min	16.573577035842934
driven_lanedir_max	18.85602369132867
driven_lanedir_mean	18.326709778572717
driven_lanedir_median	18.326709778572717
driven_lanedir_min	17.797395865816764
get_duckie_state_max	1.2570078625071554e-06
get_duckie_state_mean	1.2378509991571965e-06
get_duckie_state_median	1.2378509991571965e-06
get_duckie_state_min	1.2186941358072375e-06
get_robot_state_max	0.0036889966778910033
get_robot_state_mean	0.0035754872003661703
get_robot_state_median	0.0035754872003661703
get_robot_state_min	0.0034619777228413373
get_state_dump_max	0.004563005242518441
get_state_dump_mean	0.00447859752188118
get_state_dump_median	0.00447859752188118
get_state_dump_min	0.004394189801243918
get_ui_image_max	0.03754155145497445
get_ui_image_mean	0.03703268461680036
get_ui_image_median	0.03703268461680036
get_ui_image_min	0.036523817778626254
in-drivable-lane_max	1.800000000000006
in-drivable-lane_mean	0.900000000000003
in-drivable-lane_min	0.0
per-episodes	details {"LFI-norm-4way-000-ego0": {"driven_any": 18.557591414082907, "get_ui_image": 0.036523817778626254, "step_physics": 0.15334233217294965, "survival_time": 59.99999999999873, "driven_lanedir": 17.797395865816764, "get_state_dump": 0.004394189801243918, "get_robot_state": 0.0034619777228413373, "sim_render-ego0": 0.0036847021657163952, "get_duckie_state": 1.2570078625071554e-06, "in-drivable-lane": 1.800000000000006, "deviation-heading": 7.358879207793444, "agent_compute-ego0": 0.024424021885258072, "complete-iteration": 0.2417180534207156, "set_robot_commands": 0.0020606746085974495, "deviation-center-line": 2.027419817894357, "driven_lanedir_consec": 16.573577035842934, "sim_compute_sim_state": 0.011854696234100367, "sim_compute_performance-ego0": 0.0018905594783659085}, "LFI-norm-udem1-000-ego0": {"driven_any": 19.042290082112377, "get_ui_image": 0.03754155145497445, "step_physics": 0.15352883724050656, "survival_time": 59.99999999999873, "driven_lanedir": 18.85602369132867, "get_state_dump": 0.004563005242518441, "get_robot_state": 0.0036889966778910033, "sim_render-ego0": 0.0038984574247260175, "get_duckie_state": 1.2186941358072375e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.1023668413978625, "agent_compute-ego0": 0.02544409984553684, "complete-iteration": 0.24580511919763265, "set_robot_commands": 0.0022186806160246304, "deviation-center-line": 2.315201812251505, "driven_lanedir_consec": 18.61401489607207, "sim_compute_sim_state": 0.012790800828322284, "sim_compute_performance-ego0": 0.002045424752787289}}
set_robot_commands_max	0.0022186806160246304
set_robot_commands_mean	0.00213967761231104
set_robot_commands_median	0.00213967761231104
set_robot_commands_min	0.0020606746085974495
sim_compute_performance-ego0_max	0.002045424752787289
sim_compute_performance-ego0_mean	0.001967992115576598
sim_compute_performance-ego0_median	0.001967992115576598
sim_compute_performance-ego0_min	0.0018905594783659085
sim_compute_sim_state_max	0.012790800828322284
sim_compute_sim_state_mean	0.012322748531211326
sim_compute_sim_state_median	0.012322748531211326
sim_compute_sim_state_min	0.011854696234100367
sim_render-ego0_max	0.0038984574247260175
sim_render-ego0_mean	0.0037915797952212064
sim_render-ego0_median	0.0037915797952212064
sim_render-ego0_min	0.0036847021657163952
simulation-passed	1
step_physics_max	0.15352883724050656
step_physics_mean	0.1534355847067281
step_physics_median	0.1534355847067281
step_physics_min	0.15334233217294965
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

59084

12891

Robert Moni 🇭🇺

speedRL

LFVv-sim

success

yes

2020-12-04 19:54:37+00:00

2020-12-04 20:28:32+00:00

0:33:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.491301137317526
survival_time_median	12.600000000000044
deviation-center-line_median	0.395833475492908
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.027903964803537303
agent_compute-ego0_mean	0.027243209525040127
agent_compute-ego0_median	0.02717724178129209
agent_compute-ego0_min	0.026714389734039026
agent_compute-npc0_max	0.027492057909524387
agent_compute-npc0_mean	0.02336680093181987
agent_compute-npc0_median	0.022043171575972353
agent_compute-npc0_min	0.0218888026658104
agent_compute-npc1_max	0.032701634327857505
agent_compute-npc1_mean	0.030705730826100026
agent_compute-npc1_median	0.029811896611509365
agent_compute-npc1_min	0.02960366153893321
agent_compute-npc2_max	0.0380444879566289
agent_compute-npc2_mean	0.03085665674912752
agent_compute-npc2_median	0.027303076936224698
agent_compute-npc2_min	0.027222405354528967
agent_compute-npc3_max	0.043105441930512675
agent_compute-npc3_mean	0.03778672861378782
agent_compute-npc3_median	0.03778672861378782
agent_compute-npc3_min	0.032468015297062953
complete-iteration_max	1.3005478330054137
complete-iteration_mean	1.017411023908863
complete-iteration_median	1.1741790075536698
complete-iteration_min	0.4207382475226986
deviation-center-line_max	0.7023422350010549
deviation-center-line_mean	0.44831814934872866
deviation-center-line_min	0.2992634114080437
deviation-heading_max	3.399581443165017
deviation-heading_mean	1.9030759839681035
deviation-heading_median	1.521345094452877
deviation-heading_min	1.1700323038016436
driven_any_max	7.920105151011589
driven_any_mean	4.511588178277194
driven_any_median	3.5282144585958504
driven_any_min	3.069818644905483
driven_lanedir_consec_max	7.821314842532765
driven_lanedir_consec_mean	4.459651514770321
driven_lanedir_consec_min	3.0346889419134664
driven_lanedir_max	7.821314842532765
driven_lanedir_mean	4.459651514770321
driven_lanedir_median	3.491301137317526
driven_lanedir_min	3.0346889419134664
get_duckie_state_max	1.8221376604982232e-06
get_duckie_state_mean	1.6308334598106068e-06
get_duckie_state_median	1.6505717326708182e-06
get_duckie_state_min	1.4000527134025677e-06
get_robot_state_max	0.018356491905112453
get_robot_state_mean	0.01504060559595549
get_robot_state_median	0.016932629480624576
get_robot_state_min	0.007940671517460357
get_state_dump_max	0.011486470959592597
get_state_dump_mean	0.009920160554954554
get_state_dump_median	0.010734601714859453
get_state_dump_min	0.006724967830506716
get_ui_image_max	0.0557430676303377
get_ui_image_mean	0.048417181628684365
get_ui_image_median	0.051677454099179614
get_ui_image_min	0.034570750686040534
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LFV-norm-loop-000-ego0": {"driven_any": 3.8304443698299537, "get_ui_image": 0.04942804467376819, "step_physics": 0.7988235649219059, "survival_time": 13.80000000000006, "driven_lanedir": 3.782719866554227, "get_state_dump": 0.010229772609063437, "get_robot_state": 0.01555122967661503, "sim_render-ego0": 0.004174553530310896, "sim_render-npc0": 0.004198307595098062, "sim_render-npc1": 0.004190280549362678, "sim_render-npc2": 0.004311007282794168, "get_duckie_state": 1.8221376604982232e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.8037055376703832, "agent_compute-ego0": 0.027903964803537303, "agent_compute-npc0": 0.022134922902076252, "agent_compute-npc1": 0.032701634327857505, "agent_compute-npc2": 0.0380444879566289, "complete-iteration": 1.0582660681934564, "set_robot_commands": 0.0025828512997403473, "deviation-center-line": 0.4242111266333478, "driven_lanedir_consec": 3.782719866554227, "sim_compute_sim_state": 0.027313421779591257, "sim_compute_performance-ego0": 0.0023109301763321087, "sim_compute_performance-npc0": 0.0021949416893914287, "sim_compute_performance-npc1": 0.0021616112884631656, "sim_compute_performance-npc2": 0.0022279424357500317}, "LFV-norm-zigzag-000-ego0": {"driven_any": 7.920105151011589, "get_ui_image": 0.0557430676303377, "step_physics": 0.96312721291223, "survival_time": 27.00000000000025, "driven_lanedir": 7.821314842532765, "get_state_dump": 0.01123943082065547, "get_robot_state": 0.018314029284634124, "sim_render-ego0": 0.004032784601236227, "sim_render-npc0": 0.00398321909737014, "sim_render-npc1": 0.004092686277660997, "sim_render-npc2": 0.004069309798714855, "sim_render-npc3": 0.004007742717834585, "get_duckie_state": 1.5957738908073158e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.399581443165017, "agent_compute-ego0": 0.026714389734039026, "agent_compute-npc0": 0.02195142024986845, "agent_compute-npc1": 0.02960366153893321, "agent_compute-npc2": 0.027303076936224698, "agent_compute-npc3": 0.032468015297062953, "complete-iteration": 1.2900919469138832, "set_robot_commands": 0.0023926340057316637, "deviation-center-line": 0.7023422350010549, "driven_lanedir_consec": 7.821314842532765, "sim_compute_sim_state": 0.06095821667951488, "sim_compute_performance-ego0": 0.0021999662332305627, "sim_compute_performance-npc0": 0.001999110699581351, "sim_compute_performance-npc1": 0.002057888591575975, "sim_compute_performance-npc2": 0.002072061055689334, "sim_compute_performance-npc3": 0.0020880183538976305}, "LFV-norm-techtrack-000-ego0": {"driven_any": 3.225984547361747, "get_ui_image": 0.05392686352459104, "step_physics": 0.965448426367414, "survival_time": 11.400000000000029, "driven_lanedir": 3.199882408080825, "get_state_dump": 0.011486470959592597, "get_robot_state": 0.018356491905112453, "sim_render-ego0": 0.004172369902831498, "sim_render-npc0": 0.004013592499312355, "sim_render-npc1": 0.004113602325905879, "sim_render-npc2": 0.004030816940240985, "sim_render-npc3": 0.004156694662102446, "get_duckie_state": 1.7053695745343204e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.1700323038016436, "agent_compute-ego0": 0.02725235031161246, "agent_compute-npc0": 0.0218888026658104, "agent_compute-npc1": 0.029811896611509365, "agent_compute-npc2": 0.027222405354528967, "agent_compute-npc3": 0.043105441930512675, "complete-iteration": 1.3005478330054137, "set_robot_commands": 0.002443965345490968, "deviation-center-line": 0.2992634114080437, "driven_lanedir_consec": 3.199882408080825, "sim_compute_sim_state": 0.05875531971194338, "sim_compute_performance-ego0": 0.002278653815323609, "sim_compute_performance-npc0": 0.0020617272656036777, "sim_compute_performance-npc1": 0.002090824743545732, "sim_compute_performance-npc2": 0.0020433076083920406, "sim_compute_performance-npc3": 0.002102856032192447}, "LFV-norm-small_loop-000-ego0": {"driven_any": 3.069818644905483, "get_ui_image": 0.034570750686040534, "step_physics": 0.2879065248934708, "survival_time": 11.300000000000026, "driven_lanedir": 3.0346889419134664, "get_state_dump": 0.006724967830506716, "get_robot_state": 0.007940671517460357, "sim_render-ego0": 0.004149525176060882, "sim_render-npc0": 0.004092520029009177, "get_duckie_state": 1.4000527134025677e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.2389846512353706, "agent_compute-ego0": 0.027102133250971723, "agent_compute-npc0": 0.027492057909524387, "complete-iteration": 0.4207382475226986, "set_robot_commands": 0.0025495527074200467, "deviation-center-line": 0.36745582435246826, "driven_lanedir_consec": 3.0346889419134664, "sim_compute_sim_state": 0.011223993637488276, "sim_compute_performance-ego0": 0.0021657723162142716, "sim_compute_performance-npc0": 0.0021629753616937983}}
set_robot_commands_max	0.0025828512997403473
set_robot_commands_mean	0.0024922508395957563
set_robot_commands_median	0.0024967590264555074
set_robot_commands_min	0.0023926340057316637
sim_compute_performance-ego0_max	0.0023109301763321087
sim_compute_performance-ego0_mean	0.002238830635275138
sim_compute_performance-ego0_median	0.002239310024277086
sim_compute_performance-ego0_min	0.0021657723162142716
sim_compute_performance-npc0_max	0.0021949416893914287
sim_compute_performance-npc0_mean	0.002104688754067564
sim_compute_performance-npc0_median	0.0021123513136487382
sim_compute_performance-npc0_min	0.001999110699581351
sim_compute_performance-npc1_max	0.0021616112884631656
sim_compute_performance-npc1_mean	0.0021034415411949575
sim_compute_performance-npc1_median	0.002090824743545732
sim_compute_performance-npc1_min	0.002057888591575975
sim_compute_performance-npc2_max	0.0022279424357500317
sim_compute_performance-npc2_mean	0.002114437033277135
sim_compute_performance-npc2_median	0.002072061055689334
sim_compute_performance-npc2_min	0.0020433076083920406
sim_compute_performance-npc3_max	0.002102856032192447
sim_compute_performance-npc3_mean	0.002095437193045038
sim_compute_performance-npc3_median	0.002095437193045038
sim_compute_performance-npc3_min	0.0020880183538976305
sim_compute_sim_state_max	0.06095821667951488
sim_compute_sim_state_mean	0.03956273795213445
sim_compute_sim_state_median	0.04303437074576732
sim_compute_sim_state_min	0.011223993637488276
sim_render-ego0_max	0.004174553530310896
sim_render-ego0_mean	0.004132308302609876
sim_render-ego0_median	0.004160947539446191
sim_render-ego0_min	0.004032784601236227
sim_render-npc0_max	0.004198307595098062
sim_render-npc0_mean	0.004071909805197433
sim_render-npc0_median	0.0040530562641607655
sim_render-npc0_min	0.00398321909737014
sim_render-npc1_max	0.004190280549362678
sim_render-npc1_mean	0.004132189717643185
sim_render-npc1_median	0.004113602325905879
sim_render-npc1_min	0.004092686277660997
sim_render-npc2_max	0.004311007282794168
sim_render-npc2_mean	0.004137044673916669
sim_render-npc2_median	0.004069309798714855
sim_render-npc2_min	0.004030816940240985
sim_render-npc3_max	0.004156694662102446
sim_render-npc3_mean	0.004082218689968515
sim_render-npc3_median	0.004082218689968515
sim_render-npc3_min	0.004007742717834585
simulation-passed	1
step_physics_max	0.965448426367414
step_physics_mean	0.7538264322737551
step_physics_median	0.880975388917068
step_physics_min	0.2879065248934708
survival_time_max	27.00000000000025
survival_time_mean	15.87500000000009
survival_time_min	11.300000000000026

No reset possible

59073

12883

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

LFv-sim

failed

yes

aido5-LFV_multi-sim-validation

2020-12-04 19:41:30+00:00

2020-12-04 19:44:13+00:00

0:02:43

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58953

12773

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

LFVmultibodyv-sim

success

yes

aido5-LFV-sim-validation

2020-12-04 17:04:51+00:00

2020-12-04 19:07:42+00:00

2:02:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	15.346415386512014
survival_time_median	49.39999999999933
deviation-center-line_median	2.5597755489580525
in-drivable-lane_median	1.7000000000000206

other stats

agent_compute-ego0_max	0.06749656283873583
agent_compute-ego0_mean	0.060245422917767806
agent_compute-ego0_median	0.06241882869742693
agent_compute-ego0_min	0.05219425832056059
agent_compute-ego1_max	0.060472028259091544
agent_compute-ego1_mean	0.053799257266843314
agent_compute-ego1_median	0.05707019433490839
agent_compute-ego1_min	0.04612599875254385
complete-iteration_max	1.3643344897471736
complete-iteration_mean	1.1906926110157638
complete-iteration_median	1.3523176699057904
complete-iteration_min	0.45691629829851416
deviation-center-line_max	4.064325800266463
deviation-center-line_mean	2.499764519387145
deviation-center-line_min	1.126777927737872
deviation-heading_max	24.31893113536188
deviation-heading_mean	12.911008260944865
deviation-heading_median	12.523344125212915
deviation-heading_min	5.774264106731368
driven_any_max	27.58168840037928
driven_any_mean	16.647275463668045
driven_any_median	16.406256557884177
driven_any_min	8.048216598365851
driven_lanedir_consec_max	26.79664188602629
driven_lanedir_consec_mean	15.221626462034603
driven_lanedir_consec_min	7.131807685028717
driven_lanedir_max	26.79664188602629
driven_lanedir_mean	15.397262490188703
driven_lanedir_median	15.346415386512014
driven_lanedir_min	7.504602018548223
get_duckie_state_max	1.7219119601779514e-06
get_duckie_state_mean	1.6346293074154795e-06
get_duckie_state_median	1.688456752302673e-06
get_duckie_state_min	1.4338862588264662e-06
get_robot_state_max	0.015659917253700383
get_robot_state_mean	0.014265817366277769
get_robot_state_median	0.015248268511225408
get_robot_state_min	0.0077333980357021615
get_state_dump_max	0.010478935285245992
get_state_dump_mean	0.00965339584770528
get_state_dump_median	0.010028130009609098
get_state_dump_min	0.006598946653138986
get_ui_image_max	0.05100348251844624
get_ui_image_mean	0.04619386850414432
get_ui_image_median	0.04892831263334855
get_ui_image_min	0.03157678512014219
in-drivable-lane_max	25.79999999999911
in-drivable-lane_mean	4.974999999999872
in-drivable-lane_min	0.0
per-episodes	details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 12.315069619456604, "get_ui_image": 0.04595835205263925, "step_physics": 0.8500551916148564, "survival_time": 32.800000000000274, "driven_lanedir": 11.908448927540606, "get_state_dump": 0.010478935285245992, "get_robot_state": 0.015659917253700383, "sim_render-ego0": 0.0042973598933111045, "sim_render-ego1": 0.004093512371069039, "sim_render-ego2": 0.003995772003220278, "sim_render-ego3": 0.004037815323340475, "get_duckie_state": 1.7219119601779514e-06, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 6.741448330248063, "agent_compute-ego0": 0.06749656283873583, "agent_compute-ego1": 0.060472028259091544, "agent_compute-ego2": 0.05635746610400521, "agent_compute-ego3": 0.05312041967789695, "complete-iteration": 1.2223138297529526, "set_robot_commands": 0.0024441250201592524, "deviation-center-line": 1.6314081292929812, "driven_lanedir_consec": 11.908448927540606, "sim_compute_sim_state": 0.02759117876920889, "sim_compute_performance-ego0": 0.002352521844106178, "sim_compute_performance-ego1": 0.0021098324152976954, "sim_compute_performance-ego2": 0.0020679756205194437, "sim_compute_performance-ego3": 0.002104086781564187}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 14.709084979800233, "get_ui_image": 0.04595835205263925, "step_physics": 0.8500551916148564, "survival_time": 32.800000000000274, "driven_lanedir": 14.224898156299233, "get_state_dump": 0.010478935285245992, "get_robot_state": 0.015659917253700383, "sim_render-ego0": 0.0042973598933111045, "sim_render-ego1": 0.004093512371069039, "sim_render-ego2": 0.003995772003220278, "sim_render-ego3": 0.004037815323340475, "get_duckie_state": 1.7219119601779514e-06, "in-drivable-lane": 0.20000000000000284, "deviation-heading": 6.790071772716778, "agent_compute-ego0": 0.06749656283873583, "agent_compute-ego1": 0.060472028259091544, "agent_compute-ego2": 0.05635746610400521, "agent_compute-ego3": 0.05312041967789695, "complete-iteration": 1.2223138297529526, "set_robot_commands": 0.0024441250201592524, "deviation-center-line": 1.5096016405965311, "driven_lanedir_consec": 14.224898156299233, "sim_compute_sim_state": 0.02759117876920889, "sim_compute_performance-ego0": 0.002352521844106178, "sim_compute_performance-ego1": 0.0021098324152976954, "sim_compute_performance-ego2": 0.0020679756205194437, "sim_compute_performance-ego3": 0.002104086781564187}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 8.048216598365851, "get_ui_image": 0.04595835205263925, "step_physics": 0.8500551916148564, "survival_time": 32.800000000000274, "driven_lanedir": 7.504602018548223, "get_state_dump": 0.010478935285245992, "get_robot_state": 0.015659917253700383, "sim_render-ego0": 0.0042973598933111045, "sim_render-ego1": 0.004093512371069039, "sim_render-ego2": 0.003995772003220278, "sim_render-ego3": 0.004037815323340475, "get_duckie_state": 1.7219119601779514e-06, "in-drivable-lane": 11.500000000000108, "deviation-heading": 6.1433342064898975, "agent_compute-ego0": 0.06749656283873583, "agent_compute-ego1": 0.060472028259091544, "agent_compute-ego2": 0.05635746610400521, "agent_compute-ego3": 0.05312041967789695, "complete-iteration": 1.2223138297529526, "set_robot_commands": 0.0024441250201592524, "deviation-center-line": 1.126777927737872, "driven_lanedir_consec": 7.504602018548223, "sim_compute_sim_state": 0.02759117876920889, "sim_compute_performance-ego0": 0.002352521844106178, "sim_compute_performance-ego1": 0.0021098324152976954, "sim_compute_performance-ego2": 0.0020679756205194437, "sim_compute_performance-ego3": 0.002104086781564187}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 8.911193331209567, "get_ui_image": 0.04595835205263925, "step_physics": 0.8500551916148564, "survival_time": 32.800000000000274, "driven_lanedir": 8.576996349763904, "get_state_dump": 0.010478935285245992, "get_robot_state": 0.015659917253700383, "sim_render-ego0": 0.0042973598933111045, "sim_render-ego1": 0.004093512371069039, "sim_render-ego2": 0.003995772003220278, "sim_render-ego3": 0.004037815323340475, "get_duckie_state": 1.7219119601779514e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.258580216935751, "agent_compute-ego0": 0.06749656283873583, "agent_compute-ego1": 0.060472028259091544, "agent_compute-ego2": 0.05635746610400521, "agent_compute-ego3": 0.05312041967789695, "complete-iteration": 1.2223138297529526, "set_robot_commands": 0.0024441250201592524, "deviation-center-line": 1.1487139902068333, "driven_lanedir_consec": 8.576996349763904, "sim_compute_sim_state": 0.02759117876920889, "sim_compute_performance-ego0": 0.002352521844106178, "sim_compute_performance-ego1": 0.0021098324152976954, "sim_compute_performance-ego2": 0.0020679756205194437, "sim_compute_performance-ego3": 0.002104086781564187}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 18.103428135968123, "get_ui_image": 0.05100348251844624, "step_physics": 0.9693922148854608, "survival_time": 59.99999999999873, "driven_lanedir": 16.467932616724795, "get_state_dump": 0.010028130009609098, "get_robot_state": 0.015155475999195311, "sim_render-ego0": 0.004233173287778373, "sim_render-ego1": 0.0039552651674523145, "sim_render-ego2": 0.003900929354906678, "sim_render-ego3": 0.0038433771744854346, "get_duckie_state": 1.5938907340603208e-06, "in-drivable-lane": 16.54999999999912, "deviation-heading": 12.259397461422363, "agent_compute-ego0": 0.06241882869742693, "agent_compute-ego1": 0.05707019433490839, "agent_compute-ego2": 0.05408167918456981, "agent_compute-ego3": 0.05236695311051622, "complete-iteration": 1.3523176699057904, "set_robot_commands": 0.0022811915455610925, "deviation-center-line": 2.486811053719023, "driven_lanedir_consec": 16.467932616724795, "sim_compute_sim_state": 0.047016644855026005, "sim_compute_performance-ego0": 0.0022675125525456283, "sim_compute_performance-ego1": 0.0020552985773396233, "sim_compute_performance-ego2": 0.0020131564557204933, "sim_compute_performance-ego3": 0.0019857309740052235}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 22.6730782955318, "get_ui_image": 0.05100348251844624, "step_physics": 0.9693922148854608, "survival_time": 59.99999999999873, "driven_lanedir": 20.66941790950471, "get_state_dump": 0.010028130009609098, "get_robot_state": 0.015155475999195311, "sim_render-ego0": 0.004233173287778373, "sim_render-ego1": 0.0039552651674523145, "sim_render-ego2": 0.003900929354906678, "sim_render-ego3": 0.0038433771744854346, "get_duckie_state": 1.5938907340603208e-06, "in-drivable-lane": 3.3499999999999392, "deviation-heading": 14.93971686087217, "agent_compute-ego0": 0.06241882869742693, "agent_compute-ego1": 0.05707019433490839, "agent_compute-ego2": 0.05408167918456981, "agent_compute-ego3": 0.05236695311051622, "complete-iteration": 1.3523176699057904, "set_robot_commands": 0.0022811915455610925, "deviation-center-line": 4.064325800266463, "driven_lanedir_consec": 20.66941790950471, "sim_compute_sim_state": 0.047016644855026005, "sim_compute_performance-ego0": 0.0022675125525456283, "sim_compute_performance-ego1": 0.0020552985773396233, "sim_compute_performance-ego2": 0.0020131564557204933, "sim_compute_performance-ego3": 0.0019857309740052235}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 23.45895604451161, "get_ui_image": 0.05100348251844624, "step_physics": 0.9693922148854608, "survival_time": 59.99999999999873, "driven_lanedir": 21.09314638409324, "get_state_dump": 0.010028130009609098, "get_robot_state": 0.015155475999195311, "sim_render-ego0": 0.004233173287778373, "sim_render-ego1": 0.0039552651674523145, "sim_render-ego2": 0.003900929354906678, "sim_render-ego3": 0.0038433771744854346, "get_duckie_state": 1.5938907340603208e-06, "in-drivable-lane": 3.749999999999938, "deviation-heading": 16.777103100091594, "agent_compute-ego0": 0.06241882869742693, "agent_compute-ego1": 0.05707019433490839, "agent_compute-ego2": 0.05408167918456981, "agent_compute-ego3": 0.05236695311051622, "complete-iteration": 1.3523176699057904, "set_robot_commands": 0.0022811915455610925, "deviation-center-line": 3.490162493884269, "driven_lanedir_consec": 21.09314638409324, "sim_compute_sim_state": 0.047016644855026005, "sim_compute_performance-ego0": 0.0022675125525456283, "sim_compute_performance-ego1": 0.0020552985773396233, "sim_compute_performance-ego2": 0.0020131564557204933, "sim_compute_performance-ego3": 0.0019857309740052235}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 23.317404956672934, "get_ui_image": 0.05100348251844624, "step_physics": 0.9693922148854608, "survival_time": 59.99999999999873, "driven_lanedir": 21.16766967361322, "get_state_dump": 0.010028130009609098, "get_robot_state": 0.015155475999195311, "sim_render-ego0": 0.004233173287778373, "sim_render-ego1": 0.0039552651674523145, "sim_render-ego2": 0.003900929354906678, "sim_render-ego3": 0.0038433771744854346, "get_duckie_state": 1.5938907340603208e-06, "in-drivable-lane": 2.1000000000000227, "deviation-heading": 18.873099141289796, "agent_compute-ego0": 0.06241882869742693, "agent_compute-ego1": 0.05707019433490839, "agent_compute-ego2": 0.05408167918456981, "agent_compute-ego3": 0.05236695311051622, "complete-iteration": 1.3523176699057904, "set_robot_commands": 0.0022811915455610925, "deviation-center-line": 3.9012378860548265, "driven_lanedir_consec": 21.16766967361322, "sim_compute_sim_state": 0.047016644855026005, "sim_compute_performance-ego0": 0.0022675125525456283, "sim_compute_performance-ego1": 0.0020552985773396233, "sim_compute_performance-ego2": 0.0020131564557204933, "sim_compute_performance-ego3": 0.0019857309740052235}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 10.469998578549031, "get_ui_image": 0.04892831263334855, "step_physics": 1.0343186433443043, "survival_time": 49.39999999999933, "driven_lanedir": 9.5907120791861, "get_state_dump": 0.009980346845543903, "get_robot_state": 0.015248268511225408, "sim_render-ego0": 0.004159382790236671, "sim_render-ego1": 0.003919018291245818, "sim_render-ego2": 0.003894558570020963, "sim_render-ego3": 0.003820358320724133, "get_duckie_state": 1.688456752302673e-06, "in-drivable-lane": 1.200000000000017, "deviation-heading": 24.31893113536188, "agent_compute-ego0": 0.05219425832056059, "agent_compute-ego1": 0.04612599875254385, "agent_compute-ego2": 0.04590106854183247, "agent_compute-ego3": 0.04613247534864713, "complete-iteration": 1.3643344897471736, "set_robot_commands": 0.0022808847340582837, "deviation-center-line": 2.632740044197082, "driven_lanedir_consec": 7.131807685028717, "sim_compute_sim_state": 0.03151966997538105, "sim_compute_performance-ego0": 0.002225663712581561, "sim_compute_performance-ego1": 0.0020684424497722015, "sim_compute_performance-ego2": 0.002033715060073035, "sim_compute_performance-ego3": 0.002018717832343523}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 11.014407568503948, "get_ui_image": 0.04892831263334855, "step_physics": 1.0343186433443043, "survival_time": 49.39999999999933, "driven_lanedir": 10.014028804267152, "get_state_dump": 0.009980346845543903, "get_robot_state": 0.015248268511225408, "sim_render-ego0": 0.004159382790236671, "sim_render-ego1": 0.003919018291245818, "sim_render-ego2": 0.003894558570020963, "sim_render-ego3": 0.003820358320724133, "get_duckie_state": 1.688456752302673e-06, "in-drivable-lane": 25.79999999999911, "deviation-heading": 5.774264106731368, "agent_compute-ego0": 0.05219425832056059, "agent_compute-ego1": 0.04612599875254385, "agent_compute-ego2": 0.04590106854183247, "agent_compute-ego3": 0.04613247534864713, "complete-iteration": 1.3643344897471736, "set_robot_commands": 0.0022808847340582837, "deviation-center-line": 1.4108224907596705, "driven_lanedir_consec": 10.014028804267152, "sim_compute_sim_state": 0.03151966997538105, "sim_compute_performance-ego0": 0.002225663712581561, "sim_compute_performance-ego1": 0.0020684424497722015, "sim_compute_performance-ego2": 0.002033715060073035, "sim_compute_performance-ego3": 0.002018717832343523}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 9.794312389097096, "get_ui_image": 0.04892831263334855, "step_physics": 1.0343186433443043, "survival_time": 49.39999999999933, "driven_lanedir": 8.96936521790357, "get_state_dump": 0.009980346845543903, "get_robot_state": 0.015248268511225408, "sim_render-ego0": 0.004159382790236671, "sim_render-ego1": 0.003919018291245818, "sim_render-ego2": 0.003894558570020963, "sim_render-ego3": 0.003820358320724133, "get_duckie_state": 1.688456752302673e-06, "in-drivable-lane": 0.5000000000000071, "deviation-heading": 12.787290789003466, "agent_compute-ego0": 0.05219425832056059, "agent_compute-ego1": 0.04612599875254385, "agent_compute-ego2": 0.04590106854183247, "agent_compute-ego3": 0.04613247534864713, "complete-iteration": 1.3643344897471736, "set_robot_commands": 0.0022808847340582837, "deviation-center-line": 2.0929538238387684, "driven_lanedir_consec": 8.96936521790357, "sim_compute_sim_state": 0.03151966997538105, "sim_compute_performance-ego0": 0.002225663712581561, "sim_compute_performance-ego1": 0.0020684424497722015, "sim_compute_performance-ego2": 0.002033715060073035, "sim_compute_performance-ego3": 0.002018717832343523}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 20.25271241415137, "get_ui_image": 0.04892831263334855, "step_physics": 1.0343186433443043, "survival_time": 49.39999999999933, "driven_lanedir": 18.887482219640347, "get_state_dump": 0.009980346845543903, "get_robot_state": 0.015248268511225408, "sim_render-ego0": 0.004159382790236671, "sim_render-ego1": 0.003919018291245818, "sim_render-ego2": 0.003894558570020963, "sim_render-ego3": 0.003820358320724133, "get_duckie_state": 1.688456752302673e-06, "in-drivable-lane": 1.3000000000000185, "deviation-heading": 13.14045725935853, "agent_compute-ego0": 0.05219425832056059, "agent_compute-ego1": 0.04612599875254385, "agent_compute-ego2": 0.04590106854183247, "agent_compute-ego3": 0.04613247534864713, "complete-iteration": 1.3643344897471736, "set_robot_commands": 0.0022808847340582837, "deviation-center-line": 2.8395904140125423, "driven_lanedir_consec": 18.887482219640347, "sim_compute_sim_state": 0.03151966997538105, "sim_compute_performance-ego0": 0.002225663712581561, "sim_compute_performance-ego1": 0.0020684424497722015, "sim_compute_performance-ego2": 0.002033715060073035, "sim_compute_performance-ego3": 0.002018717832343523}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 27.58168840037928, "get_ui_image": 0.03157678512014219, "step_physics": 0.27644776801681836, "survival_time": 59.99999999999873, "driven_lanedir": 26.79664188602629, "get_state_dump": 0.006598946653138986, "get_robot_state": 0.0077333980357021615, "sim_render-ego0": 0.004050602226034985, "sim_render-ego1": 0.0038893355815039386, "get_duckie_state": 1.4338862588264662e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.249545393963675, "agent_compute-ego0": 0.05749866071092795, "agent_compute-ego1": 0.04925835817481556, "complete-iteration": 0.45691629829851416, "set_robot_commands": 0.0023319423446845847, "deviation-center-line": 2.835669000045721, "driven_lanedir_consec": 26.79664188602629, "sim_compute_sim_state": 0.010851330602298074, "sim_compute_performance-ego0": 0.002149694269642445, "sim_compute_performance-ego1": 0.002027972155466961}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 22.412305179155187, "get_ui_image": 0.03157678512014219, "step_physics": 0.27644776801681836, "survival_time": 59.99999999999873, "driven_lanedir": 19.69033261953043, "get_state_dump": 0.006598946653138986, "get_robot_state": 0.0077333980357021615, "sim_render-ego0": 0.004050602226034985, "sim_render-ego1": 0.0038893355815039386, "get_duckie_state": 1.4338862588264662e-06, "in-drivable-lane": 3.099999999999917, "deviation-heading": 20.700875878742774, "agent_compute-ego0": 0.05749866071092795, "agent_compute-ego1": 0.04925835817481556, "complete-iteration": 0.45691629829851416, "set_robot_commands": 0.0023319423446845847, "deviation-center-line": 3.825888576807445, "driven_lanedir_consec": 19.69033261953043, "sim_compute_sim_state": 0.010851330602298074, "sim_compute_performance-ego0": 0.002149694269642445, "sim_compute_performance-ego1": 0.002027972155466961}}
set_robot_commands_max	0.0024441250201592524
set_robot_commands_mean	0.002334906420605977
set_robot_commands_median	0.0022811915455610925
set_robot_commands_min	0.0022808847340582837
sim_compute_performance-ego0_max	0.002352521844106178
sim_compute_performance-ego0_mean	0.0022630129268727396
sim_compute_performance-ego0_median	0.0022675125525456283
sim_compute_performance-ego0_min	0.002149694269642445
sim_compute_performance-ego1_max	0.0021098324152976954
sim_compute_performance-ego1_mean	0.0020707312914694286
sim_compute_performance-ego1_median	0.0020684424497722015
sim_compute_performance-ego1_min	0.002027972155466961
sim_compute_sim_state_max	0.047016644855026005
sim_compute_sim_state_mean	0.031872331114504285
sim_compute_sim_state_median	0.03151966997538105
sim_compute_sim_state_min	0.010851330602298074
sim_render-ego0_max	0.0042973598933111045
sim_render-ego0_mean	0.004204347738383898
sim_render-ego0_median	0.004233173287778373
sim_render-ego0_min	0.004050602226034985
sim_render-ego1_max	0.004093512371069039
sim_render-ego1_mean	0.003974989605862611
sim_render-ego1_median	0.0039552651674523145
sim_render-ego1_min	0.0038893355815039386
simulation-passed	1
step_physics_max	1.0343186433443043
step_physics_mean	0.8548542668151519
step_physics_median	0.9693922148854608
step_physics_min	0.27644776801681836
survival_time_max	59.99999999999873
survival_time_mean	49.19999999999935
survival_time_min	32.800000000000274

No reset possible

58929

12802

Yishu Malhotra 🇨🇦

exercise_state_estimation

LFVv-sim

success

yes

2020-12-04 16:24:38+00:00

2020-12-04 17:04:28+00:00

0:39:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.0113016095405363
survival_time_median	21.725000000000172
deviation-center-line_median	1.2424879972515916
in-drivable-lane_median	1.675000000000002

other stats

agent_compute-ego0_max	0.012700026009672433
agent_compute-ego0_mean	0.012083592061888094
agent_compute-ego0_median	0.011988638991455088
agent_compute-ego0_min	0.011657064254969767
agent_compute-npc0_max	0.02858085436363743
agent_compute-npc0_mean	0.024038847913866877
agent_compute-npc0_median	0.023046686574652277
agent_compute-npc0_min	0.021481164142525513
agent_compute-npc1_max	0.03417989976944462
agent_compute-npc1_mean	0.03234641307095058
agent_compute-npc1_median	0.03251206037784604
agent_compute-npc1_min	0.03034727906556109
agent_compute-npc2_max	0.03674893344574344
agent_compute-npc2_mean	0.0307878879236439
agent_compute-npc2_median	0.02861566799943165
agent_compute-npc2_min	0.026999062325756624
agent_compute-npc3_max	0.04861636674532326
agent_compute-npc3_mean	0.04080098769796529
agent_compute-npc3_median	0.04080098769796529
agent_compute-npc3_min	0.03298560865060731
complete-iteration_max	1.282992900198724
complete-iteration_mean	0.9365519811790513
complete-iteration_median	1.0723242978594807
complete-iteration_min	0.31856642879851876
deviation-center-line_max	1.9569549597330091
deviation-center-line_mean	1.1660596027282852
deviation-center-line_min	0.22230745667694815
deviation-heading_max	7.619286862748656
deviation-heading_mean	5.533372388654442
deviation-heading_median	6.4718673728150975
deviation-heading_min	1.5704679462389166
driven_any_max	4.483832138153108
driven_any_mean	4.076211057524242
driven_any_median	4.224444452314102
driven_any_min	3.3721231873156583
driven_lanedir_consec_max	4.007394891383655
driven_lanedir_consec_mean	2.671885604058285
driven_lanedir_consec_min	0.6575443057684125
driven_lanedir_max	4.007394891383655
driven_lanedir_mean	3.0535894608604273
driven_lanedir_median	3.768424079194441
driven_lanedir_min	0.6701147936691731
get_duckie_state_max	1.715780866198144e-06
get_duckie_state_mean	1.5753938888994269e-06
get_duckie_state_median	1.6703962326894006e-06
get_duckie_state_min	1.245002224020762e-06
get_robot_state_max	0.01916258360749932
get_robot_state_mean	0.014639955104019107
get_robot_state_median	0.016215781511128506
get_robot_state_min	0.006965673786320099
get_state_dump_max	0.012010160056493616
get_state_dump_mean	0.009753423942154685
get_state_dump_median	0.010448378345999286
get_state_dump_min	0.006106779020126552
get_ui_image_max	0.05599762649946315
get_ui_image_mean	0.04678283107127323
get_ui_image_median	0.05017702465263986
get_ui_image_min	0.030779648480350023
in-drivable-lane_max	14.450000000000127
in-drivable-lane_mean	4.450000000000033
in-drivable-lane_min	0.0
per-episodes	details {"LFV-norm-loop-000-ego0": {"driven_any": 4.075163115317679, "get_ui_image": 0.04490648805373518, "step_physics": 0.633348012951904, "survival_time": 20.60000000000016, "driven_lanedir": 3.732317738191027, "get_state_dump": 0.009745912459514332, "get_robot_state": 0.014308904042832788, "sim_render-ego0": 0.003900114040975132, "sim_render-npc0": 0.004049276901503741, "sim_render-npc1": 0.00393390309146761, "sim_render-npc2": 0.0040643365273464105, "get_duckie_state": 1.6493023740754577e-06, "in-drivable-lane": 0.9000000000000128, "deviation-heading": 5.638770361979368, "agent_compute-ego0": 0.01216614390689582, "agent_compute-npc0": 0.021481164142525513, "agent_compute-npc1": 0.03251206037784604, "agent_compute-npc2": 0.03674893344574344, "complete-iteration": 0.8638332732941856, "set_robot_commands": 0.0023724501704476936, "deviation-center-line": 1.2079769084847936, "driven_lanedir_consec": 3.732317738191027, "sim_compute_sim_state": 0.025002332922910084, "sim_compute_performance-ego0": 0.0020696366381702932, "sim_compute_performance-npc0": 0.001986802057261617, "sim_compute_performance-npc1": 0.0020551525651686994, "sim_compute_performance-npc2": 0.002071567078190912}, "LFV-norm-zigzag-000-ego0": {"driven_any": 4.483832138153108, "get_ui_image": 0.055447561251544535, "step_physics": 0.9699931285266792, "survival_time": 22.85000000000019, "driven_lanedir": 3.8045304201978545, "get_state_dump": 0.011150844232484242, "get_robot_state": 0.018122658979424226, "sim_render-ego0": 0.003944572402920786, "sim_render-npc0": 0.0041075367073825355, "sim_render-npc1": 0.004082730763864309, "sim_render-npc2": 0.004034368752392098, "sim_render-npc3": 0.003916048587149407, "get_duckie_state": 1.715780866198144e-06, "in-drivable-lane": 2.4499999999999913, "deviation-heading": 7.304964383650828, "agent_compute-ego0": 0.011811134076014355, "agent_compute-npc0": 0.022267614389611123, "agent_compute-npc1": 0.03034727906556109, "agent_compute-npc2": 0.026999062325756624, "agent_compute-npc3": 0.03298560865060731, "complete-iteration": 1.282992900198724, "set_robot_commands": 0.0022824643480725683, "deviation-center-line": 1.27699908601839, "driven_lanedir_consec": 2.2902854808900455, "sim_compute_sim_state": 0.06135818635532429, "sim_compute_performance-ego0": 0.002177476362369987, "sim_compute_performance-npc0": 0.0020050643312879003, "sim_compute_performance-npc1": 0.002090582160449965, "sim_compute_performance-npc2": 0.0020859793284053888, "sim_compute_performance-npc3": 0.002077044357899495}, "LFV-norm-techtrack-000-ego0": {"driven_any": 4.373725789310525, "get_ui_image": 0.05599762649946315, "step_physics": 0.9372997914591144, "survival_time": 23.200000000000195, "driven_lanedir": 4.007394891383655, "get_state_dump": 0.012010160056493616, "get_robot_state": 0.01916258360749932, "sim_render-ego0": 0.004231601120323263, "sim_render-npc0": 0.004363309696156492, "sim_render-npc1": 0.004322954403456821, "sim_render-npc2": 0.004107071250997564, "sim_render-npc3": 0.004214485229984406, "get_duckie_state": 1.6914900913033434e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.619286862748656, "agent_compute-ego0": 0.012700026009672433, "agent_compute-npc0": 0.023825758759693432, "agent_compute-npc1": 0.03417989976944462, "agent_compute-npc2": 0.02861566799943165, "agent_compute-npc3": 0.04861636674532326, "complete-iteration": 1.2808153224247758, "set_robot_commands": 0.0024719294681343983, "deviation-center-line": 1.9569549597330091, "driven_lanedir_consec": 4.007394891383655, "sim_compute_sim_state": 0.0637102819258167, "sim_compute_performance-ego0": 0.0023397209823772473, "sim_compute_performance-npc0": 0.002198508477980091, "sim_compute_performance-npc1": 0.0021618140641079153, "sim_compute_performance-npc2": 0.002146351721978957, "sim_compute_performance-npc3": 0.0021353972855434624}, "LFV-norm-small_loop-000-ego0": {"driven_any": 3.3721231873156583, "get_ui_image": 0.030779648480350023, "step_physics": 0.2087638358547263, "survival_time": 18.200000000000124, "driven_lanedir": 0.6701147936691731, "get_state_dump": 0.006106779020126552, "get_robot_state": 0.006965673786320099, "sim_render-ego0": 0.003747564472564279, "sim_render-npc0": 0.003984306936394679, "get_duckie_state": 1.245002224020762e-06, "in-drivable-lane": 14.450000000000127, "deviation-heading": 1.5704679462389166, "agent_compute-ego0": 0.011657064254969767, "agent_compute-npc0": 0.02858085436363743, "complete-iteration": 0.31856642879851876, "set_robot_commands": 0.002232993138979559, "deviation-center-line": 0.22230745667694815, "driven_lanedir_consec": 0.6575443057684125, "sim_compute_sim_state": 0.009650042285657908, "sim_compute_performance-ego0": 0.001892487643516227, "sim_compute_performance-npc0": 0.0019128498965746735}}
set_robot_commands_max	0.0024719294681343983
set_robot_commands_mean	0.002339959281408555
set_robot_commands_median	0.002327457259260131
set_robot_commands_min	0.002232993138979559
sim_compute_performance-ego0_max	0.0023397209823772473
sim_compute_performance-ego0_mean	0.002119830406608439
sim_compute_performance-ego0_median	0.00212355650027014
sim_compute_performance-ego0_min	0.001892487643516227
sim_compute_performance-npc0_max	0.002198508477980091
sim_compute_performance-npc0_mean	0.0020258061907760705
sim_compute_performance-npc0_median	0.0019959331942747587
sim_compute_performance-npc0_min	0.0019128498965746735
sim_compute_performance-npc1_max	0.0021618140641079153
sim_compute_performance-npc1_mean	0.002102516263242193
sim_compute_performance-npc1_median	0.002090582160449965
sim_compute_performance-npc1_min	0.0020551525651686994
sim_compute_performance-npc2_max	0.002146351721978957
sim_compute_performance-npc2_mean	0.0021012993761917527
sim_compute_performance-npc2_median	0.0020859793284053888
sim_compute_performance-npc2_min	0.002071567078190912
sim_compute_performance-npc3_max	0.0021353972855434624
sim_compute_performance-npc3_mean	0.002106220821721479
sim_compute_performance-npc3_median	0.002106220821721479
sim_compute_performance-npc3_min	0.002077044357899495
sim_compute_sim_state_max	0.0637102819258167
sim_compute_sim_state_mean	0.03993021087242725
sim_compute_sim_state_median	0.04318025963911719
sim_compute_sim_state_min	0.009650042285657908
sim_render-ego0_max	0.004231601120323263
sim_render-ego0_mean	0.003955963009195864
sim_render-ego0_median	0.003922343221947958
sim_render-ego0_min	0.003747564472564279
sim_render-npc0_max	0.004363309696156492
sim_render-npc0_mean	0.004126107560359362
sim_render-npc0_median	0.0040784068044431385
sim_render-npc0_min	0.003984306936394679
sim_render-npc1_max	0.004322954403456821
sim_render-npc1_mean	0.004113196086262913
sim_render-npc1_median	0.004082730763864309
sim_render-npc1_min	0.00393390309146761
sim_render-npc2_max	0.004107071250997564
sim_render-npc2_mean	0.004068592176912024
sim_render-npc2_median	0.0040643365273464105
sim_render-npc2_min	0.004034368752392098
sim_render-npc3_max	0.004214485229984406
sim_render-npc3_mean	0.004065266908566907
sim_render-npc3_median	0.004065266908566907
sim_render-npc3_min	0.003916048587149407
simulation-passed	1
step_physics_max	0.9699931285266792
step_physics_mean	0.687351192198106
step_physics_median	0.7853239022055092
step_physics_min	0.2087638358547263
survival_time_max	23.200000000000195
survival_time_mean	21.21250000000017
survival_time_min	18.200000000000124

No reset possible

58922

12814

Yishu Malhotra 🇨🇦

sim-exercise-2

LFP-sim

success

2020-12-04 16:15:21+00:00

2020-12-04 16:24:04+00:00

0:08:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	11.00000000000002
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.61459972134554
deviation-center-line_median	0.48733252676586186

other stats

agent_compute-ego0_max	0.013832714304577704
agent_compute-ego0_mean	0.013434315298955234
agent_compute-ego0_median	0.013486985044971592
agent_compute-ego0_min	0.012930576801300048
complete-iteration_max	0.34213340872585185
complete-iteration_mean	0.276937062501722
complete-iteration_median	0.279763748396764
complete-iteration_min	0.20608734448750815
deviation-center-line_max	0.8467745471695113
deviation-center-line_mean	0.5448954362141133
deviation-center-line_min	0.35814214415521806
deviation-heading_max	4.926104223486742
deviation-heading_mean	3.0848776884031084
deviation-heading_median	2.715457269099636
deviation-heading_min	1.9824919919264188
driven_any_max	2.5227193852917593
driven_any_mean	1.7779158466114302
driven_any_median	1.976122135230097
driven_any_min	0.6366997306937671
driven_lanedir_consec_max	2.316975928892796
driven_lanedir_consec_mean	1.5308225477770636
driven_lanedir_consec_min	0.5771148195243792
driven_lanedir_max	2.316975928892796
driven_lanedir_mean	1.5308225477770636
driven_lanedir_median	1.61459972134554
driven_lanedir_min	0.5771148195243792
get_duckie_state_max	0.025850086611033392
get_duckie_state_mean	0.01856998845688832
get_duckie_state_median	0.02205498287507513
get_duckie_state_min	0.004319901466369629
get_robot_state_max	0.003984236445263765
get_robot_state_mean	0.003923812875223231
get_robot_state_median	0.003924994145856573
get_robot_state_min	0.003861026763916016
get_state_dump_max	0.00897763437191343
get_state_dump_mean	0.007755815305511985
get_state_dump_median	0.00830539594650585
get_state_dump_min	0.005434834957122802
get_ui_image_max	0.04134011032557724
get_ui_image_mean	0.03548360460217729
get_ui_image_median	0.03635425195340067
get_ui_image_min	0.027885804176330565
in-drivable-lane_max	3.300000000000047
in-drivable-lane_mean	0.8250000000000117
in-drivable-lane_min	0.0
per-episodes	details {"LFP-norm-loop-000-ego0": {"driven_any": 2.5227193852917593, "get_ui_image": 0.03486187739064032, "step_physics": 0.15133148273134414, "survival_time": 13.100000000000051, "driven_lanedir": 1.8536204200470392, "get_state_dump": 0.00897763437191343, "get_robot_state": 0.003984236445263765, "sim_render-ego0": 0.004003838441217807, "get_duckie_state": 0.025850086611033392, "in-drivable-lane": 3.300000000000047, "deviation-heading": 2.9757784962396725, "agent_compute-ego0": 0.013315411121673004, "complete-iteration": 0.25499535513468113, "set_robot_commands": 0.002338082164865936, "deviation-center-line": 0.4795306076205466, "driven_lanedir_consec": 1.8536204200470392, "sim_compute_sim_state": 0.008232333360969341, "sim_compute_performance-ego0": 0.002002425066871788}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.6366997306937671, "get_ui_image": 0.04134011032557724, "step_physics": 0.2328107994381744, "survival_time": 4.99999999999999, "driven_lanedir": 0.5771148195243792, "get_state_dump": 0.00836647855173243, "get_robot_state": 0.003923784388173925, "sim_render-ego0": 0.004242984375151077, "get_duckie_state": 0.022169689140697516, "in-drivable-lane": 0.0, "deviation-heading": 1.9824919919264188, "agent_compute-ego0": 0.01365855896827018, "complete-iteration": 0.34213340872585185, "set_robot_commands": 0.002431501256357325, "deviation-center-line": 0.35814214415521806, "driven_lanedir_consec": 0.5771148195243792, "sim_compute_sim_state": 0.010929506604034122, "sim_compute_performance-ego0": 0.002158984099284257}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.4440845850721875, "get_ui_image": 0.03784662651616102, "step_physics": 0.19516694745537955, "survival_time": 8.899999999999991, "driven_lanedir": 1.3755790226440403, "get_state_dump": 0.00824431334127927, "get_robot_state": 0.0039262039035392205, "sim_render-ego0": 0.004084615068062724, "get_duckie_state": 0.021940276609452743, "in-drivable-lane": 0.0, "deviation-heading": 2.4551360419596, "agent_compute-ego0": 0.013832714304577704, "complete-iteration": 0.3045321416588469, "set_robot_commands": 0.0023607808118425934, "deviation-center-line": 0.4951344459111771, "driven_lanedir_consec": 1.3755790226440403, "sim_compute_sim_state": 0.014748702502117477, "sim_compute_performance-ego0": 0.00227853439373677}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.508159685388007, "get_ui_image": 0.027885804176330565, "step_physics": 0.1372003706296285, "survival_time": 14.950000000000076, "driven_lanedir": 2.316975928892796, "get_state_dump": 0.005434834957122802, "get_robot_state": 0.003861026763916016, "sim_render-ego0": 0.0038654430707295738, "get_duckie_state": 0.004319901466369629, "in-drivable-lane": 0.0, "deviation-heading": 4.926104223486742, "agent_compute-ego0": 0.012930576801300048, "complete-iteration": 0.20608734448750815, "set_robot_commands": 0.002339606285095215, "deviation-center-line": 0.8467745471695113, "driven_lanedir_consec": 2.316975928892796, "sim_compute_sim_state": 0.006129759152730306, "sim_compute_performance-ego0": 0.0020345226923624673}}
set_robot_commands_max	0.002431501256357325
set_robot_commands_mean	0.0023674926295402677
set_robot_commands_median	0.0023501935484689044
set_robot_commands_min	0.002338082164865936
sim_compute_performance-ego0_max	0.00227853439373677
sim_compute_performance-ego0_mean	0.0021186165630638206
sim_compute_performance-ego0_median	0.002096753395823362
sim_compute_performance-ego0_min	0.002002425066871788
sim_compute_sim_state_max	0.014748702502117477
sim_compute_sim_state_mean	0.010010075404962812
sim_compute_sim_state_median	0.009580919982501731
sim_compute_sim_state_min	0.006129759152730306
sim_render-ego0_max	0.004242984375151077
sim_render-ego0_mean	0.004049220238790295
sim_render-ego0_median	0.004044226754640265
sim_render-ego0_min	0.0038654430707295738
simulation-passed	1
step_physics_max	0.2328107994381744
step_physics_mean	0.17912740006363165
step_physics_median	0.17324921509336183
step_physics_min	0.1372003706296285
survival_time_max	14.950000000000076
survival_time_mean	10.487500000000027
survival_time_min	4.99999999999999

No reset possible

58904

12825

exercise_state_estimation

aido5-LFI-sim-testing

LFVIv-sim

success

yes

aido5-LFVI_multi-sim-validation

2020-12-04 15:52:51+00:00

2020-12-04 16:14:46+00:00

0:21:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	10.96560063148576
survival_time_median	59.99999999999873
deviation-center-line_median	2.779051591705116
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.01265171922116752
agent_compute-ego0_mean	0.01244521607566535
agent_compute-ego0_median	0.01244521607566535
agent_compute-ego0_min	0.012238712930163178
complete-iteration_max	0.24441001476792867
complete-iteration_mean	0.2369236494480422
complete-iteration_median	0.2369236494480422
complete-iteration_min	0.22943728412815573
deviation-center-line_max	2.901313755629798
deviation-center-line_mean	2.779051591705116
deviation-center-line_min	2.6567894277804345
deviation-heading_max	11.038004125612384
deviation-heading_mean	11.00029695659699
deviation-heading_median	11.00029695659699
deviation-heading_min	10.9625897875816
driven_any_max	11.673126610565795
driven_any_mean	11.668232407408947
driven_any_median	11.668232407408947
driven_any_min	11.6633382042521
driven_lanedir_consec_max	11.09806869371723
driven_lanedir_consec_mean	10.96560063148576
driven_lanedir_consec_min	10.833132569254287
driven_lanedir_max	11.393401046255311
driven_lanedir_mean	11.384765137906632
driven_lanedir_median	11.384765137906632
driven_lanedir_min	11.376129229557954
get_duckie_state_max	1.5913100167178393e-06
get_duckie_state_mean	1.4770636451333689e-06
get_duckie_state_median	1.4770636451333689e-06
get_duckie_state_min	1.362817273548898e-06
get_robot_state_max	0.004039090837070487
get_robot_state_mean	0.003917406937363344
get_robot_state_median	0.003917406937363344
get_robot_state_min	0.003795723037656201
get_state_dump_max	0.005006715121813162
get_state_dump_mean	0.004828176430917402
get_state_dump_median	0.004828176430917402
get_state_dump_min	0.004649637740021641
get_ui_image_max	0.04126426937379607
get_ui_image_mean	0.039567315409721485
get_ui_image_median	0.039567315409721485
get_ui_image_min	0.0378703614456469
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LFI-norm-4way-000-ego0": {"driven_any": 11.673126610565795, "get_ui_image": 0.04126426937379607, "step_physics": 0.15884303490784046, "survival_time": 59.99999999999873, "driven_lanedir": 11.376129229557954, "get_state_dump": 0.005006715121813162, "get_robot_state": 0.004039090837070487, "sim_render-ego0": 0.00423879964861842, "get_duckie_state": 1.5913100167178393e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.038004125612384, "agent_compute-ego0": 0.01265171922116752, "complete-iteration": 0.24441001476792867, "set_robot_commands": 0.002429055730865758, "deviation-center-line": 2.901313755629798, "driven_lanedir_consec": 11.09806869371723, "sim_compute_sim_state": 0.013601864902899724, "sim_compute_performance-ego0": 0.0022442860964632947}, "LFI-norm-udem1-000-ego0": {"driven_any": 11.6633382042521, "get_ui_image": 0.0378703614456469, "step_physics": 0.14957038389455268, "survival_time": 59.99999999999873, "driven_lanedir": 11.393401046255311, "get_state_dump": 0.004649637740021641, "get_robot_state": 0.003795723037656201, "sim_render-ego0": 0.003968648966107142, "get_duckie_state": 1.362817273548898e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.9625897875816, "agent_compute-ego0": 0.012238712930163178, "complete-iteration": 0.22943728412815573, "set_robot_commands": 0.0023238883228921376, "deviation-center-line": 2.6567894277804345, "driven_lanedir_consec": 10.833132569254287, "sim_compute_sim_state": 0.012827118469416152, "sim_compute_performance-ego0": 0.002107497158892248}}
set_robot_commands_max	0.002429055730865758
set_robot_commands_mean	0.002376472026878948
set_robot_commands_median	0.002376472026878948
set_robot_commands_min	0.0023238883228921376
sim_compute_performance-ego0_max	0.0022442860964632947
sim_compute_performance-ego0_mean	0.0021758916276777714
sim_compute_performance-ego0_median	0.0021758916276777714
sim_compute_performance-ego0_min	0.002107497158892248
sim_compute_sim_state_max	0.013601864902899724
sim_compute_sim_state_mean	0.013214491686157938
sim_compute_sim_state_median	0.013214491686157938
sim_compute_sim_state_min	0.012827118469416152
sim_render-ego0_max	0.00423879964861842
sim_render-ego0_mean	0.004103724307362781
sim_render-ego0_median	0.004103724307362781
sim_render-ego0_min	0.003968648966107142
simulation-passed	1
step_physics_max	0.15884303490784046
step_physics_mean	0.15420670940119657
step_physics_median	0.15420670940119657
step_physics_min	0.14957038389455268
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

58852

12847

Raphael Jean

exercise_state_estimation

LFVIv-sim

success

yes

aido5-LFV_multi-sim-testing

2020-12-04 14:36:47+00:00

2020-12-04 15:52:42+00:00

1:15:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	9.73364262810328
survival_time_median	59.99999999999873
deviation-center-line_median	2.4383912030479395
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.012359452188064614
agent_compute-ego0_mean	0.01221854253970614
agent_compute-ego0_median	0.01221854253970614
agent_compute-ego0_min	0.012077632891347664
agent_compute-ego1_max	0.012766561936974823
agent_compute-ego1_mean	0.012710734569063593
agent_compute-ego1_median	0.012710734569063593
agent_compute-ego1_min	0.01265490720115236
agent_compute-ego2_max	0.013191053412736804
agent_compute-ego2_mean	0.013179369314227076
agent_compute-ego2_median	0.013179369314227076
agent_compute-ego2_min	0.01316768521571735
agent_compute-ego3_max	0.012499755467105965
agent_compute-ego3_mean	0.012494132381791777
agent_compute-ego3_median	0.012494132381791777
agent_compute-ego3_min	0.012488509296477586
complete-iteration_max	1.002415952039301
complete-iteration_mean	0.9649406728101312
complete-iteration_median	0.9649406728101312
complete-iteration_min	0.9274653935809616
deviation-center-line_max	4.205147941117272
deviation-center-line_mean	2.3372572074885274
deviation-center-line_min	0.1905702421849274
deviation-heading_max	12.727318911293231
deviation-heading_mean	8.029506537639593
deviation-heading_median	8.695914832304034
deviation-heading_min	0.941437983047616
driven_any_max	14.882186359407466
driven_any_mean	10.59018641858541
driven_any_median	11.86860890040549
driven_any_min	1.4104853879178365
driven_lanedir_consec_max	13.973858186193528
driven_lanedir_consec_mean	9.267513516394908
driven_lanedir_consec_min	0.4954203420515211
driven_lanedir_max	14.601540981566984
driven_lanedir_mean	10.086982246350455
driven_lanedir_median	11.63959024437814
driven_lanedir_min	0.4954203420515211
get_duckie_state_max	1.663570102307322e-06
get_duckie_state_mean	1.6303185519330408e-06
get_duckie_state_median	1.6303185519330408e-06
get_duckie_state_min	1.5970670015587597e-06
get_robot_state_max	0.015604273266438935
get_robot_state_mean	0.01528850651899047
get_robot_state_median	0.01528850651899047
get_robot_state_min	0.014972739771542004
get_state_dump_max	0.010278908835164116
get_state_dump_mean	0.010066694959216471
get_state_dump_median	0.010066694959216471
get_state_dump_min	0.009854481083268826
get_ui_image_max	0.05542546942470274
get_ui_image_mean	0.05407786448730418
get_ui_image_median	0.05407786448730418
get_ui_image_min	0.052730259549905616
in-drivable-lane_max	56.69999999999873
in-drivable-lane_mean	9.624999999999748
in-drivable-lane_min	0.0
per-episodes	details {"LFVI_multi-norm-4way-000-ego0": {"driven_any": 12.7411337336886, "get_ui_image": 0.05542546942470274, "step_physics": 0.7184598199731603, "survival_time": 59.99999999999873, "driven_lanedir": 12.564643098880676, "get_state_dump": 0.010278908835164116, "get_robot_state": 0.015604273266438935, "sim_render-ego0": 0.004168019505166491, "sim_render-ego1": 0.004299199948402169, "sim_render-ego2": 0.004316410752359179, "sim_render-ego3": 0.004362302656276935, "get_duckie_state": 1.663570102307322e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.509681639793864, "agent_compute-ego0": 0.012359452188064614, "agent_compute-ego1": 0.01265490720115236, "agent_compute-ego2": 0.013191053412736804, "agent_compute-ego3": 0.012488509296477586, "complete-iteration": 0.9274653935809616, "set_robot_commands": 0.002455638112076911, "deviation-center-line": 2.0853978540071023, "driven_lanedir_consec": 11.960105177201996, "sim_compute_sim_state": 0.04090745065928895, "sim_compute_performance-ego0": 0.002286557650982986, "sim_compute_performance-ego1": 0.002139808137053554, "sim_compute_performance-ego2": 0.002187358052605495, "sim_compute_performance-ego3": 0.002202968017743291}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 9.696265732826868, "get_ui_image": 0.05542546942470274, "step_physics": 0.7184598199731603, "survival_time": 59.99999999999873, "driven_lanedir": 8.467446737494198, "get_state_dump": 0.010278908835164116, "get_robot_state": 0.015604273266438935, "sim_render-ego0": 0.004168019505166491, "sim_render-ego1": 0.004299199948402169, "sim_render-ego2": 0.004316410752359179, "sim_render-ego3": 0.004362302656276935, "get_duckie_state": 1.663570102307322e-06, "in-drivable-lane": 18.299999999999297, "deviation-heading": 8.56795841638704, "agent_compute-ego0": 0.012359452188064614, "agent_compute-ego1": 0.01265490720115236, "agent_compute-ego2": 0.013191053412736804, "agent_compute-ego3": 0.012488509296477586, "complete-iteration": 0.9274653935809616, "set_robot_commands": 0.002455638112076911, "deviation-center-line": 2.5621134745112717, "driven_lanedir_consec": 8.0099923925149, "sim_compute_sim_state": 0.04090745065928895, "sim_compute_performance-ego0": 0.002286557650982986, "sim_compute_performance-ego1": 0.002139808137053554, "sim_compute_performance-ego2": 0.002187358052605495, "sim_compute_performance-ego3": 0.002202968017743291}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 11.839884997393003, "get_ui_image": 0.05542546942470274, "step_physics": 0.7184598199731603, "survival_time": 59.99999999999873, "driven_lanedir": 11.589172600810556, "get_state_dump": 0.010278908835164116, "get_robot_state": 0.015604273266438935, "sim_render-ego0": 0.004168019505166491, "sim_render-ego1": 0.004299199948402169, "sim_render-ego2": 0.004316410752359179, "sim_render-ego3": 0.004362302656276935, "get_duckie_state": 1.663570102307322e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.823871248221026, "agent_compute-ego0": 0.012359452188064614, "agent_compute-ego1": 0.01265490720115236, "agent_compute-ego2": 0.013191053412736804, "agent_compute-ego3": 0.012488509296477586, "complete-iteration": 0.9274653935809616, "set_robot_commands": 0.002455638112076911, "deviation-center-line": 2.314668931584608, "driven_lanedir_consec": 10.251787688877366, "sim_compute_sim_state": 0.04090745065928895, "sim_compute_performance-ego0": 0.002286557650982986, "sim_compute_performance-ego1": 0.002139808137053554, "sim_compute_performance-ego2": 0.002187358052605495, "sim_compute_performance-ego3": 0.002202968017743291}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 12.576943452501895, "get_ui_image": 0.05542546942470274, "step_physics": 0.7184598199731603, "survival_time": 59.99999999999873, "driven_lanedir": 11.782117456452486, "get_state_dump": 0.010278908835164116, "get_robot_state": 0.015604273266438935, "sim_render-ego0": 0.004168019505166491, "sim_render-ego1": 0.004299199948402169, "sim_render-ego2": 0.004316410752359179, "sim_render-ego3": 0.004362302656276935, "get_duckie_state": 1.663570102307322e-06, "in-drivable-lane": 1.9999999999999505, "deviation-heading": 12.727318911293231, "agent_compute-ego0": 0.012359452188064614, "agent_compute-ego1": 0.01265490720115236, "agent_compute-ego2": 0.013191053412736804, "agent_compute-ego3": 0.012488509296477586, "complete-iteration": 0.9274653935809616, "set_robot_commands": 0.002455638112076911, "deviation-center-line": 2.5864196322523094, "driven_lanedir_consec": 9.21549756732919, "sim_compute_sim_state": 0.04090745065928895, "sim_compute_performance-ego0": 0.002286557650982986, "sim_compute_performance-ego1": 0.002139808137053554, "sim_compute_performance-ego2": 0.002187358052605495, "sim_compute_performance-ego3": 0.002202968017743291}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 11.89733280341798, "get_ui_image": 0.052730259549905616, "step_physics": 0.8084686602482093, "survival_time": 59.99999999999873, "driven_lanedir": 11.690007887945724, "get_state_dump": 0.009854481083268826, "get_robot_state": 0.014972739771542004, "sim_render-ego0": 0.004018659893420217, "sim_render-ego1": 0.004160010546669178, "sim_render-ego2": 0.004265951375778668, "sim_render-ego3": 0.0042761565247344336, "get_duckie_state": 1.5970670015587597e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.644377918138058, "agent_compute-ego0": 0.012077632891347664, "agent_compute-ego1": 0.012766561936974823, "agent_compute-ego2": 0.01316768521571735, "agent_compute-ego3": 0.012499755467105965, "complete-iteration": 1.002415952039301, "set_robot_commands": 0.002576744824424572, "deviation-center-line": 2.155156140122347, "driven_lanedir_consec": 11.094311562316792, "sim_compute_sim_state": 0.030704789912075325, "sim_compute_performance-ego0": 0.0021896515162560864, "sim_compute_performance-ego1": 0.0020630911526136058, "sim_compute_performance-ego2": 0.002100046032374348, "sim_compute_performance-ego3": 0.0021176479142671024}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 14.882186359407466, "get_ui_image": 0.052730259549905616, "step_physics": 0.8084686602482093, "survival_time": 59.99999999999873, "driven_lanedir": 14.601540981566984, "get_state_dump": 0.009854481083268826, "get_robot_state": 0.014972739771542004, "sim_render-ego0": 0.004018659893420217, "sim_render-ego1": 0.004160010546669178, "sim_render-ego2": 0.004265951375778668, "sim_render-ego3": 0.0042761565247344336, "get_duckie_state": 1.5970670015587597e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.182214999822165, "agent_compute-ego0": 0.012077632891347664, "agent_compute-ego1": 0.012766561936974823, "agent_compute-ego2": 0.01316768521571735, "agent_compute-ego3": 0.012499755467105965, "complete-iteration": 1.002415952039301, "set_robot_commands": 0.002576744824424572, "deviation-center-line": 2.598583444128381, "driven_lanedir_consec": 13.973858186193528, "sim_compute_sim_state": 0.030704789912075325, "sim_compute_performance-ego0": 0.0021896515162560864, "sim_compute_performance-ego1": 0.0020630911526136058, "sim_compute_performance-ego2": 0.002100046032374348, "sim_compute_performance-ego3": 0.0021176479142671024}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 9.677258881529644, "get_ui_image": 0.052730259549905616, "step_physics": 0.8084686602482093, "survival_time": 59.99999999999873, "driven_lanedir": 9.5055088656015, "get_state_dump": 0.009854481083268826, "get_robot_state": 0.014972739771542004, "sim_render-ego0": 0.004018659893420217, "sim_render-ego1": 0.004160010546669178, "sim_render-ego2": 0.004265951375778668, "sim_render-ego3": 0.0042761565247344336, "get_duckie_state": 1.5970670015587597e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.839191184413746, "agent_compute-ego0": 0.012077632891347664, "agent_compute-ego1": 0.012766561936974823, "agent_compute-ego2": 0.01316768521571735, "agent_compute-ego3": 0.012499755467105965, "complete-iteration": 1.002415952039301, "set_robot_commands": 0.002576744824424572, "deviation-center-line": 4.205147941117272, "driven_lanedir_consec": 9.139135214673956, "sim_compute_sim_state": 0.030704789912075325, "sim_compute_performance-ego0": 0.0021896515162560864, "sim_compute_performance-ego1": 0.0020630911526136058, "sim_compute_performance-ego2": 0.002100046032374348, "sim_compute_performance-ego3": 0.0021176479142671024}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.4104853879178365, "get_ui_image": 0.052730259549905616, "step_physics": 0.8084686602482093, "survival_time": 59.99999999999873, "driven_lanedir": 0.4954203420515211, "get_state_dump": 0.009854481083268826, "get_robot_state": 0.014972739771542004, "sim_render-ego0": 0.004018659893420217, "sim_render-ego1": 0.004160010546669178, "sim_render-ego2": 0.004265951375778668, "sim_render-ego3": 0.0042761565247344336, "get_duckie_state": 1.5970670015587597e-06, "in-drivable-lane": 56.69999999999873, "deviation-heading": 0.941437983047616, "agent_compute-ego0": 0.012077632891347664, "agent_compute-ego1": 0.012766561936974823, "agent_compute-ego2": 0.01316768521571735, "agent_compute-ego3": 0.012499755467105965, "complete-iteration": 1.002415952039301, "set_robot_commands": 0.002576744824424572, "deviation-center-line": 0.1905702421849274, "driven_lanedir_consec": 0.4954203420515211, "sim_compute_sim_state": 0.030704789912075325, "sim_compute_performance-ego0": 0.0021896515162560864, "sim_compute_performance-ego1": 0.0020630911526136058, "sim_compute_performance-ego2": 0.002100046032374348, "sim_compute_performance-ego3": 0.0021176479142671024}}
set_robot_commands_max	0.002576744824424572
set_robot_commands_mean	0.0025161914682507417
set_robot_commands_median	0.0025161914682507417
set_robot_commands_min	0.002455638112076911
sim_compute_performance-ego0_max	0.002286557650982986
sim_compute_performance-ego0_mean	0.0022381045836195363
sim_compute_performance-ego0_median	0.0022381045836195363
sim_compute_performance-ego0_min	0.0021896515162560864
sim_compute_performance-ego1_max	0.002139808137053554
sim_compute_performance-ego1_mean	0.00210144964483358
sim_compute_performance-ego1_median	0.00210144964483358
sim_compute_performance-ego1_min	0.0020630911526136058
sim_compute_performance-ego2_max	0.002187358052605495
sim_compute_performance-ego2_mean	0.0021437020424899212
sim_compute_performance-ego2_median	0.0021437020424899212
sim_compute_performance-ego2_min	0.002100046032374348
sim_compute_performance-ego3_max	0.002202968017743291
sim_compute_performance-ego3_mean	0.0021603079660051966
sim_compute_performance-ego3_median	0.0021603079660051966
sim_compute_performance-ego3_min	0.0021176479142671024
sim_compute_sim_state_max	0.04090745065928895
sim_compute_sim_state_mean	0.035806120285682135
sim_compute_sim_state_median	0.035806120285682135
sim_compute_sim_state_min	0.030704789912075325
sim_render-ego0_max	0.004168019505166491
sim_render-ego0_mean	0.004093339699293354
sim_render-ego0_median	0.004093339699293354
sim_render-ego0_min	0.004018659893420217
sim_render-ego1_max	0.004299199948402169
sim_render-ego1_mean	0.004229605247535673
sim_render-ego1_median	0.004229605247535673
sim_render-ego1_min	0.004160010546669178
sim_render-ego2_max	0.004316410752359179
sim_render-ego2_mean	0.004291181064068924
sim_render-ego2_median	0.004291181064068924
sim_render-ego2_min	0.004265951375778668
sim_render-ego3_max	0.004362302656276935
sim_render-ego3_mean	0.004319229590505684
sim_render-ego3_median	0.004319229590505684
sim_render-ego3_min	0.0042761565247344336
simulation-passed	1
step_physics_max	0.8084686602482093
step_physics_mean	0.7634642401106848
step_physics_median	0.7634642401106848
step_physics_min	0.7184598199731603
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

58790

12744

Thomas Wiggers 🇳🇱

ppo_v1

LFVmultibodyv-sim

success

yes

2020-12-04 12:40:53+00:00

2020-12-04 14:36:08+00:00

1:55:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.0983541398027032
survival_time_median	59.99999999999873
deviation-center-line_median	1.3815148761237874
in-drivable-lane_median	23.32499999999964

other stats

agent_compute-ego0_max	0.07344313307070514
agent_compute-ego0_mean	0.06857923177673088
agent_compute-ego0_median	0.06838649059711745
agent_compute-ego0_min	0.06385679601350289
agent_compute-ego1_max	0.06957206221841754
agent_compute-ego1_mean	0.06383618347670947
agent_compute-ego1_median	0.06562529118432292
agent_compute-ego1_min	0.056468133824575835
complete-iteration_max	1.1431993554771989
complete-iteration_mean	0.9280768572549098
complete-iteration_median	0.9799355849139796
complete-iteration_min	0.3285292425189578
deviation-center-line_max	4.413645943315625
deviation-center-line_mean	1.4417684591753008
deviation-center-line_min	0.2530789513376133
deviation-heading_max	27.31715699009108
deviation-heading_mean	8.432814022344413
deviation-heading_median	6.796731492199607
deviation-heading_min	1.9006536347707013
driven_any_max	9.728362916027685
driven_any_mean	4.879117997701984
driven_any_median	4.572768804413098
driven_any_min	0.7973361560178924
driven_lanedir_consec_max	8.079859861323152
driven_lanedir_consec_mean	2.6282550880024007
driven_lanedir_consec_min	0.07904964542260284
driven_lanedir_max	8.08409399177013
driven_lanedir_mean	3.0985706524549146
driven_lanedir_median	2.6709602445456113
driven_lanedir_min	0.0975031382126268
get_duckie_state_max	1.72153698415383e-06
get_duckie_state_mean	1.6531632645032736e-06
get_duckie_state_median	1.717765166499434e-06
get_duckie_state_min	1.3965728868369105e-06
get_robot_state_max	0.015586556641882802
get_robot_state_mean	0.014016934176212898
get_robot_state_median	0.014937869317327114
get_robot_state_min	0.0072503488683191486
get_state_dump_max	0.01007144000508406
get_state_dump_mean	0.00938309260991023
get_state_dump_median	0.009844722596930028
get_state_dump_min	0.006205536716773417
get_ui_image_max	0.05020669219297334
get_ui_image_mean	0.04541812819476749
get_ui_image_median	0.05008560930263192
get_ui_image_min	0.029434516336570005
in-drivable-lane_max	56.749999999998735
in-drivable-lane_mean	23.032142857142333
in-drivable-lane_min	0.0
per-episodes	details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.8080912424391244, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 1.3605112972951914, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 14.350000000000202, "deviation-heading": 27.31715699009108, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 4.413645943315625, "driven_lanedir_consec": 1.3132834376113705, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.3142893202758046, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 2.5319699155430535, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 3.4499999999999904, "deviation-heading": 13.308626802537782, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 2.467832836497597, "driven_lanedir_consec": 2.5319699155430535, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.249375470341283, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 4.509140212445026, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 25.299999999999415, "deviation-heading": 7.969840486418534, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 1.5084287656737665, "driven_lanedir_consec": 3.98050054375529, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 8.836925542371242, "get_ui_image": 0.04395388901779594, "step_physics": 0.5903470228355592, "survival_time": 59.99999999999873, "driven_lanedir": 8.08409399177013, "get_state_dump": 0.009844722596930028, "get_robot_state": 0.014937869317327114, "sim_render-ego0": 0.004144628875757832, "sim_render-ego1": 0.003886106707075057, "sim_render-ego2": 0.003907866521639987, "sim_render-ego3": 0.003824431929957559, "get_duckie_state": 1.6484828316897375e-06, "in-drivable-lane": 9.199999999999475, "deviation-heading": 7.516984176738013, "agent_compute-ego0": 0.06626928954398403, "agent_compute-ego1": 0.059995221853454746, "agent_compute-ego2": 0.05921423425285346, "agent_compute-ego3": 0.06124226834553664, "complete-iteration": 0.9608694387415267, "set_robot_commands": 0.002203908788472985, "deviation-center-line": 2.071209476960221, "driven_lanedir_consec": 8.079859861323152, "sim_compute_sim_state": 0.021711568054211924, "sim_compute_performance-ego0": 0.002148043404610131, "sim_compute_performance-ego1": 0.0020328713495665843, "sim_compute_performance-ego2": 0.001988427029561242, "sim_compute_performance-ego3": 0.0019364061204718117}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 6.793733571695143, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 3.53672069906364, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 26.799999999999493, "deviation-heading": 11.538091660163886, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 1.8205898778486296, "driven_lanedir_consec": 1.960633532019494, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 0.7973361560178924, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 0.0975031382126268, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 56.749999999998735, "deviation-heading": 3.8293023567133737, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 0.2530789513376133, "driven_lanedir_consec": 0.07904964542260284, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 6.297324339091237, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 3.2562059933482588, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 27.449999999998916, "deviation-heading": 13.805730385774654, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 1.684034840294491, "driven_lanedir_consec": 2.795995015923963, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 6.4697816352780775, "get_ui_image": 0.05008560930263192, "step_physics": 0.5622428960347553, "survival_time": 59.99999999999873, "driven_lanedir": 2.9224230610932356, "get_state_dump": 0.009821893174285, "get_robot_state": 0.014909669223375662, "sim_render-ego0": 0.0041881959503834495, "sim_render-ego1": 0.004024331714588835, "sim_render-ego2": 0.003826365879830671, "sim_render-ego3": 0.003835443850857927, "get_duckie_state": 1.717765166499434e-06, "in-drivable-lane": 29.949999999998965, "deviation-heading": 11.154848597705762, "agent_compute-ego0": 0.07344313307070514, "agent_compute-ego1": 0.06957206221841754, "agent_compute-ego2": 0.06513185882250733, "agent_compute-ego3": 0.06868350476051349, "complete-iteration": 0.9799355849139796, "set_robot_commands": 0.002183086369853532, "deviation-center-line": 1.5810046345441815, "driven_lanedir_consec": 2.2360747475859126, "sim_compute_sim_state": 0.03273219033939257, "sim_compute_performance-ego0": 0.0022254958934926866, "sim_compute_performance-ego1": 0.0019810019087334856, "sim_compute_performance-ego2": 0.0019738880621205756, "sim_compute_performance-ego3": 0.0019498276373031832}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.728362916027685, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 7.259982135946148, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 21.349999999999863, "deviation-heading": 4.897446819080791, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 1.2546009865738084, "driven_lanedir_consec": 4.638905733553564, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.3557900717984817, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 1.2658322592935, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 51.54999999999875, "deviation-heading": 2.0436738190618966, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 0.27460122912983925, "driven_lanedir_consec": 1.2658322592935, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.931015304270937, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 2.307110483155605, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 38.49999999999864, "deviation-heading": 6.0764788076612, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 1.20138517553391, "driven_lanedir_consec": 1.6649705927993144, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 5.214522304555258, "get_ui_image": 0.05020669219297334, "step_physics": 0.7386424259579648, "survival_time": 59.99999999999873, "driven_lanedir": 2.8099505735481696, "get_state_dump": 0.01007144000508406, "get_robot_state": 0.015586556641882802, "sim_render-ego0": 0.004252444893791714, "sim_render-ego1": 0.0043588782428801804, "sim_render-ego2": 0.004146571957400002, "sim_render-ego3": 0.004049060743714649, "get_duckie_state": 1.72153698415383e-06, "in-drivable-lane": 17.050000000000242, "deviation-heading": 4.624203606628596, "agent_compute-ego0": 0.06838649059711745, "agent_compute-ego1": 0.06562529118432292, "agent_compute-ego2": 0.06182542391164813, "agent_compute-ego3": 0.06731745662736853, "complete-iteration": 1.1431993554771989, "set_robot_commands": 0.0024741539649423415, "deviation-center-line": 0.7162236741317428, "driven_lanedir_consec": 2.8099505735481696, "sim_compute_sim_state": 0.02944537801210529, "sim_compute_performance-ego0": 0.002339213813572105, "sim_compute_performance-ego1": 0.0022474988910379658, "sim_compute_performance-ego2": 0.002181450393575117, "sim_compute_performance-ego3": 0.0021494443370936615}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.8868319209481177, "get_ui_image": 0.029434516336570005, "step_physics": 0.14044011275539195, "survival_time": 14.000000000000064, "driven_lanedir": 1.8695941055544616, "get_state_dump": 0.006205536716773417, "get_robot_state": 0.0072503488683191486, "sim_render-ego0": 0.003776163393068144, "sim_render-ego1": 0.003677805971844765, "get_duckie_state": 1.3965728868369105e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.9006536347707013, "agent_compute-ego0": 0.06385679601350289, "agent_compute-ego1": 0.056468133824575835, "complete-iteration": 0.3285292425189578, "set_robot_commands": 0.0020843799428159233, "deviation-center-line": 0.5799403265632029, "driven_lanedir_consec": 1.8695941055544616, "sim_compute_sim_state": 0.009298642759221303, "sim_compute_performance-ego0": 0.001890151101923498, "sim_compute_performance-ego1": 0.001887839035631499}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.6242721727174907, "get_ui_image": 0.029434516336570005, "step_physics": 0.14044011275539195, "survival_time": 14.000000000000064, "driven_lanedir": 1.5689512680997564, "get_state_dump": 0.006205536716773417, "get_robot_state": 0.0072503488683191486, "sim_render-ego0": 0.003776163393068144, "sim_render-ego1": 0.003677805971844765, "get_duckie_state": 1.3965728868369105e-06, "in-drivable-lane": 0.7500000000000107, "deviation-heading": 2.0763581694755175, "agent_compute-ego0": 0.06385679601350289, "agent_compute-ego1": 0.056468133824575835, "complete-iteration": 0.3285292425189578, "set_robot_commands": 0.0020843799428159233, "deviation-center-line": 0.358181710049586, "driven_lanedir_consec": 1.5689512680997564, "sim_compute_sim_state": 0.009298642759221303, "sim_compute_performance-ego0": 0.001890151101923498, "sim_compute_performance-ego1": 0.001887839035631499}}
set_robot_commands_max	0.0024741539649423415
set_robot_commands_mean	0.002258096884193377
set_robot_commands_median	0.002203908788472985
set_robot_commands_min	0.0020843799428159233
sim_compute_performance-ego0_max	0.002339213813572105
sim_compute_performance-ego0_mean	0.0021879510464676206
sim_compute_performance-ego0_median	0.0022254958934926866
sim_compute_performance-ego0_min	0.001890151101923498
sim_compute_performance-ego1_max	0.0022474988910379658
sim_compute_performance-ego1_mean	0.0020586547620439384
sim_compute_performance-ego1_median	0.0020328713495665843
sim_compute_performance-ego1_min	0.001887839035631499
sim_compute_sim_state_max	0.03273219033939257
sim_compute_sim_state_mean	0.02529670222437727
sim_compute_sim_state_median	0.02944537801210529
sim_compute_sim_state_min	0.009298642759221303
sim_render-ego0_max	0.004252444893791714
sim_render-ego0_mean	0.004135243261847734
sim_render-ego0_median	0.0041881959503834495
sim_render-ego0_min	0.003776163393068144
sim_render-ego1_max	0.0043588782428801804
sim_render-ego1_mean	0.0040309199001332735
sim_render-ego1_median	0.004024331714588835
sim_render-ego1_min	0.003677805971844765
simulation-passed	1
step_physics_max	0.7386424259579648
step_physics_mean	0.5604149717731356
step_physics_median	0.5903470228355592
step_physics_min	0.14044011275539195
survival_time_max	59.99999999999873
survival_time_mean	53.42857142857036
survival_time_min	14.000000000000064

No reset possible

58780

12753

Raphael Jean

sim-exercise-1

LFP-sim

success

2020-12-04 12:30:33+00:00

2020-12-04 12:40:14+00:00

0:09:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	13.100000000000051
in-drivable-lane_median	0.7500000000000107
driven_lanedir_consec_median	1.7634408891323048
deviation-center-line_median	0.5631774442218882

other stats

agent_compute-ego0_max	0.013788413442125069
agent_compute-ego0_mean	0.01346297144874253
agent_compute-ego0_median	0.01357838985333858
agent_compute-ego0_min	0.012906692646167896
complete-iteration_max	0.3285955938638425
complete-iteration_mean	0.26261370677062396
complete-iteration_median	0.26559115603708716
complete-iteration_min	0.19067692114447904
deviation-center-line_max	0.8977167042169929
deviation-center-line_mean	0.5853428284755782
deviation-center-line_min	0.3172997212415434
deviation-heading_max	3.4843655891128726
deviation-heading_mean	2.4814268071013
deviation-heading_median	2.5903520756015883
deviation-heading_min	1.2606374880891509
driven_any_max	3.153018733228156
driven_any_mean	2.0109695507135292
driven_any_median	2.1572142283191535
driven_any_min	0.5764310129876535
driven_lanedir_consec_max	2.312641754032205
driven_lanedir_consec_mean	1.598082002884744
driven_lanedir_consec_min	0.5528044792421619
driven_lanedir_max	2.312641754032205
driven_lanedir_mean	1.598082002884744
driven_lanedir_median	1.7634408891323048
driven_lanedir_min	0.5528044792421619
get_duckie_state_max	0.028538335358732132
get_duckie_state_mean	0.019622482507351664
get_duckie_state_median	0.02269814170172556
get_duckie_state_min	0.0045553112672234225
get_robot_state_max	0.004264283909027233
get_robot_state_mean	0.004032926713267579
get_robot_state_median	0.004022201351282904
get_robot_state_min	0.003823020241477273
get_state_dump_max	0.009532498480451158
get_state_dump_mean	0.008038709845311133
get_state_dump_median	0.008552277350698535
get_state_dump_min	0.005517786199396307
get_ui_image_max	0.042540914872113395
get_ui_image_mean	0.0361207273822884
get_ui_image_median	0.03703115309108656
get_ui_image_min	0.02787968847486708
in-drivable-lane_max	6.700000000000054
in-drivable-lane_mean	2.050000000000019
in-drivable-lane_min	0.0
per-episodes	details {"LFP-norm-loop-000-ego0": {"driven_any": 1.9311583374199677, "get_ui_image": 0.03587894148181099, "step_physics": 0.1378425916730056, "survival_time": 11.400000000000029, "driven_lanedir": 1.7430644799717336, "get_state_dump": 0.009532498480451158, "get_robot_state": 0.004264283909027233, "sim_render-ego0": 0.004174636441026712, "get_duckie_state": 0.028538335358732132, "in-drivable-lane": 1.500000000000021, "deviation-heading": 2.1266902039645337, "agent_compute-ego0": 0.013430594356820051, "complete-iteration": 0.247336404292344, "set_robot_commands": 0.002502371650595853, "deviation-center-line": 0.3172997212415434, "driven_lanedir_consec": 1.7430644799717336, "sim_compute_sim_state": 0.008802112012971437, "sim_compute_performance-ego0": 0.0022504704487896383}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5764310129876535, "get_ui_image": 0.042540914872113395, "step_physics": 0.21724678955826104, "survival_time": 5.04999999999999, "driven_lanedir": 0.5528044792421619, "get_state_dump": 0.008794971540862439, "get_robot_state": 0.0039793533437392295, "sim_render-ego0": 0.004083395004272461, "get_duckie_state": 0.0227205566331452, "in-drivable-lane": 0.0, "deviation-heading": 1.2606374880891509, "agent_compute-ego0": 0.013726185349857103, "complete-iteration": 0.3285955938638425, "set_robot_commands": 0.002472732581344305, "deviation-center-line": 0.4007946705397557, "driven_lanedir_consec": 0.5528044792421619, "sim_compute_sim_state": 0.0107574416141884, "sim_compute_performance-ego0": 0.0021529291190353094}, "LFP-norm-techtrack-000-ego0": {"driven_any": 3.153018733228156, "get_ui_image": 0.03818336470036213, "step_physics": 0.17208360856579197, "survival_time": 17.000000000000107, "driven_lanedir": 1.7838172982928755, "get_state_dump": 0.008309583160534631, "get_robot_state": 0.004065049358826579, "sim_render-ego0": 0.00408794243664336, "get_duckie_state": 0.022675726770305913, "in-drivable-lane": 6.700000000000054, "deviation-heading": 3.4843655891128726, "agent_compute-ego0": 0.013788413442125069, "complete-iteration": 0.2838459077818303, "set_robot_commands": 0.002435595408912278, "deviation-center-line": 0.7255602179040207, "driven_lanedir_consec": 1.7838172982928755, "sim_compute_sim_state": 0.015851565470094205, "sim_compute_performance-ego0": 0.0022594047781309425}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.3832701192183396, "get_ui_image": 0.02787968847486708, "step_physics": 0.12129678148211856, "survival_time": 14.800000000000075, "driven_lanedir": 2.312641754032205, "get_state_dump": 0.005517786199396307, "get_robot_state": 0.003823020241477273, "sim_render-ego0": 0.003948699745666299, "get_duckie_state": 0.0045553112672234225, "in-drivable-lane": 0.0, "deviation-heading": 3.054013947238643, "agent_compute-ego0": 0.012906692646167896, "complete-iteration": 0.19067692114447904, "set_robot_commands": 0.002362033734819303, "deviation-center-line": 0.8977167042169929, "driven_lanedir_consec": 2.312641754032205, "sim_compute_sim_state": 0.006108137894961167, "sim_compute_performance-ego0": 0.0021841574196863655}}
set_robot_commands_max	0.002502371650595853
set_robot_commands_mean	0.0024431833439179347
set_robot_commands_median	0.002454163995128292
set_robot_commands_min	0.002362033734819303
sim_compute_performance-ego0_max	0.0022594047781309425
sim_compute_performance-ego0_mean	0.0022117404414105637
sim_compute_performance-ego0_median	0.002217313934238002
sim_compute_performance-ego0_min	0.0021529291190353094
sim_compute_sim_state_max	0.015851565470094205
sim_compute_sim_state_mean	0.010379814248053804
sim_compute_sim_state_median	0.00977977681357992
sim_compute_sim_state_min	0.006108137894961167
sim_render-ego0_max	0.004174636441026712
sim_render-ego0_mean	0.004073668406902208
sim_render-ego0_median	0.004085668720457911
sim_render-ego0_min	0.003948699745666299
simulation-passed	1
step_physics_max	0.21724678955826104
step_physics_mean	0.1621174428197943
step_physics_median	0.1549631001193988
step_physics_min	0.12129678148211856
survival_time_max	17.000000000000107
survival_time_mean	12.06250000000005
survival_time_min	5.04999999999999

No reset possible

58722

11772

Ehsan Ahmadi 🇨🇦

template-random

LFv-sim

aborted

yes

2020-12-04 02:32:14+00:00

2020-12-04 02:32:37+00:00

0:00:23

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58702

10936

Bhavya Patwa 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-04 02:16:04+00:00

2020-12-04 02:21:17+00:00

0:05:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.635240456758402
survival_time_median	6.324999999999985
deviation-center-line_median	0.162880221275905
in-drivable-lane_median	3.4500000000000055

other stats

agent_compute-ego0_max	0.01345756800487788
agent_compute-ego0_mean	0.012044081424611714
agent_compute-ego0_median	0.01187298984557396
agent_compute-ego0_min	0.01097277800242106
complete-iteration_max	0.1842212677001953
complete-iteration_mean	0.15752854098538424
complete-iteration_median	0.15758722655627194
complete-iteration_min	0.13071844312879774
deviation-center-line_max	0.5362740643534367
deviation-center-line_mean	0.2401740286916691
deviation-center-line_min	0.09866160786142976
deviation-heading_max	1.772167965593244
deviation-heading_mean	0.9756191524588368
deviation-heading_median	0.8440120739554773
deviation-heading_min	0.4422844963311483
driven_any_max	2.4521091379052353
driven_any_mean	1.6232694274388892
driven_any_median	1.4879899733306008
driven_any_min	1.064988625189121
driven_lanedir_consec_max	1.5896252471516426
driven_lanedir_consec_mean	0.7929085383263111
driven_lanedir_consec_min	0.311527992636798
driven_lanedir_max	1.5896252471516426
driven_lanedir_mean	0.7929085383263111
driven_lanedir_median	0.635240456758402
driven_lanedir_min	0.311527992636798
get_duckie_state_max	1.7532194503630051e-06
get_duckie_state_mean	1.5800395591825656e-06
get_duckie_state_median	1.5880818708040716e-06
get_duckie_state_min	1.3907750447591143e-06
get_robot_state_max	0.003916752458822848
get_robot_state_mean	0.0034378413921358607
get_robot_state_median	0.003315002904216207
get_robot_state_min	0.003204607301288181
get_state_dump_max	0.00476858832619407
get_state_dump_mean	0.004385874160540908
get_state_dump_median	0.004270327805727583
get_state_dump_min	0.004234252704514397
get_ui_image_max	0.03169471938330848
get_ui_image_mean	0.02763772896838968
get_ui_image_median	0.027803005354597603
get_ui_image_min	0.023250185781055022
in-drivable-lane_max	4.449999999999984
in-drivable-lane_mean	3.3749999999999973
in-drivable-lane_min	2.1499999999999924
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.4521091379052353, "get_ui_image": 0.024511885886289636, "step_physics": 0.08574634547136267, "survival_time": 9.750000000000004, "driven_lanedir": 1.5896252471516426, "get_state_dump": 0.004273538686791245, "get_robot_state": 0.003336261729804837, "sim_render-ego0": 0.0033958736731081593, "get_duckie_state": 1.599594038359973e-06, "in-drivable-lane": 3.65000000000002, "deviation-heading": 1.207568156973917, "agent_compute-ego0": 0.01176812454145782, "complete-iteration": 0.1451979802579296, "set_robot_commands": 0.0019392675283003823, "deviation-center-line": 0.5362740643534367, "driven_lanedir_consec": 1.5896252471516426, "sim_compute_sim_state": 0.008420010002291933, "sim_compute_performance-ego0": 0.0017319929843046227}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2466776297867128, "get_ui_image": 0.03169471938330848, "step_physics": 0.1025956901344093, "survival_time": 5.4999999999999885, "driven_lanedir": 0.311527992636798, "get_state_dump": 0.0042671169246639214, "get_robot_state": 0.003293744078627578, "sim_render-ego0": 0.00340611440641386, "get_duckie_state": 1.57656970324817e-06, "in-drivable-lane": 3.2499999999999907, "deviation-heading": 1.772167965593244, "agent_compute-ego0": 0.011977855149690096, "complete-iteration": 0.16997647285461426, "set_robot_commands": 0.0019447975330524616, "deviation-center-line": 0.182884613614752, "driven_lanedir_consec": 0.311527992636798, "sim_compute_sim_state": 0.008966445922851562, "sim_compute_performance-ego0": 0.0017547414109513567}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.064988625189121, "get_ui_image": 0.03109412482290557, "step_physics": 0.11437623669402767, "survival_time": 4.899999999999991, "driven_lanedir": 0.6325288344380494, "get_state_dump": 0.00476858832619407, "get_robot_state": 0.003916752458822848, "sim_render-ego0": 0.003932386937767568, "get_duckie_state": 1.7532194503630051e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 0.48045599093703767, "agent_compute-ego0": 0.01345756800487788, "complete-iteration": 0.1842212677001953, "set_robot_commands": 0.0023817149075594816, "deviation-center-line": 0.09866160786142976, "driven_lanedir_consec": 0.6325288344380494, "sim_compute_sim_state": 0.00803962620821866, "sim_compute_performance-ego0": 0.0021668540106879342}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7293023168744883, "get_ui_image": 0.023250185781055022, "step_physics": 0.0776069313287735, "survival_time": 7.149999999999983, "driven_lanedir": 0.6379520790787545, "get_state_dump": 0.004234252704514397, "get_robot_state": 0.003204607301288181, "sim_render-ego0": 0.003283277153968811, "get_duckie_state": 1.3907750447591143e-06, "in-drivable-lane": 4.449999999999984, "deviation-heading": 0.4422844963311483, "agent_compute-ego0": 0.01097277800242106, "complete-iteration": 0.13071844312879774, "set_robot_commands": 0.0018745313088099165, "deviation-center-line": 0.14287582893705802, "driven_lanedir_consec": 0.6379520790787545, "sim_compute_sim_state": 0.004562661051750183, "sim_compute_performance-ego0": 0.0016586134831110635}}
set_robot_commands_max	0.0023817149075594816
set_robot_commands_mean	0.0020350778194305605
set_robot_commands_median	0.001942032530676422
set_robot_commands_min	0.0018745313088099165
sim_compute_performance-ego0_max	0.0021668540106879342
sim_compute_performance-ego0_mean	0.0018280504722637445
sim_compute_performance-ego0_median	0.0017433671976279895
sim_compute_performance-ego0_min	0.0016586134831110635
sim_compute_sim_state_max	0.008966445922851562
sim_compute_sim_state_mean	0.007497185796278085
sim_compute_sim_state_median	0.008229818105255297
sim_compute_sim_state_min	0.004562661051750183
sim_render-ego0_max	0.003932386937767568
sim_render-ego0_mean	0.0035044130428145996
sim_render-ego0_median	0.0034009940397610097
sim_render-ego0_min	0.003283277153968811
simulation-passed	1
step_physics_max	0.11437623669402767
step_physics_mean	0.09508130090714328
step_physics_median	0.094171017802886
step_physics_min	0.0776069313287735
survival_time_max	9.750000000000004
survival_time_mean	6.824999999999992
survival_time_min	4.899999999999991

No reset possible

58682

6729

Andrea Censi 🇨🇭

template-random

LFv-sim

success

yes

2020-12-04 02:11:10+00:00

2020-12-04 02:15:10+00:00

0:04:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5040495128145347
survival_time_median	4.6499999999999915
deviation-center-line_median	0.10620228737371736
in-drivable-lane_median	2.674999999999992

other stats

agent_compute-ego0_max	0.010504828559027778
agent_compute-ego0_mean	0.010433763312195804
agent_compute-ego0_median	0.010463280489501157
agent_compute-ego0_min	0.010303663710753122
complete-iteration_max	0.20347191976464313
complete-iteration_mean	0.1774627032443095
complete-iteration_median	0.1744436915497572
complete-iteration_min	0.15749151011308035
deviation-center-line_max	0.16455763165774434
deviation-center-line_mean	0.1092777488823554
deviation-center-line_min	0.06014878912424249
deviation-heading_max	1.819139548495243
deviation-heading_mean	0.860079214882594
deviation-heading_median	0.6517793617099584
deviation-heading_min	0.31761858761521594
driven_any_max	3.078535752374254
driven_any_mean	1.8526223552312917
driven_any_median	1.6219947547238958
driven_any_min	1.0879641591031215
driven_lanedir_consec_max	0.6643282900394009
driven_lanedir_consec_mean	0.4884432809313369
driven_lanedir_consec_min	0.28134580805687714
driven_lanedir_max	0.6643282900394009
driven_lanedir_mean	0.4924956463812869
driven_lanedir_median	0.5121542437144349
driven_lanedir_min	0.28134580805687714
get_duckie_state_max	1.2889504432678225e-06
get_duckie_state_mean	1.2255101368156534e-06
get_duckie_state_median	1.2195688762745273e-06
get_duckie_state_min	1.173952351445737e-06
get_robot_state_max	0.0036751429239908857
get_robot_state_mean	0.003626246797373657
get_robot_state_median	0.0036212551065638097
get_robot_state_min	0.0035873340523761253
get_state_dump_max	0.0047383904457092285
get_state_dump_mean	0.00461504919528378
get_state_dump_median	0.004593540216989564
get_state_dump_min	0.004534725901446765
get_ui_image_max	0.03450518328210582
get_ui_image_mean	0.029680005630714837
get_ui_image_median	0.028822335303248903
get_ui_image_min	0.02657016863425573
in-drivable-lane_max	6.549999999999982
in-drivable-lane_mean	3.3499999999999894
in-drivable-lane_min	1.499999999999995
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.02737603459177138, "step_physics": 0.09812214102926134, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004534725901446765, "get_robot_state": 0.003592053546181208, "sim_render-ego0": 0.003745862200290342, "get_duckie_state": 1.2569789645038073e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.010496294951137108, "complete-iteration": 0.1614642399775831, "set_robot_commands": 0.002150885666473002, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.009420649914801876, "sim_compute_performance-ego0": 0.0019452451150628585}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03450518328210582, "step_physics": 0.1329018629115561, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.004589231117911961, "get_robot_state": 0.0035873340523761253, "sim_render-ego0": 0.003786983697310738, "get_duckie_state": 1.173952351445737e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.010430266027865202, "complete-iteration": 0.20347191976464313, "set_robot_commands": 0.002177590909211532, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.009456997332365616, "sim_compute_performance-ego0": 0.001958880735480267}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.030268636014726423, "step_physics": 0.12288444572024876, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004597849316067166, "get_robot_state": 0.0036751429239908857, "sim_render-ego0": 0.0038037035200330946, "get_duckie_state": 1.1821587880452471e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.010504828559027778, "complete-iteration": 0.18742314312193128, "set_robot_commands": 0.002184185716840956, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.007448630200492011, "sim_compute_performance-ego0": 0.001974976725048489}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.02657016863425573, "step_physics": 0.09947987894217174, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.0047383904457092285, "get_robot_state": 0.003650456666946411, "sim_render-ego0": 0.0036613792181015015, "get_duckie_state": 1.2889504432678225e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.010303663710753122, "complete-iteration": 0.15749151011308035, "set_robot_commands": 0.0022067601482073465, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.004857271909713745, "sim_compute_performance-ego0": 0.0019437149167060852}}
set_robot_commands_max	0.0022067601482073465
set_robot_commands_mean	0.002179855610183209
set_robot_commands_median	0.002180888313026244
set_robot_commands_min	0.002150885666473002
sim_compute_performance-ego0_max	0.001974976725048489
sim_compute_performance-ego0_mean	0.001955704373074425
sim_compute_performance-ego0_median	0.0019520629252715628
sim_compute_performance-ego0_min	0.0019437149167060852
sim_compute_sim_state_max	0.009456997332365616
sim_compute_sim_state_mean	0.007795887339343312
sim_compute_sim_state_median	0.008434640057646943
sim_compute_sim_state_min	0.004857271909713745
sim_render-ego0_max	0.0038037035200330946
sim_render-ego0_mean	0.003749482158933919
sim_render-ego0_median	0.00376642294880054
sim_render-ego0_min	0.0036613792181015015
simulation-passed	1
step_physics_max	0.1329018629115561
step_physics_mean	0.11334708215080948
step_physics_median	0.11118216233121024
step_physics_min	0.09812214102926134
survival_time_max	7.84999999999998
survival_time_mean	5.17499999999999
survival_time_min	3.5499999999999954

No reset possible

58670

6756

Liam Paull 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-04 02:07:59+00:00

2020-12-04 02:10:40+00:00

0:02:41

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58644

6803

Anthony Courchesne 🇨🇦

baseline-duckietown

LFv-sim

failed

yes

2020-12-04 02:04:16+00:00

2020-12-04 02:07:26+00:00

0:03:10

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58636

6800

Anthony Courchesne 🇨🇦

baseline-duckietown

LFv-sim

failed

yes

2020-12-04 02:03:07+00:00

2020-12-04 02:03:54+00:00

0:00:47

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 39, in on_received_observations
              ||     jpg_data = data['camera']['jpg_data']
              || TypeError: 'Duckiebot1Observations' object is not subscriptable
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 474, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
              ||     raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
              || zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method ROSBaselineAgent.on_received_observations of <__main__.ROSBaselineAgent object at 0x7f71df3163d0>>.
              || │       f: <bound method ROSBaselineAgent.on_received_observations of <__main__.ROSBaselineAgent object at 0x7f71df3163d0>>
              || │    args: dict[2]
              || │          │ data:
              || │          │ Duckiebot1Observations
              || │          │ │ camera: JPGImage(jpg_data=71872 bytes b'\xff\xd8\xff\xe0\x00\x10JFIF')
              || │          │ context: <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f71c425cfa0>
              || │ argspec: <class 'inspect.FullArgSpec'>[7]
              || │          #0 [self, context, data]
              || │          #1 None
              || │          #2 None
              || │          #3 None
              || │          #4 []
              || │          #5 None
              || │          #6 dict[2]
              || │             │ context: <class 'zuper_nodes_wrapper.interface.Context'>
              || │             │ data:
              || │             │ dataclass aido_schemas.schemas.Duckiebot1Observations
              || │             │  field  camera : dataclass aido_schemas.protocol_simulator.JPGImage
              || │             │                   field jpg_data : bytes
              || │             │                          __doc__
              || │             │                                            An image in JPG format.
              || │             │
              || │             │                                            jpg_data
              || │             │        __doc__   Duckiebot1Observations(camera: aido_schemas.protoc
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58625

6805

Anthony Courchesne 🇨🇦

baseline-duckietown

LFv-sim

failed

yes

2020-12-04 01:59:26+00:00

2020-12-04 02:02:33+00:00

0:03:07

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58593

6823

Anthony Courchesne 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-04 01:30:49+00:00

2020-12-04 01:59:11+00:00

0:28:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	5.205385464638705
survival_time_median	59.99999999999873
deviation-center-line_median	2.806634559730705
in-drivable-lane_median	8.22499999999999

other stats

agent_compute-ego0_max	0.013085618404226436
agent_compute-ego0_mean	0.012780131394573142
agent_compute-ego0_median	0.0127740756878822
agent_compute-ego0_min	0.012486755798301727
complete-iteration_max	0.22933768550394035
complete-iteration_mean	0.1936844537182495
complete-iteration_median	0.18625439047118608
complete-iteration_min	0.17289134842668544
deviation-center-line_max	3.949581296790671
deviation-center-line_mean	2.6287355594272475
deviation-center-line_min	0.952091821456907
deviation-heading_max	10.3417188011292
deviation-heading_mean	6.984910638904266
deviation-heading_median	7.760958953486893
deviation-heading_min	2.0760058475140744
driven_any_max	7.921197772223129
driven_any_mean	6.312851547014995
driven_any_median	7.917633743226228
driven_any_min	1.4949409293843936
driven_lanedir_consec_max	6.606493022642767
driven_lanedir_consec_mean	4.58154793930551
driven_lanedir_consec_min	1.3089278053018647
driven_lanedir_max	6.677727170119434
driven_lanedir_mean	5.135659023628013
driven_lanedir_median	6.277990559545376
driven_lanedir_min	1.3089278053018647
get_duckie_state_max	1.5065433778532538e-06
get_duckie_state_mean	1.390574853641688e-06
get_duckie_state_median	1.39080813087889e-06
get_duckie_state_min	1.2741397749557186e-06
get_robot_state_max	0.0038335367007418337
get_robot_state_mean	0.003739750954874701
get_robot_state_median	0.0037761897866076775
get_robot_state_min	0.0035730875455416166
get_state_dump_max	0.0049133290855414066
get_state_dump_mean	0.004781098015478035
get_state_dump_median	0.004771927115720674
get_state_dump_min	0.004667208744929387
get_ui_image_max	0.03578574165158909
get_ui_image_mean	0.0314216872090416
get_ui_image_median	0.031040538955389906
get_ui_image_min	0.02781992927379751
in-drivable-lane_max	11.999999999999512
in-drivable-lane_mean	7.562499999999878
in-drivable-lane_min	1.8000000000000176
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 7.921197772223129, "get_ui_image": 0.029731496386881377, "step_physics": 0.10582540732041486, "survival_time": 59.99999999999873, "driven_lanedir": 6.606493022642767, "get_state_dump": 0.004845341476770761, "get_robot_state": 0.0038335367007418337, "sim_render-ego0": 0.003923804237880278, "get_duckie_state": 1.5065433778532538e-06, "in-drivable-lane": 8.749999999999872, "deviation-heading": 6.839670223597505, "agent_compute-ego0": 0.013007480834147812, "complete-iteration": 0.17564366302521997, "set_robot_commands": 0.0023212283973789135, "deviation-center-line": 3.949581296790671, "driven_lanedir_consec": 6.606493022642767, "sim_compute_sim_state": 0.009971877716661592, "sim_compute_performance-ego0": 0.0020855985811409805}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.4949409293843936, "get_ui_image": 0.03578574165158909, "step_physics": 0.15422636198128767, "survival_time": 12.30000000000004, "driven_lanedir": 1.3089278053018647, "get_state_dump": 0.004667208744929387, "get_robot_state": 0.0035730875455416166, "sim_render-ego0": 0.0037643561961679807, "get_duckie_state": 1.2741397749557186e-06, "in-drivable-lane": 1.8000000000000176, "deviation-heading": 2.0760058475140744, "agent_compute-ego0": 0.012540670541616589, "complete-iteration": 0.22933768550394035, "set_robot_commands": 0.0022405294271615837, "deviation-center-line": 0.952091821456907, "driven_lanedir_consec": 1.3089278053018647, "sim_compute_sim_state": 0.01042621145364244, "sim_compute_performance-ego0": 0.0020213464976322312}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.914313952565608, "get_ui_image": 0.03234958152389844, "step_physics": 0.1247976201460026, "survival_time": 59.99999999999873, "driven_lanedir": 5.949488096447985, "get_state_dump": 0.004698512754670587, "get_robot_state": 0.003744829505011998, "sim_render-ego0": 0.003844160719973955, "get_duckie_state": 1.316959911540188e-06, "in-drivable-lane": 11.999999999999512, "deviation-heading": 10.3417188011292, "agent_compute-ego0": 0.012486755798301727, "complete-iteration": 0.19686511791715217, "set_robot_commands": 0.0022741682225718885, "deviation-center-line": 2.5942057838862285, "driven_lanedir_consec": 3.8402139848587744, "sim_compute_sim_state": 0.010471393623320288, "sim_compute_performance-ego0": 0.0021072500055775256}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920953533886847, "get_ui_image": 0.02781992927379751, "step_physics": 0.10823043299952118, "survival_time": 59.99999999999873, "driven_lanedir": 6.677727170119434, "get_state_dump": 0.0049133290855414066, "get_robot_state": 0.003807550068203357, "sim_render-ego0": 0.003921833959447653, "get_duckie_state": 1.4646563502175922e-06, "in-drivable-lane": 7.700000000000109, "deviation-heading": 8.682247683376282, "agent_compute-ego0": 0.013085618404226436, "complete-iteration": 0.17289134842668544, "set_robot_commands": 0.0022950309400852275, "deviation-center-line": 3.0190633355751824, "driven_lanedir_consec": 6.570556944418636, "sim_compute_sim_state": 0.006615234751387699, "sim_compute_performance-ego0": 0.0021040024705770905}}
set_robot_commands_max	0.0023212283973789135
set_robot_commands_mean	0.0022827392467994036
set_robot_commands_median	0.002284599581328558
set_robot_commands_min	0.0022405294271615837
sim_compute_performance-ego0_max	0.0021072500055775256
sim_compute_performance-ego0_mean	0.0020795493887319568
sim_compute_performance-ego0_median	0.0020948005258590355
sim_compute_performance-ego0_min	0.0020213464976322312
sim_compute_sim_state_max	0.010471393623320288
sim_compute_sim_state_mean	0.009371179386253006
sim_compute_sim_state_median	0.010199044585152016
sim_compute_sim_state_min	0.006615234751387699
sim_render-ego0_max	0.003923804237880278
sim_render-ego0_mean	0.003863538778367467
sim_render-ego0_median	0.003882997339710804
sim_render-ego0_min	0.0037643561961679807
simulation-passed	1
step_physics_max	0.15422636198128767
step_physics_mean	0.12326995561180656
step_physics_median	0.11651402657276189
step_physics_min	0.10582540732041486
survival_time_max	59.99999999999873
survival_time_mean	48.07499999999906
survival_time_min	12.30000000000004

No reset possible

58561

6836

exercise_ros_template

LFv-sim

success

yes

2020-12-04 00:44:39+00:00

2020-12-04 01:30:36+00:00

0:45:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	59.99999999999873
deviation-center-line_median	1.2422730096440104
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.013637277506273256
agent_compute-ego0_mean	0.01326826971635334
agent_compute-ego0_median	0.013448221498881648
agent_compute-ego0_min	0.012539358361376813
complete-iteration_max	0.3784651494244553
complete-iteration_mean	0.3219387904491949
complete-iteration_median	0.3266500715014341
complete-iteration_min	0.255989869369456
deviation-center-line_max	4.053503393024394
deviation-center-line_mean	1.731069028434027
deviation-center-line_min	0.386226701423694
deviation-heading_max	27.859809596736422
deviation-heading_mean	14.925250437835436
deviation-heading_median	14.309269950178932
deviation-heading_min	3.22265225424745
driven_any_max	2.6645352591003757e-13
driven_any_mean	1.9984014443252818e-13
driven_any_median	2.6645352591003757e-13
driven_any_min	0.0
driven_lanedir_consec_max	0.000286102294921875
driven_lanedir_consec_mean	7.152557373046875e-05
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.000286102294921875
driven_lanedir_mean	7.152557373046875e-05
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	1.414630137117181e-06
get_duckie_state_mean	1.3449011396905168e-06
get_duckie_state_median	1.3353227080155373e-06
get_duckie_state_min	1.2943290056138114e-06
get_robot_state_max	0.003951176120081511
get_robot_state_mean	0.00392229685080637
get_robot_state_median	0.003917314825605889
get_robot_state_min	0.003903381631932191
get_state_dump_max	0.004913788651745087
get_state_dump_mean	0.004880208258426358
get_state_dump_median	0.004890669493949185
get_state_dump_min	0.004825705394061975
get_ui_image_max	0.03868530811020774
get_ui_image_mean	0.03298793044515096
get_ui_image_median	0.032743217149046835
get_ui_image_min	0.02777997937230246
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.030731931316366205, "step_physics": 0.2345426304949809, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004913788651745087, "get_robot_state": 0.003903381631932191, "sim_render-ego0": 0.0040183708530778595, "get_duckie_state": 1.414630137117181e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.013311763091647158, "complete-iteration": 0.3053096517932901, "set_robot_commands": 0.002425939415416352, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009207086499585002, "sim_compute_performance-ego0": 0.0021607250496310853}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03868530811020774, "step_physics": 0.29627624101980243, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004870098496753905, "get_robot_state": 0.003951176120081511, "sim_render-ego0": 0.004103265535225976, "get_duckie_state": 1.3092177595127434e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013637277506273256, "complete-iteration": 0.3784651494244553, "set_robot_commands": 0.0023795403012824394, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.012263097731298848, "sim_compute_performance-ego0": 0.0022066153654150917}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03475450298172747, "step_physics": 0.27290850376507125, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004825705394061975, "get_robot_state": 0.0039098606220788505, "sim_render-ego0": 0.004007863958709742, "get_duckie_state": 1.2943290056138114e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.01358467990611614, "complete-iteration": 0.34799049120957803, "set_robot_commands": 0.0023812366266433246, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009384719259435192, "sim_compute_performance-ego0": 0.002143131108407077}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02777997937230246, "step_physics": 0.19201358390985976, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004911240491144464, "get_robot_state": 0.0039247690291329285, "sim_render-ego0": 0.00392058211301983, "get_duckie_state": 1.3614276565183312e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.012539358361376813, "complete-iteration": 0.255989869369456, "set_robot_commands": 0.002299406248564327, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00643748982959147, "sim_compute_performance-ego0": 0.0020734193819349355}}
set_robot_commands_max	0.002425939415416352
set_robot_commands_mean	0.002371530647976611
set_robot_commands_median	0.0023803884639628818
set_robot_commands_min	0.002299406248564327
sim_compute_performance-ego0_max	0.0022066153654150917
sim_compute_performance-ego0_mean	0.0021459727263470475
sim_compute_performance-ego0_median	0.002151928079019081
sim_compute_performance-ego0_min	0.0020734193819349355
sim_compute_sim_state_max	0.012263097731298848
sim_compute_sim_state_mean	0.009323098329977629
sim_compute_sim_state_median	0.009295902879510097
sim_compute_sim_state_min	0.00643748982959147
sim_render-ego0_max	0.004103265535225976
sim_render-ego0_mean	0.004012520615008352
sim_render-ego0_median	0.004013117405893801
sim_render-ego0_min	0.00392058211301983
simulation-passed	1
step_physics_max	0.29627624101980243
step_physics_mean	0.2489352397974286
step_physics_median	0.2537255671300261
step_physics_min	0.19201358390985976
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

58537

6846

Daniil Lisus

exercise_ros_template

LFv-sim

success

yes

2020-12-04 00:17:09+00:00

2020-12-04 00:44:24+00:00

0:27:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.504840754270347
survival_time_median	59.99999999999873
deviation-center-line_median	1.216546680069829
in-drivable-lane_median	6.350000000000046

other stats

agent_compute-ego0_max	0.03360922191661164
agent_compute-ego0_mean	0.018005855233487494
agent_compute-ego0_median	0.012885236833698755
agent_compute-ego0_min	0.012643725349940824
complete-iteration_max	0.21255385055743828
complete-iteration_mean	0.18694583498150025
complete-iteration_median	0.17924625937091024
complete-iteration_min	0.17673697062674212
deviation-center-line_max	1.8696151790215392
deviation-center-line_mean	1.1388641753608
deviation-center-line_min	0.2527481622820023
deviation-heading_max	9.376568774460342
deviation-heading_mean	5.133420742076749
deviation-heading_median	4.814821146762741
deviation-heading_min	1.5274719003211694
driven_any_max	6.19228006790988
driven_any_mean	3.903836869838584
driven_any_median	4.3920875509474016
driven_any_min	0.6388923095496536
driven_lanedir_consec_max	5.856121864907712
driven_lanedir_consec_mean	2.77182132963326
driven_lanedir_consec_min	0.22148194508463437
driven_lanedir_max	5.856121864907712
driven_lanedir_mean	2.77182132963326
driven_lanedir_median	2.504840754270347
driven_lanedir_min	0.22148194508463437
get_duckie_state_max	1.4773614202113473e-06
get_duckie_state_mean	1.3903732847332704e-06
get_duckie_state_median	1.3721711922682586e-06
get_duckie_state_min	1.3397893341852168e-06
get_robot_state_max	0.0041073293709735096
get_robot_state_mean	0.0038982782520961393
get_robot_state_median	0.0038548519371153418
get_robot_state_min	0.003776079763180364
get_state_dump_max	0.005022576210600053
get_state_dump_mean	0.004929371341841128
get_state_dump_median	0.004921446476181225
get_state_dump_min	0.004852016204402012
get_ui_image_max	0.03636138275186851
get_ui_image_mean	0.031205173904510337
get_ui_image_median	0.031151778890528743
get_ui_image_min	0.02615575508511533
in-drivable-lane_max	52.799999999998704
in-drivable-lane_mean	17.737499999999663
in-drivable-lane_min	5.449999999999857
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 6.19228006790988, "get_ui_image": 0.02914650235743844, "step_physics": 0.10618111076799658, "survival_time": 59.99999999999873, "driven_lanedir": 5.856121864907712, "get_state_dump": 0.005022576210600053, "get_robot_state": 0.0041073293709735096, "sim_render-ego0": 0.004138564587036438, "get_duckie_state": 1.4773614202113473e-06, "in-drivable-lane": 5.449999999999857, "deviation-heading": 7.665145585116451, "agent_compute-ego0": 0.012643725349940824, "complete-iteration": 0.17673697062674212, "set_robot_commands": 0.0024342616332956994, "deviation-center-line": 1.8696151790215392, "driven_lanedir_consec": 5.856121864907712, "sim_compute_sim_state": 0.010667463226381884, "sim_compute_performance-ego0": 0.0022955018217418713}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6388923095496536, "get_ui_image": 0.03636138275186851, "step_physics": 0.13582155565736154, "survival_time": 9.4, "driven_lanedir": 0.22148194508463437, "get_state_dump": 0.004863843716010846, "get_robot_state": 0.003776079763180364, "sim_render-ego0": 0.0038604698483906096, "get_duckie_state": 1.385098411923363e-06, "in-drivable-lane": 6.350000000000001, "deviation-heading": 1.5274719003211694, "agent_compute-ego0": 0.012670108250209264, "complete-iteration": 0.21255385055743828, "set_robot_commands": 0.002219241762918139, "deviation-center-line": 0.2527481622820023, "driven_lanedir_consec": 0.22148194508463437, "sim_compute_sim_state": 0.010841932246293972, "sim_compute_performance-ego0": 0.0020434957332712}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.124149694540122, "get_ui_image": 0.03315705542361905, "step_physics": 0.1051024731549494, "survival_time": 59.99999999999873, "driven_lanedir": 4.524801239057554, "get_state_dump": 0.004979049236351604, "get_robot_state": 0.0038856671910599606, "sim_render-ego0": 0.003977253276243695, "get_duckie_state": 1.3397893341852168e-06, "in-drivable-lane": 6.35000000000009, "deviation-heading": 9.376568774460342, "agent_compute-ego0": 0.013100365417188252, "complete-iteration": 0.18151831884963823, "set_robot_commands": 0.002339146317887763, "deviation-center-line": 1.8414822001524016, "driven_lanedir_consec": 4.524801239057554, "sim_compute_sim_state": 0.012729516136556936, "sim_compute_performance-ego0": 0.0021456703357553603}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.66002540735468, "get_ui_image": 0.02615575508511533, "step_physics": 0.094111645052971, "survival_time": 59.99999999999873, "driven_lanedir": 0.4848802694831395, "get_state_dump": 0.004852016204402012, "get_robot_state": 0.003824036683170722, "sim_render-ego0": 0.0038447719529506865, "get_duckie_state": 1.3592439726131543e-06, "in-drivable-lane": 52.799999999998704, "deviation-heading": 1.9644967084090297, "agent_compute-ego0": 0.03360922191661164, "complete-iteration": 0.17697419989218224, "set_robot_commands": 0.0022697605558676484, "deviation-center-line": 0.5916111599872568, "driven_lanedir_consec": 0.4848802694831395, "sim_compute_sim_state": 0.006226941806688396, "sim_compute_performance-ego0": 0.001987554945616202}}
set_robot_commands_max	0.0024342616332956994
set_robot_commands_mean	0.002315602567492312
set_robot_commands_median	0.0023044534368777056
set_robot_commands_min	0.002219241762918139
sim_compute_performance-ego0_max	0.0022955018217418713
sim_compute_performance-ego0_mean	0.0021180557090961583
sim_compute_performance-ego0_median	0.00209458303451328
sim_compute_performance-ego0_min	0.001987554945616202
sim_compute_sim_state_max	0.012729516136556936
sim_compute_sim_state_mean	0.010116463353980296
sim_compute_sim_state_median	0.010754697736337929
sim_compute_sim_state_min	0.006226941806688396
sim_render-ego0_max	0.004138564587036438
sim_render-ego0_mean	0.003955264916155357
sim_render-ego0_median	0.003918861562317152
sim_render-ego0_min	0.0038447719529506865
simulation-passed	1
step_physics_max	0.13582155565736154
step_physics_mean	0.11030419615831964
step_physics_median	0.105641791961473
step_physics_min	0.094111645052971
survival_time_max	59.99999999999873
survival_time_mean	47.34999999999904
survival_time_min	9.4

No reset possible

58511

6852

exercise_ros_template

LFv-sim

success

yes

2020-12-04 00:08:09+00:00

2020-12-04 00:16:48+00:00

0:08:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7977062852297826
survival_time_median	13.80000000000006
deviation-center-line_median	0.7387642617362422
in-drivable-lane_median	5.475000000000062

other stats

agent_compute-ego0_max	0.013982437275074146
agent_compute-ego0_mean	0.0130547123512684
agent_compute-ego0_median	0.012794434487513877
agent_compute-ego0_min	0.0126475431549717
complete-iteration_max	0.21309030409212465
complete-iteration_mean	0.18426187741107897
complete-iteration_median	0.1772017428882069
complete-iteration_min	0.16955371977577746
deviation-center-line_max	0.8379408994400002
deviation-center-line_mean	0.702472321769424
deviation-center-line_min	0.4944198641652112
deviation-heading_max	3.423876900832177
deviation-heading_mean	2.6199213467073466
deviation-heading_median	2.76084418784617
deviation-heading_min	1.5341201103048712
driven_any_max	3.1885990819105077
driven_any_mean	2.4443815602124888
driven_any_median	2.5544263020665134
driven_any_min	1.4800745548064211
driven_lanedir_consec_max	1.2441718805886337
driven_lanedir_consec_mean	0.8854596735848215
driven_lanedir_consec_min	0.7022542432910871
driven_lanedir_max	1.875914348046508
driven_lanedir_mean	1.391596169875118
driven_lanedir_median	1.4542227047738432
driven_lanedir_min	0.782024921906278
get_duckie_state_max	1.8252266777886288e-06
get_duckie_state_mean	1.6867527801881914e-06
get_duckie_state_median	1.6752263190041127e-06
get_duckie_state_min	1.571331804955912e-06
get_robot_state_max	0.003946876525878907
get_robot_state_mean	0.0038305817911656226
get_robot_state_median	0.0038440246873745337
get_robot_state_min	0.0036874012640345168
get_state_dump_max	0.005133487560130932
get_state_dump_mean	0.005010483751760888
get_state_dump_median	0.0050048991975178685
get_state_dump_min	0.004898649051876887
get_ui_image_max	0.03647186932740388
get_ui_image_mean	0.03042293309989883
get_ui_image_median	0.029483232098537905
get_ui_image_min	0.026253398875115623
in-drivable-lane_max	8.40000000000007
in-drivable-lane_mean	5.237500000000047
in-drivable-lane_min	1.5999999999999952
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 1.4800745548064211, "get_ui_image": 0.02783257683361966, "step_physics": 0.10335998593663875, "survival_time": 8.09999999999998, "driven_lanedir": 1.2441718805886337, "get_state_dump": 0.004898649051876887, "get_robot_state": 0.003902795124639031, "sim_render-ego0": 0.0038460222489994727, "get_duckie_state": 1.6689300537109375e-06, "in-drivable-lane": 1.5999999999999952, "deviation-heading": 1.5341201103048712, "agent_compute-ego0": 0.012808910908143211, "complete-iteration": 0.16989363190586582, "set_robot_commands": 0.002214556091402206, "deviation-center-line": 0.661690229482047, "driven_lanedir_consec": 1.2441718805886337, "sim_compute_sim_state": 0.00889661999567886, "sim_compute_performance-ego0": 0.002035788963177453}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.507284818486238, "get_ui_image": 0.03647186932740388, "step_physics": 0.13392720134169966, "survival_time": 13.450000000000056, "driven_lanedir": 0.782024921906278, "get_state_dump": 0.005133487560130932, "get_robot_state": 0.003946876525878907, "sim_render-ego0": 0.004069305349279333, "get_duckie_state": 1.8252266777886288e-06, "in-drivable-lane": 8.40000000000007, "deviation-heading": 2.403207090911923, "agent_compute-ego0": 0.013982437275074146, "complete-iteration": 0.21309030409212465, "set_robot_commands": 0.0023460458826135705, "deviation-center-line": 0.4944198641652112, "driven_lanedir_consec": 0.782024921906278, "sim_compute_sim_state": 0.01089457317634865, "sim_compute_performance-ego0": 0.002209945961281105}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.1885990819105077, "get_ui_image": 0.031133887363456143, "step_physics": 0.11556253377457112, "survival_time": 17.050000000000107, "driven_lanedir": 1.664273528959053, "get_state_dump": 0.005037180164404083, "get_robot_state": 0.0036874012640345168, "sim_render-ego0": 0.003833276486536215, "get_duckie_state": 1.571331804955912e-06, "in-drivable-lane": 7.35000000000009, "deviation-heading": 3.423876900832177, "agent_compute-ego0": 0.012779958066884535, "complete-iteration": 0.184509853870548, "set_robot_commands": 0.002191252875746342, "deviation-center-line": 0.8158382939904374, "driven_lanedir_consec": 0.7022542432910871, "sim_compute_sim_state": 0.00818029621191192, "sim_compute_performance-ego0": 0.0020062065961068136}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6015677856467887, "get_ui_image": 0.026253398875115623, "step_physics": 0.10757974503745496, "survival_time": 14.150000000000066, "driven_lanedir": 1.875914348046508, "get_state_dump": 0.004972618230631653, "get_robot_state": 0.003785254250110035, "sim_render-ego0": 0.003915999976681991, "get_duckie_state": 1.6815225842972877e-06, "in-drivable-lane": 3.6000000000000334, "deviation-heading": 3.1184812847804153, "agent_compute-ego0": 0.0126475431549717, "complete-iteration": 0.16955371977577746, "set_robot_commands": 0.002254187221258459, "deviation-center-line": 0.8379408994400002, "driven_lanedir_consec": 0.8133876485532872, "sim_compute_sim_state": 0.005984542235522203, "sim_compute_performance-ego0": 0.0020594823528343525}}
set_robot_commands_max	0.0023460458826135705
set_robot_commands_mean	0.0022515105177551443
set_robot_commands_median	0.0022343716563303327
set_robot_commands_min	0.002191252875746342
sim_compute_performance-ego0_max	0.002209945961281105
sim_compute_performance-ego0_mean	0.0020778559683499306
sim_compute_performance-ego0_median	0.0020476356580059027
sim_compute_performance-ego0_min	0.0020062065961068136
sim_compute_sim_state_max	0.01089457317634865
sim_compute_sim_state_mean	0.008489007904865408
sim_compute_sim_state_median	0.008538458103795391
sim_compute_sim_state_min	0.005984542235522203
sim_render-ego0_max	0.004069305349279333
sim_render-ego0_mean	0.003916151015374254
sim_render-ego0_median	0.003881011112840732
sim_render-ego0_min	0.003833276486536215
simulation-passed	1
step_physics_max	0.13392720134169966
step_physics_mean	0.11510736652259113
step_physics_median	0.11157113940601304
step_physics_min	0.10335998593663875
survival_time_max	17.050000000000107
survival_time_mean	13.187500000000052
survival_time_min	8.09999999999998

No reset possible

58502

9236

exercise_ros_template

LFv-sim

success

yes

2020-12-04 00:00:51+00:00

2020-12-04 00:08:01+00:00

0:07:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6769108319633372
survival_time_median	11.800000000000033
deviation-center-line_median	0.17300581352145625
in-drivable-lane_median	4.85000000000003

other stats

agent_compute-ego0_max	0.014021233705143944
agent_compute-ego0_mean	0.013359086522671367
agent_compute-ego0_median	0.013553715703913068
agent_compute-ego0_min	0.012307680977715386
complete-iteration_max	0.24816755078873545
complete-iteration_mean	0.1934674120764424
complete-iteration_median	0.18296506860278416
complete-iteration_min	0.1597719603114658
deviation-center-line_max	0.5722637954819846
deviation-center-line_mean	0.2504517173865186
deviation-center-line_min	0.08353144702117743
deviation-heading_max	1.709507309723723
deviation-heading_mean	0.925921161446384
deviation-heading_median	0.7058374081086349
deviation-heading_min	0.5825025198445435
driven_any_max	3.1047973641388222
driven_any_mean	1.9858379994800468
driven_any_median	2.255754202203172
driven_any_min	0.32704622937502004
driven_lanedir_consec_max	2.0270705761054875
driven_lanedir_consec_mean	0.8880972660617822
driven_lanedir_consec_min	0.1714968242149668
driven_lanedir_max	2.0270705761054875
driven_lanedir_mean	0.8880972660617822
driven_lanedir_median	0.6769108319633372
driven_lanedir_min	0.1714968242149668
get_duckie_state_max	1.633802551460864e-06
get_duckie_state_mean	1.499320958430119e-06
get_duckie_state_median	1.4850285710885731e-06
get_duckie_state_min	1.3934241400824652e-06
get_robot_state_max	0.00400022428984926
get_robot_state_mean	0.003866110003325607
get_robot_state_median	0.003853349215319367
get_robot_state_min	0.0037575172928144343
get_state_dump_max	0.005249388913002134
get_state_dump_mean	0.005112076365882748
get_state_dump_median	0.005110280227024615
get_state_dump_min	0.004978356096479628
get_ui_image_max	0.03488036371626944
get_ui_image_mean	0.030931178789426583
get_ui_image_median	0.031354130210532356
get_ui_image_min	0.02613609102037218
in-drivable-lane_max	12.150000000000096
in-drivable-lane_mean	5.775000000000039
in-drivable-lane_min	1.2499999999999982
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.85323619361272, "get_ui_image": 0.02905387781104263, "step_physics": 0.10304247522029748, "survival_time": 14.650000000000071, "driven_lanedir": 2.0270705761054875, "get_state_dump": 0.005150593867918261, "get_robot_state": 0.0039169318011017884, "sim_render-ego0": 0.004018151030248525, "get_duckie_state": 1.5440441313244048e-06, "in-drivable-lane": 4.4000000000000625, "deviation-heading": 1.709507309723723, "agent_compute-ego0": 0.013137767104064526, "complete-iteration": 0.17330113397974548, "set_robot_commands": 0.0024060481259612, "deviation-center-line": 0.5722637954819846, "driven_lanedir_consec": 2.0270705761054875, "sim_compute_sim_state": 0.010281475222840602, "sim_compute_performance-ego0": 0.0021925288803723393}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.32704622937502004, "get_ui_image": 0.03488036371626944, "step_physics": 0.17256341340406886, "survival_time": 2.5999999999999988, "driven_lanedir": 0.1714968242149668, "get_state_dump": 0.00506996658613097, "get_robot_state": 0.0037575172928144343, "sim_render-ego0": 0.0040790135005735004, "get_duckie_state": 1.4260130108527417e-06, "in-drivable-lane": 1.2499999999999982, "deviation-heading": 0.7816936044696271, "agent_compute-ego0": 0.013969664303761608, "complete-iteration": 0.24816755078873545, "set_robot_commands": 0.0024471148005071677, "deviation-center-line": 0.08353144702117743, "driven_lanedir_consec": 0.1714968242149668, "sim_compute_sim_state": 0.00924083871661492, "sim_compute_performance-ego0": 0.002061897853635392}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.1047973641388222, "get_ui_image": 0.033654382610022085, "step_physics": 0.11569366783931335, "survival_time": 15.900000000000093, "driven_lanedir": 0.6837641856517811, "get_state_dump": 0.005249388913002134, "get_robot_state": 0.00400022428984926, "sim_render-ego0": 0.004225047030792715, "get_duckie_state": 1.633802551460864e-06, "in-drivable-lane": 12.150000000000096, "deviation-heading": 0.6299812117476429, "agent_compute-ego0": 0.014021233705143944, "complete-iteration": 0.1926290032258228, "set_robot_commands": 0.0023569836511881, "deviation-center-line": 0.1700007084792843, "driven_lanedir_consec": 0.6837641856517811, "sim_compute_sim_state": 0.01105424602951002, "sim_compute_performance-ego0": 0.002272833103670222}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.658272210793624, "get_ui_image": 0.02613609102037218, "step_physics": 0.09902252753575642, "survival_time": 8.949999999999992, "driven_lanedir": 0.6700574782748934, "get_state_dump": 0.004978356096479628, "get_robot_state": 0.0037897666295369464, "sim_render-ego0": 0.0039144463009304475, "get_duckie_state": 1.3934241400824652e-06, "in-drivable-lane": 5.299999999999997, "deviation-heading": 0.5825025198445435, "agent_compute-ego0": 0.012307680977715386, "complete-iteration": 0.1597719603114658, "set_robot_commands": 0.0022778418329026965, "deviation-center-line": 0.1760109185636282, "driven_lanedir_consec": 0.6700574782748934, "sim_compute_sim_state": 0.005262709988488092, "sim_compute_performance-ego0": 0.0019898136456807454}}
set_robot_commands_max	0.0024471148005071677
set_robot_commands_mean	0.002371997102639791
set_robot_commands_median	0.00238151588857465
set_robot_commands_min	0.0022778418329026965
sim_compute_performance-ego0_max	0.002272833103670222
sim_compute_performance-ego0_mean	0.002129268370839674
sim_compute_performance-ego0_median	0.002127213367003866
sim_compute_performance-ego0_min	0.0019898136456807454
sim_compute_sim_state_max	0.01105424602951002
sim_compute_sim_state_mean	0.00895981748936341
sim_compute_sim_state_median	0.009761156969727762
sim_compute_sim_state_min	0.005262709988488092
sim_render-ego0_max	0.004225047030792715
sim_render-ego0_mean	0.004059164465636297
sim_render-ego0_median	0.004048582265411013
sim_render-ego0_min	0.0039144463009304475
simulation-passed	1
step_physics_max	0.17256341340406886
step_physics_mean	0.12258052099985904
step_physics_median	0.10936807152980542
step_physics_min	0.09902252753575642
survival_time_max	15.900000000000093
survival_time_mean	10.525000000000038
survival_time_min	2.5999999999999988

No reset possible

58493

9238

exercise_ros_template

LFv-sim

success

yes

2020-12-03 23:52:41+00:00

2020-12-04 00:00:42+00:00

0:08:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.008769098915205
survival_time_median	11.750000000000032
deviation-center-line_median	0.2926372925751593
in-drivable-lane_median	4.800000000000029

other stats

agent_compute-ego0_max	0.0472389077240566
agent_compute-ego0_mean	0.04195415184539141
agent_compute-ego0_median	0.04163647725623451
agent_compute-ego0_min	0.037304745145040015
complete-iteration_max	0.2624190978284152
complete-iteration_mean	0.21203511174428932
complete-iteration_median	0.20278713476101143
complete-iteration_min	0.18014707962671916
deviation-center-line_max	0.5974171387161349
deviation-center-line_mean	0.31676263408263394
deviation-center-line_min	0.08435881246408236
deviation-heading_max	1.839428651580268
deviation-heading_mean	1.1477496913988772
deviation-heading_median	1.092886250108145
deviation-heading_min	0.56579761379895
driven_any_max	3.859520286481351
driven_any_mean	2.169279333761671
driven_any_median	2.245275653368239
driven_any_min	0.3270457418288548
driven_lanedir_consec_max	2.0483678095879325
driven_lanedir_consec_mean	1.0591197919579438
driven_lanedir_consec_min	0.1705731604134324
driven_lanedir_max	2.0483678095879325
driven_lanedir_mean	1.0591197919579438
driven_lanedir_median	1.008769098915205
driven_lanedir_min	0.1705731604134324
get_duckie_state_max	2.463386483388404e-06
get_duckie_state_mean	2.293391683265368e-06
get_duckie_state_median	2.3249419245675193e-06
get_duckie_state_min	2.0602964005380307e-06
get_robot_state_max	0.003961088712258107
get_robot_state_mean	0.003781622291297786
get_robot_state_median	0.003813571391040332
get_robot_state_min	0.003538257670852373
get_state_dump_max	0.005147885178665981
get_state_dump_mean	0.004835692677992491
get_state_dump_median	0.00487244186336047
get_state_dump_min	0.004450001806583045
get_ui_image_max	0.03321781670650863
get_ui_image_mean	0.03021345103497158
get_ui_image_median	0.030714702655499408
get_ui_image_min	0.02620658212237888
in-drivable-lane_max	12.2500000000001
in-drivable-lane_mean	5.7750000000000385
in-drivable-lane_min	1.2499999999999982
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.832276250902942, "get_ui_image": 0.028555860258128545, "step_physics": 0.09807017649689766, "survival_time": 14.550000000000072, "driven_lanedir": 2.0483678095879325, "get_state_dump": 0.005094302843694817, "get_robot_state": 0.0039003385256414546, "sim_render-ego0": 0.0039502741539315005, "get_duckie_state": 2.463386483388404e-06, "in-drivable-lane": 4.25000000000006, "deviation-heading": 1.3969720124352298, "agent_compute-ego0": 0.037304745145040015, "complete-iteration": 0.1917669324025716, "set_robot_commands": 0.002389176251137093, "deviation-center-line": 0.5974171387161349, "driven_lanedir_consec": 2.0483678095879325, "sim_compute_sim_state": 0.01022423946694152, "sim_compute_performance-ego0": 0.002164864376799701}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3270457418288548, "get_ui_image": 0.03287354505287027, "step_physics": 0.157376784198689, "survival_time": 2.5999999999999988, "driven_lanedir": 0.1705731604134324, "get_state_dump": 0.004450001806583045, "get_robot_state": 0.003538257670852373, "sim_render-ego0": 0.0037675893531655368, "get_duckie_state": 2.0602964005380307e-06, "in-drivable-lane": 1.2499999999999982, "deviation-heading": 0.7888004877810609, "agent_compute-ego0": 0.0472389077240566, "complete-iteration": 0.2624190978284152, "set_robot_commands": 0.002251368648601028, "deviation-center-line": 0.08435881246408236, "driven_lanedir_consec": 0.1705731604134324, "sim_compute_sim_state": 0.008790232100576724, "sim_compute_performance-ego0": 0.002035514363702738}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.859520286481351, "get_ui_image": 0.03321781670650863, "step_physics": 0.10613592384416427, "survival_time": 19.500000000000146, "driven_lanedir": 1.3565476062411692, "get_state_dump": 0.005147885178665981, "get_robot_state": 0.003961088712258107, "sim_render-ego0": 0.004111540591930185, "get_duckie_state": 2.4604065643856895e-06, "in-drivable-lane": 12.2500000000001, "deviation-heading": 1.839428651580268, "agent_compute-ego0": 0.044947516277927875, "complete-iteration": 0.21380733711945127, "set_robot_commands": 0.002428081029516352, "deviation-center-line": 0.4085378036562056, "driven_lanedir_consec": 1.3565476062411692, "sim_compute_sim_state": 0.011541082426105314, "sim_compute_performance-ego0": 0.002201898018722339}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6582750558335355, "get_ui_image": 0.02620658212237888, "step_physics": 0.09383542670143977, "survival_time": 8.949999999999992, "driven_lanedir": 0.6609905915892409, "get_state_dump": 0.004650580883026123, "get_robot_state": 0.003726804256439209, "sim_render-ego0": 0.003766454590691461, "get_duckie_state": 2.189477284749349e-06, "in-drivable-lane": 5.349999999999997, "deviation-heading": 0.56579761379895, "agent_compute-ego0": 0.038325438234541154, "complete-iteration": 0.18014707962671916, "set_robot_commands": 0.002310666773054335, "deviation-center-line": 0.1767367814941131, "driven_lanedir_consec": 0.6609905915892409, "sim_compute_sim_state": 0.005209534698062472, "sim_compute_performance-ego0": 0.00201724370320638}}
set_robot_commands_max	0.002428081029516352
set_robot_commands_mean	0.002344823175577202
set_robot_commands_median	0.002349921512095714
set_robot_commands_min	0.002251368648601028
sim_compute_performance-ego0_max	0.002201898018722339
sim_compute_performance-ego0_mean	0.0021048801156077898
sim_compute_performance-ego0_median	0.0021001893702512196
sim_compute_performance-ego0_min	0.00201724370320638
sim_compute_sim_state_max	0.011541082426105314
sim_compute_sim_state_mean	0.008941272172921507
sim_compute_sim_state_median	0.009507235783759125
sim_compute_sim_state_min	0.005209534698062472
sim_render-ego0_max	0.004111540591930185
sim_render-ego0_mean	0.0038989646724296705
sim_render-ego0_median	0.003858931753548518
sim_render-ego0_min	0.003766454590691461
simulation-passed	1
step_physics_max	0.157376784198689
step_physics_mean	0.11385457781029767
step_physics_median	0.10210305017053098
step_physics_min	0.09383542670143977
survival_time_max	19.500000000000146
survival_time_mean	11.400000000000052
survival_time_min	2.5999999999999988

No reset possible

58471

9243

exercise_ros_template

LFv-sim

success

yes

2020-12-03 23:44:01+00:00

2020-12-03 23:52:27+00:00

0:08:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6946411742740501
survival_time_median	8.949999999999992
deviation-center-line_median	0.2490145281345859
in-drivable-lane_median	4.725000000000035

other stats

agent_compute-ego0_max	0.03625090028986584
agent_compute-ego0_mean	0.026304224826030943
agent_compute-ego0_median	0.02729881665983253
agent_compute-ego0_min	0.014368365694592882
complete-iteration_max	0.23043077618050176
complete-iteration_mean	0.20331116213856257
complete-iteration_median	0.2040423786318229
complete-iteration_min	0.1747291151101027
deviation-center-line_max	1.2692857390580914
deviation-center-line_mean	0.48429665690615753
deviation-center-line_min	0.16987183229736666
deviation-heading_max	2.805421957517778
deviation-heading_mean	1.5469753402969382
deviation-heading_median	1.4008306798333383
deviation-heading_min	0.5808180440032985
driven_any_max	4.928671275017078
driven_any_mean	2.376278391277715
driven_any_median	1.6582508635711823
driven_any_min	1.259940562951416
driven_lanedir_consec_max	3.954751948934782
driven_lanedir_consec_mean	1.5042740607409275
driven_lanedir_consec_min	0.673061945480828
driven_lanedir_max	3.954751948934782
driven_lanedir_mean	1.5113147508306135
driven_lanedir_median	0.7033969510816256
driven_lanedir_min	0.6837131522244205
get_duckie_state_max	1.6372520606834573e-06
get_duckie_state_mean	1.5101590577208847e-06
get_duckie_state_median	1.5170711372888502e-06
get_duckie_state_min	1.3692418956223814e-06
get_robot_state_max	0.004000513703673036
get_robot_state_mean	0.00385998955200634
get_robot_state_median	0.003874929859509382
get_robot_state_min	0.0036895847853335583
get_state_dump_max	0.0051451446293117285
get_state_dump_mean	0.005013499408202094
get_state_dump_median	0.005065172650992578
get_state_dump_min	0.00477850770151149
get_ui_image_max	0.03488226443029649
get_ui_image_mean	0.03125658611549183
get_ui_image_median	0.03110982782736762
get_ui_image_min	0.02792442437693559
in-drivable-lane_max	5.199999999999998
in-drivable-lane_mean	4.500000000000014
in-drivable-lane_min	3.349999999999988
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 4.928671275017078, "get_ui_image": 0.028202656323347633, "step_physics": 0.10001232711280264, "survival_time": 24.550000000000217, "driven_lanedir": 3.954751948934782, "get_state_dump": 0.005011474698539672, "get_robot_state": 0.003788884093121784, "sim_render-ego0": 0.003906927942260494, "get_duckie_state": 1.520645327684356e-06, "in-drivable-lane": 5.000000000000071, "deviation-heading": 2.805421957517778, "agent_compute-ego0": 0.01884794235229492, "complete-iteration": 0.1747291151101027, "set_robot_commands": 0.00236691255879596, "deviation-center-line": 1.2692857390580914, "driven_lanedir_consec": 3.954751948934782, "sim_compute_sim_state": 0.010370805980713388, "sim_compute_performance-ego0": 0.002116033216802085}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.6477547497971692, "get_ui_image": 0.03488226443029649, "step_physics": 0.13236257483839323, "survival_time": 8.899999999999991, "driven_lanedir": 0.7012247058395715, "get_state_dump": 0.00477850770151149, "get_robot_state": 0.0036895847853335583, "sim_render-ego0": 0.003850958200806346, "get_duckie_state": 1.3692418956223814e-06, "in-drivable-lane": 4.449999999999999, "deviation-heading": 2.1726931066388384, "agent_compute-ego0": 0.03625090028986584, "complete-iteration": 0.23043077618050176, "set_robot_commands": 0.002399191510077962, "deviation-center-line": 0.32456372962930324, "driven_lanedir_consec": 0.673061945480828, "sim_compute_sim_state": 0.010060651342296069, "sim_compute_performance-ego0": 0.00205314225990679}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.259940562951416, "get_ui_image": 0.034016999331387604, "step_physics": 0.13819114478318006, "survival_time": 7.099999999999983, "driven_lanedir": 0.6837131522244205, "get_state_dump": 0.0051451446293117285, "get_robot_state": 0.004000513703673036, "sim_render-ego0": 0.004088335103921957, "get_duckie_state": 1.6372520606834573e-06, "in-drivable-lane": 3.349999999999988, "deviation-heading": 0.6289682530278384, "agent_compute-ego0": 0.014368365694592882, "complete-iteration": 0.21361932554445068, "set_robot_commands": 0.0024550044453227437, "deviation-center-line": 0.16987183229736666, "driven_lanedir_consec": 0.6837131522244205, "sim_compute_sim_state": 0.009037046165733071, "sim_compute_performance-ego0": 0.002205430210887135}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6687469773451955, "get_ui_image": 0.02792442437693559, "step_physics": 0.10713295778516908, "survival_time": 8.999999999999993, "driven_lanedir": 0.7055691963236796, "get_state_dump": 0.005118870603445485, "get_robot_state": 0.00396097562589698, "sim_render-ego0": 0.004088333298488216, "get_duckie_state": 1.5134969468933442e-06, "in-drivable-lane": 5.199999999999998, "deviation-heading": 0.5808180440032985, "agent_compute-ego0": 0.035749690967370136, "complete-iteration": 0.19446543171919511, "set_robot_commands": 0.0024597131086317872, "deviation-center-line": 0.17346532663986858, "driven_lanedir_consec": 0.7055691963236796, "sim_compute_sim_state": 0.005773265058823054, "sim_compute_performance-ego0": 0.002153334696648529}}
set_robot_commands_max	0.0024597131086317872
set_robot_commands_mean	0.002420205405707113
set_robot_commands_median	0.002427097977700353
set_robot_commands_min	0.00236691255879596
sim_compute_performance-ego0_max	0.002205430210887135
sim_compute_performance-ego0_mean	0.0021319850960611346
sim_compute_performance-ego0_median	0.002134683956725307
sim_compute_performance-ego0_min	0.00205314225990679
sim_compute_sim_state_max	0.010370805980713388
sim_compute_sim_state_mean	0.008810442136891396
sim_compute_sim_state_median	0.009548848754014568
sim_compute_sim_state_min	0.005773265058823054
sim_render-ego0_max	0.004088335103921957
sim_render-ego0_mean	0.003983638636369254
sim_render-ego0_median	0.003997630620374355
sim_render-ego0_min	0.003850958200806346
simulation-passed	1
step_physics_max	0.13819114478318006
step_physics_mean	0.11942475112988624
step_physics_median	0.11974776631178116
step_physics_min	0.10001232711280264
survival_time_max	24.550000000000217
survival_time_mean	12.387500000000044
survival_time_min	7.099999999999983

No reset possible

58436

12737

Thomas Wiggers 🇳🇱

ppo_v1

LFv-sim

success

yes

2020-12-03 23:11:45+00:00

2020-12-03 23:43:48+00:00

0:32:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	4.063005359889502
survival_time_median	59.349999999998765
deviation-center-line_median	1.696852548781674
in-drivable-lane_median	18.274999999999352

other stats

agent_compute-ego0_max	0.0837852359314346
agent_compute-ego0_mean	0.07701833846296238
agent_compute-ego0_median	0.07641680244908738
agent_compute-ego0_min	0.07145451302224017
complete-iteration_max	0.2591541025858934
complete-iteration_mean	0.2349681553760767
complete-iteration_median	0.23226051116058533
complete-iteration_min	0.2161974965972428
deviation-center-line_max	2.1253446035450927
deviation-center-line_mean	1.427482086272419
deviation-center-line_min	0.19087864398123291
deviation-heading_max	13.713902864637628
deviation-heading_mean	6.880623752735419
deviation-heading_median	6.33004457700938
deviation-heading_min	1.1485029922852863
driven_any_max	8.54357157361525
driven_any_mean	6.161415924995966
driven_any_median	7.14593274494959
driven_any_min	1.810226636469436
driven_lanedir_consec_max	6.25793119530719
driven_lanedir_consec_mean	3.7832156094261
driven_lanedir_consec_min	0.7489205226182056
driven_lanedir_max	6.805917043919255
driven_lanedir_mean	4.294070439966156
driven_lanedir_median	4.81072209666358
driven_lanedir_min	0.7489205226182056
get_duckie_state_max	1.4162182708664004e-06
get_duckie_state_mean	1.3645536474118555e-06
get_duckie_state_median	1.3923949697776066e-06
get_duckie_state_min	1.257206379225808e-06
get_robot_state_max	0.003814206427716194
get_robot_state_mean	0.003763798201377095
get_robot_state_median	0.0038086116363563504
get_robot_state_min	0.003623763105079486
get_state_dump_max	0.004792859097744556
get_state_dump_mean	0.004686001929214093
get_state_dump_median	0.004683900832335816
get_state_dump_min	0.004583346954440185
get_ui_image_max	0.036356879511443306
get_ui_image_mean	0.03149531824245862
get_ui_image_median	0.03139174925268751
get_ui_image_min	0.026840894953016156
in-drivable-lane_max	24.899999999999395
in-drivable-lane_mean	17.97499999999955
in-drivable-lane_min	10.450000000000106
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 8.259784671888047, "get_ui_image": 0.02904426386513182, "step_physics": 0.09351943593338864, "survival_time": 59.99999999999873, "driven_lanedir": 6.805917043919255, "get_state_dump": 0.004715971307492474, "get_robot_state": 0.00381085973893673, "sim_render-ego0": 0.0038225613069176978, "get_duckie_state": 1.4162182708664004e-06, "in-drivable-lane": 14.39999999999918, "deviation-heading": 6.536782212919248, "agent_compute-ego0": 0.07811899149447654, "complete-iteration": 0.22742964802534751, "set_robot_commands": 0.002274626994708694, "deviation-center-line": 1.8308324463656276, "driven_lanedir_consec": 6.25793119530719, "sim_compute_sim_state": 0.009963617634515184, "sim_compute_performance-ego0": 0.0020690684910122303}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.032080818011132, "get_ui_image": 0.036356879511443306, "step_physics": 0.11011130128871592, "survival_time": 59.99999999999873, "driven_lanedir": 3.3060129526878246, "get_state_dump": 0.004651830357179157, "get_robot_state": 0.003806363533775971, "sim_render-ego0": 0.003876272188833016, "get_duckie_state": 1.257206379225808e-06, "in-drivable-lane": 24.899999999999395, "deviation-heading": 13.713902864637628, "agent_compute-ego0": 0.0837852359314346, "complete-iteration": 0.2591541025858934, "set_robot_commands": 0.002235909485003037, "deviation-center-line": 2.1253446035450927, "driven_lanedir_consec": 2.424357355678488, "sim_compute_sim_state": 0.012108971733137727, "sim_compute_performance-ego0": 0.0021304605803223672}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.54357157361525, "get_ui_image": 0.033739234640243206, "step_physics": 0.10319575857608876, "survival_time": 58.6999999999988, "driven_lanedir": 6.315431240639336, "get_state_dump": 0.004792859097744556, "get_robot_state": 0.003814206427716194, "sim_render-ego0": 0.003962785639661424, "get_duckie_state": 1.3874946756565824e-06, "in-drivable-lane": 22.14999999999952, "deviation-heading": 6.123306941099512, "agent_compute-ego0": 0.07145451302224017, "complete-iteration": 0.2370913742958231, "set_robot_commands": 0.0022797874694174907, "deviation-center-line": 1.5628726511977205, "driven_lanedir_consec": 5.701653364100515, "sim_compute_sim_state": 0.011645471491712203, "sim_compute_performance-ego0": 0.002109708988920171}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.810226636469436, "get_ui_image": 0.026840894953016156, "step_physics": 0.09317524883400176, "survival_time": 16.100000000000094, "driven_lanedir": 0.7489205226182056, "get_state_dump": 0.004583346954440185, "get_robot_state": 0.003623763105079486, "sim_render-ego0": 0.003746654965191065, "get_duckie_state": 1.397295263898631e-06, "in-drivable-lane": 10.450000000000106, "deviation-heading": 1.1485029922852863, "agent_compute-ego0": 0.07471461340369824, "complete-iteration": 0.2161974965972428, "set_robot_commands": 0.0021538955877439896, "deviation-center-line": 0.19087864398123291, "driven_lanedir_consec": 0.7489205226182056, "sim_compute_sim_state": 0.005276895528976393, "sim_compute_performance-ego0": 0.001991150179883644}}
set_robot_commands_max	0.0022797874694174907
set_robot_commands_mean	0.002236054884218303
set_robot_commands_median	0.0022552682398558656
set_robot_commands_min	0.0021538955877439896
sim_compute_performance-ego0_max	0.0021304605803223672
sim_compute_performance-ego0_mean	0.002075097060034603
sim_compute_performance-ego0_median	0.0020893887399662005
sim_compute_performance-ego0_min	0.001991150179883644
sim_compute_sim_state_max	0.012108971733137727
sim_compute_sim_state_mean	0.009748739097085376
sim_compute_sim_state_median	0.010804544563113694
sim_compute_sim_state_min	0.005276895528976393
sim_render-ego0_max	0.003962785639661424
sim_render-ego0_mean	0.0038520685251508006
sim_render-ego0_median	0.0038494167478753567
sim_render-ego0_min	0.003746654965191065
simulation-passed	1
step_physics_max	0.11011130128871592
step_physics_mean	0.10000043615804877
step_physics_median	0.0983575972547387
step_physics_min	0.09317524883400176
survival_time_max	59.99999999999873
survival_time_mean	48.69999999999909
survival_time_min	16.100000000000094

No reset possible

58419

9276

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 23:08:45+00:00

2020-12-03 23:11:36+00:00

0:02:51

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58268

9311

Raphael Jean

sim-exercise-1

LFv-sim

success

yes

2020-12-03 22:35:08+00:00

2020-12-03 23:08:30+00:00

0:33:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	5.644590023444685
survival_time_median	59.99999999999873
deviation-center-line_median	2.418537632613565
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.012594220243226876
agent_compute-ego0_mean	0.012197800967020358
agent_compute-ego0_median	0.012298213155144556
agent_compute-ego0_min	0.011600557314565435
complete-iteration_max	0.18557650461284247
complete-iteration_mean	0.16518869264040462
complete-iteration_median	0.16678620853789344
complete-iteration_min	0.14160584887298913
deviation-center-line_max	3.629680815022122
deviation-center-line_mean	2.4795581014493173
deviation-center-line_min	1.451476325548018
deviation-heading_max	13.749373244660916
deviation-heading_mean	9.615990085062716
deviation-heading_median	8.501585350700912
deviation-heading_min	7.711416394188121
driven_any_max	6.9625880043714155
driven_any_mean	5.9923070795521935
driven_any_median	5.738323918227445
driven_any_min	5.529992477382468
driven_lanedir_consec_max	6.859244935515166
driven_lanedir_consec_mean	5.84419549152787
driven_lanedir_consec_min	5.2283569837069415
driven_lanedir_max	6.859244935515166
driven_lanedir_mean	5.84419549152787
driven_lanedir_median	5.644590023444685
driven_lanedir_min	5.2283569837069415
get_duckie_state_max	1.2973067563935978e-06
get_duckie_state_mean	1.2110512421391191e-06
get_duckie_state_median	1.2122423424510337e-06
get_duckie_state_min	1.1224135272608113e-06
get_robot_state_max	0.003818423424434106
get_robot_state_mean	0.00361443846350804
get_robot_state_median	0.0035827262117701904
get_robot_state_min	0.003473878006057676
get_state_dump_max	0.004674841621138472
get_state_dump_mean	0.004606667009618856
get_state_dump_median	0.0046175986305065295
get_state_dump_min	0.0045166291563238925
get_ui_image_max	0.03471304097838644
get_ui_image_mean	0.02921614366010464
get_ui_image_median	0.02882435498487741
get_ui_image_min	0.02450282369227731
in-drivable-lane_max	1.1999999999999318
in-drivable-lane_mean	0.29999999999998295
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 6.9625880043714155, "get_ui_image": 0.026724233516149973, "step_physics": 0.09107177998005202, "survival_time": 59.99999999999873, "driven_lanedir": 6.859244935515166, "get_state_dump": 0.004572140584877389, "get_robot_state": 0.0035362114616476624, "sim_render-ego0": 0.0036000637686520592, "get_duckie_state": 1.2008276311285192e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.929973521298371, "agent_compute-ego0": 0.01205034776095248, "complete-iteration": 0.1549067667977796, "set_robot_commands": 0.002039655459909812, "deviation-center-line": 2.200409406360461, "driven_lanedir_consec": 6.859244935515166, "sim_compute_sim_state": 0.009362733135810998, "sim_compute_performance-ego0": 0.001866105990445584}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.690723538481552, "get_ui_image": 0.03471304097838644, "step_physics": 0.11074726885304066, "survival_time": 59.99999999999873, "driven_lanedir": 5.5864275504041805, "get_state_dump": 0.004674841621138472, "get_robot_state": 0.003629240961892718, "sim_render-ego0": 0.0036798351313251936, "get_duckie_state": 1.2236570537735482e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.073197180103454, "agent_compute-ego0": 0.012546078549336632, "complete-iteration": 0.18557650461284247, "set_robot_commands": 0.0020802080581626926, "deviation-center-line": 2.6366658588666683, "driven_lanedir_consec": 5.5864275504041805, "sim_compute_sim_state": 0.011482720966640856, "sim_compute_performance-ego0": 0.001939657824323338}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.529992477382468, "get_ui_image": 0.030924476453604844, "step_physics": 0.10544372776168072, "survival_time": 59.99999999999873, "driven_lanedir": 5.2283569837069415, "get_state_dump": 0.0046630566761356705, "get_robot_state": 0.003818423424434106, "sim_render-ego0": 0.003885825210368008, "get_duckie_state": 1.2973067563935978e-06, "in-drivable-lane": 1.1999999999999318, "deviation-heading": 13.749373244660916, "agent_compute-ego0": 0.012594220243226876, "complete-iteration": 0.1786656502780073, "set_robot_commands": 0.0022866299110685757, "deviation-center-line": 3.629680815022122, "driven_lanedir_consec": 5.2283569837069415, "sim_compute_sim_state": 0.01284409224441109, "sim_compute_performance-ego0": 0.002117141101084383}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.785924297973337, "get_ui_image": 0.02450282369227731, "step_physics": 0.08426641802505887, "survival_time": 59.99999999999873, "driven_lanedir": 5.702752496485191, "get_state_dump": 0.0045166291563238925, "get_robot_state": 0.003473878006057676, "sim_render-ego0": 0.003523848038926708, "get_duckie_state": 1.1224135272608113e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.711416394188121, "agent_compute-ego0": 0.011600557314565435, "complete-iteration": 0.14160584887298913, "set_robot_commands": 0.002013658703018684, "deviation-center-line": 1.451476325548018, "driven_lanedir_consec": 5.702752496485191, "sim_compute_sim_state": 0.005816288335833522, "sim_compute_performance-ego0": 0.0018134694810116123}}
set_robot_commands_max	0.0022866299110685757
set_robot_commands_mean	0.002105038033039941
set_robot_commands_median	0.0020599317590362523
set_robot_commands_min	0.002013658703018684
sim_compute_performance-ego0_max	0.002117141101084383
sim_compute_performance-ego0_mean	0.0019340935992162296
sim_compute_performance-ego0_median	0.0019028819073844611
sim_compute_performance-ego0_min	0.0018134694810116123
sim_compute_sim_state_max	0.01284409224441109
sim_compute_sim_state_mean	0.009876458670674116
sim_compute_sim_state_median	0.010422727051225926
sim_compute_sim_state_min	0.005816288335833522
sim_render-ego0_max	0.003885825210368008
sim_render-ego0_mean	0.003672393037317992
sim_render-ego0_median	0.003639949449988626
sim_render-ego0_min	0.003523848038926708
simulation-passed	1
step_physics_max	0.11074726885304066
step_physics_mean	0.09788229865495808
step_physics_median	0.09825775387086638
step_physics_min	0.08426641802505887
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

58264

template-pytorch

LFv-sim

aborted

yes

2020-12-03 22:33:53+00:00

2020-12-03 22:34:33+00:00

0:00:40

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58258

11010

template-pytorch

LFv-sim

aborted

yes

2020-12-03 22:32:48+00:00

2020-12-03 22:33:27+00:00

0:00:39

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58252

11012

template-pytorch

LFv-sim

aborted

yes

2020-12-03 22:31:41+00:00

2020-12-03 22:32:19+00:00

0:00:38

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58154

9334

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

success

yes