Duckietown Challenges Home Challenges Submissions

Evaluator 4921

ID4921
evaluatornogpu-prod-02
ownerI don't have one πŸ˜€
machinenogpu-prod_57b05230aafe
processnogpu-prod-02_57b05230aafe
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success21 58161
# timeout
# failed10 58384
# error1 60402
# aborted6 58220
# host-error11 59141
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6040213154Dishank BansalΒ πŸ‡¨πŸ‡¦exercise_state_estimationaido5-LF-sim-validationLFv-simerroryesnogpu-prod-020:10:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6035313093Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:02:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6015211012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6014911012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:32
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6014210933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6013910933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6013610933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:28
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6013211010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6012911010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:28
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6012611010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6012211010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6003911772Ehsan AhmadiΒ πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5995212716Bea Baselines 🐀template-randomaido5-LFP-sim-validationLFP-simsuccessyesnogpu-prod-020:03:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.324999999999992
in-drivable-lane_median2.774999999999994
driven_lanedir_consec_median0.4321482075534334
deviation-center-line_median0.15954927868599478


other stats
agent_compute-ego0_max0.01209809451267637
agent_compute-ego0_mean0.010923348566258055
agent_compute-ego0_median0.010988306061328074
agent_compute-ego0_min0.009618687629699706
complete-iteration_max0.2373518045397772
complete-iteration_mean0.20184882927427727
complete-iteration_median0.20923135270821833
complete-iteration_min0.1515808071408953
deviation-center-line_max0.22312966499424747
deviation-center-line_mean0.16355048574709427
deviation-center-line_min0.11197372062214005
deviation-heading_max1.1731765577527429
deviation-heading_mean0.919352453519212
deviation-heading_median0.85924234065638
deviation-heading_min0.7857485750113451
driven_any_max2.100847232339913
driven_any_mean1.5514062152548211
driven_any_median1.5034346079602865
driven_any_min1.0979084127587997
driven_lanedir_consec_max0.9767221791082258
driven_lanedir_consec_mean0.5077475888170035
driven_lanedir_consec_min0.1899717610529219
driven_lanedir_max0.9767221791082258
driven_lanedir_mean0.5077475888170035
driven_lanedir_median0.4321482075534334
driven_lanedir_min0.1899717610529219
get_duckie_state_max0.023321172286724225
get_duckie_state_mean0.0167617923401319
get_duckie_state_median0.019862719450924955
get_duckie_state_min0.004000558171953474
get_robot_state_max0.0036631402515229726
get_robot_state_mean0.0035074319209345765
get_robot_state_median0.0035103326854200615
get_robot_state_min0.0033459220613752095
get_state_dump_max0.008097077238148656
get_state_dump_mean0.007098501176014356
get_state_dump_median0.007696086822336011
get_state_dump_min0.0049047538212367466
get_ui_image_max0.035872459411621094
get_ui_image_mean0.03104458026864029
get_ui_image_median0.03206048014460654
get_ui_image_min0.02418490137372698
in-drivable-lane_max4.19999999999999
in-drivable-lane_mean2.637499999999994
in-drivable-lane_min0.7999999999999972
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.100847232339913, "get_ui_image": 0.030027621778948552, "step_physics": 0.10800388969224074, "survival_time": 5.749999999999988, "driven_lanedir": 0.1899717610529219, "get_state_dump": 0.008097077238148656, "get_robot_state": 0.0034460487036869444, "sim_render-ego0": 0.003871895115951012, "get_duckie_state": 0.023321172286724225, "in-drivable-lane": 4.19999999999999, "deviation-heading": 1.1731765577527429, "agent_compute-ego0": 0.01209809451267637, "complete-iteration": 0.20027522794131575, "set_robot_commands": 0.002152786172669509, "deviation-center-line": 0.15862358643039717, "driven_lanedir_consec": 0.1899717610529219, "sim_compute_sim_state": 0.00730912027687862, "sim_compute_performance-ego0": 0.001856275673570304}, "LFP-norm-zigzag-000-ego0": {"driven_any": 1.88168671303, "get_ui_image": 0.035872459411621094, "step_physics": 0.1219261373792376, "survival_time": 5.1999999999999895, "driven_lanedir": 0.5108322939725443, "get_state_dump": 0.00783131236121768, "get_robot_state": 0.0036631402515229726, "sim_render-ego0": 0.003875989005679176, "get_duckie_state": 0.01996966770717076, "in-drivable-lane": 3.499999999999993, "deviation-heading": 0.8524889084427177, "agent_compute-ego0": 0.011599654243105934, "complete-iteration": 0.2181874774751209, "set_robot_commands": 0.002100519906906854, "deviation-center-line": 0.1604749709415924, "driven_lanedir_consec": 0.5108322939725443, "sim_compute_sim_state": 0.00929884910583496, "sim_compute_performance-ego0": 0.0019530069260370164}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.0979084127587997, "get_ui_image": 0.03409333851026452, "step_physics": 0.14240474286286728, "survival_time": 3.399999999999996, "driven_lanedir": 0.9767221791082258, "get_state_dump": 0.007560861283454342, "get_robot_state": 0.0035746166671531787, "sim_render-ego0": 0.003803280816561934, "get_duckie_state": 0.01975577119467915, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 0.7857485750113451, "agent_compute-ego0": 0.010376957879550217, "complete-iteration": 0.2373518045397772, "set_robot_commands": 0.00203824734342271, "deviation-center-line": 0.22312966499424747, "driven_lanedir_consec": 0.9767221791082258, "sim_compute_sim_state": 0.011668512786644093, "sim_compute_performance-ego0": 0.0019812238389167233}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.1251825028905729, "get_ui_image": 0.02418490137372698, "step_physics": 0.0930501767567226, "survival_time": 3.4499999999999957, "driven_lanedir": 0.3534641211343226, "get_state_dump": 0.0049047538212367466, "get_robot_state": 0.0033459220613752095, "sim_render-ego0": 0.003541163035801479, "get_duckie_state": 0.004000558171953474, "in-drivable-lane": 2.049999999999996, "deviation-heading": 0.8659957728700425, "agent_compute-ego0": 0.009618687629699706, "complete-iteration": 0.1515808071408953, "set_robot_commands": 0.001936159815107073, "deviation-center-line": 0.11197372062214005, "driven_lanedir_consec": 0.3534641211343226, "sim_compute_sim_state": 0.00516512393951416, "sim_compute_performance-ego0": 0.0017510788781302316}}
set_robot_commands_max0.002152786172669509
set_robot_commands_mean0.0020569283095265367
set_robot_commands_median0.002069383625164782
set_robot_commands_min0.001936159815107073
sim_compute_performance-ego0_max0.0019812238389167233
sim_compute_performance-ego0_mean0.0018853963291635687
sim_compute_performance-ego0_median0.00190464129980366
sim_compute_performance-ego0_min0.0017510788781302316
sim_compute_sim_state_max0.011668512786644093
sim_compute_sim_state_mean0.008360401527217958
sim_compute_sim_state_median0.00830398469135679
sim_compute_sim_state_min0.00516512393951416
sim_render-ego0_max0.003875989005679176
sim_render-ego0_mean0.0037730819934984
sim_render-ego0_median0.003837587966256473
sim_render-ego0_min0.003541163035801479
simulation-passed1
step_physics_max0.14240474286286728
step_physics_mean0.11634623667276706
step_physics_median0.11496501353573917
step_physics_min0.0930501767567226
survival_time_max5.749999999999988
survival_time_mean4.449999999999992
survival_time_min3.399999999999996
No reset possible
5993012716Bea Baselines 🐀template-randomaido5-LFP-sim-validationLFP-simsuccessyesnogpu-prod-020:03:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.324999999999992
in-drivable-lane_median2.774999999999994
driven_lanedir_consec_median0.4321482075534334
deviation-center-line_median0.15954927868599478


other stats
agent_compute-ego0_max0.014358765738351004
agent_compute-ego0_mean0.012286818046858168
agent_compute-ego0_median0.012247276344876
agent_compute-ego0_min0.01029395375932966
complete-iteration_max0.23612066904703777
complete-iteration_mean0.20521186016339887
complete-iteration_median0.2136699124641981
complete-iteration_min0.1573869466781616
deviation-center-line_max0.22312966499424747
deviation-center-line_mean0.16355048574709427
deviation-center-line_min0.11197372062214005
deviation-heading_max1.1731765577527429
deviation-heading_mean0.919352453519212
deviation-heading_median0.85924234065638
deviation-heading_min0.7857485750113451
driven_any_max2.100847232339913
driven_any_mean1.5514062152548211
driven_any_median1.5034346079602865
driven_any_min1.0979084127587997
driven_lanedir_consec_max0.9767221791082258
driven_lanedir_consec_mean0.5077475888170035
driven_lanedir_consec_min0.1899717610529219
driven_lanedir_max0.9767221791082258
driven_lanedir_mean0.5077475888170035
driven_lanedir_median0.4321482075534334
driven_lanedir_min0.1899717610529219
get_duckie_state_max0.027110451254351384
get_duckie_state_mean0.019090171162462713
get_duckie_state_median0.02248795299056154
get_duckie_state_min0.004274327414376395
get_robot_state_max0.004411231903802781
get_robot_state_mean0.0038132028745840657
get_robot_state_median0.0036414452221082607
get_robot_state_min0.003558689150316962
get_state_dump_max0.011254997088991362
get_state_dump_mean0.008848897370109469
get_state_dump_median0.009526075339465407
get_state_dump_min0.005088441712515695
get_ui_image_max0.04001516614641462
get_ui_image_mean0.0323853367721106
get_ui_image_median0.03179239599720232
get_ui_image_min0.02594138894762312
in-drivable-lane_max4.19999999999999
in-drivable-lane_mean2.637499999999994
in-drivable-lane_min0.7999999999999972
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.100847232339913, "get_ui_image": 0.03131072891169581, "step_physics": 0.09911001961806724, "survival_time": 5.749999999999988, "driven_lanedir": 0.1899717610529219, "get_state_dump": 0.011254997088991362, "get_robot_state": 0.003558689150316962, "sim_render-ego0": 0.004291926992350611, "get_duckie_state": 0.027110451254351384, "in-drivable-lane": 4.19999999999999, "deviation-heading": 1.1731765577527429, "agent_compute-ego0": 0.013264329269014555, "complete-iteration": 0.20233652715025277, "set_robot_commands": 0.0019273942914502377, "deviation-center-line": 0.15862358643039717, "driven_lanedir_consec": 0.1899717610529219, "sim_compute_sim_state": 0.00841593125770832, "sim_compute_performance-ego0": 0.002013107825969828}, "LFP-norm-zigzag-000-ego0": {"driven_any": 1.88168671303, "get_ui_image": 0.04001516614641462, "step_physics": 0.12218794822692872, "survival_time": 5.1999999999999895, "driven_lanedir": 0.5108322939725443, "get_state_dump": 0.011154815128871372, "get_robot_state": 0.004411231903802781, "sim_render-ego0": 0.003901726858956473, "get_duckie_state": 0.02436249823797317, "in-drivable-lane": 3.499999999999993, "deviation-heading": 0.8524889084427177, "agent_compute-ego0": 0.014358765738351004, "complete-iteration": 0.23612066904703777, "set_robot_commands": 0.002341899417695545, "deviation-center-line": 0.1604749709415924, "driven_lanedir_consec": 0.5108322939725443, "sim_compute_sim_state": 0.010646956307547433, "sim_compute_performance-ego0": 0.0026527768089657736}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.0979084127587997, "get_ui_image": 0.03227406308270883, "step_physics": 0.12975331320278888, "survival_time": 3.399999999999996, "driven_lanedir": 0.9767221791082258, "get_state_dump": 0.007897335550059443, "get_robot_state": 0.003585089807925017, "sim_render-ego0": 0.003843086353246717, "get_duckie_state": 0.02061340774314991, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 0.7857485750113451, "agent_compute-ego0": 0.011230223420737446, "complete-iteration": 0.2250032977781434, "set_robot_commands": 0.00217878300210704, "deviation-center-line": 0.22312966499424747, "driven_lanedir_consec": 0.9767221791082258, "sim_compute_sim_state": 0.01155994594960973, "sim_compute_performance-ego0": 0.0019806226094563804}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.1251825028905729, "get_ui_image": 0.02594138894762312, "step_physics": 0.094759167943682, "survival_time": 3.4499999999999957, "driven_lanedir": 0.3534641211343226, "get_state_dump": 0.005088441712515695, "get_robot_state": 0.003697800636291504, "sim_render-ego0": 0.003727963992527553, "get_duckie_state": 0.004274327414376395, "in-drivable-lane": 2.049999999999996, "deviation-heading": 0.8659957728700425, "agent_compute-ego0": 0.01029395375932966, "complete-iteration": 0.1573869466781616, "set_robot_commands": 0.0020689759935651505, "deviation-center-line": 0.11197372062214005, "driven_lanedir_consec": 0.3534641211343226, "sim_compute_sim_state": 0.005531593731471471, "sim_compute_performance-ego0": 0.001922767502920968}}
set_robot_commands_max0.002341899417695545
set_robot_commands_mean0.0021292631762044934
set_robot_commands_median0.0021238794978360952
set_robot_commands_min0.0019273942914502377
sim_compute_performance-ego0_max0.0026527768089657736
sim_compute_performance-ego0_mean0.0021423186868282373
sim_compute_performance-ego0_median0.001996865217713104
sim_compute_performance-ego0_min0.001922767502920968
sim_compute_sim_state_max0.01155994594960973
sim_compute_sim_state_mean0.009038606811584238
sim_compute_sim_state_median0.009531443782627876
sim_compute_sim_state_min0.005531593731471471
sim_render-ego0_max0.004291926992350611
sim_render-ego0_mean0.003941176049270339
sim_render-ego0_median0.003872406606101595
sim_render-ego0_min0.003727963992527553
simulation-passed1
step_physics_max0.12975331320278888
step_physics_mean0.1114526122478667
step_physics_median0.11064898392249796
step_physics_min0.094759167943682
survival_time_max5.749999999999988
survival_time_mean4.449999999999992
survival_time_min3.399999999999996
No reset possible
5989012948Thomas WiggersΒ πŸ‡³πŸ‡±ppo_v1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:29:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.897914506437063
survival_time_median59.99999999999873
deviation-center-line_median2.3799805690954345
in-drivable-lane_median2.99999999999984


other stats
agent_compute-ego0_max0.022180473278404573
agent_compute-ego0_mean0.02106749234186505
agent_compute-ego0_median0.020866064642884825
agent_compute-ego0_min0.020357366803285978
complete-iteration_max0.15994812566771496
complete-iteration_mean0.14935409287378887
complete-iteration_median0.15173650701079738
complete-iteration_min0.13399523180584574
deviation-center-line_max2.8415514870950225
deviation-center-line_mean2.1146206828362724
deviation-center-line_min0.8569701060591971
deviation-heading_max11.63813683141236
deviation-heading_mean7.849168045914792
deviation-heading_median8.440637659544393
deviation-heading_min2.8772600331580187
driven_any_max6.525516792775436
driven_any_mean5.972379473238744
driven_any_median5.911673149188842
driven_any_min5.540654801801858
driven_lanedir_consec_max5.797275290348408
driven_lanedir_consec_mean4.946002399847238
driven_lanedir_consec_min4.190905296166417
driven_lanedir_max5.797275290348408
driven_lanedir_mean5.168959790738162
driven_lanedir_median5.343829288218911
driven_lanedir_min4.190905296166417
get_duckie_state_max1.0962818944176965e-06
get_duckie_state_mean1.0458538465453896e-06
get_duckie_state_median1.0357609795690275e-06
get_duckie_state_min1.0156115326258063e-06
get_robot_state_max0.0033363370871563737
get_robot_state_mean0.003247623260137134
get_robot_state_median0.003258660610198162
get_robot_state_min0.003136834732995839
get_state_dump_max0.004211976466627542
get_state_dump_mean0.0040611468189126415
get_state_dump_median0.004034940805733049
get_state_dump_min0.0039627291975569265
get_ui_image_max0.03067332878398657
get_ui_image_mean0.026567922073609716
get_ui_image_median0.026301979720840644
get_ui_image_min0.022994400068771008
in-drivable-lane_max17.499999999999005
in-drivable-lane_mean5.874999999999671
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.540654801801858, "get_ui_image": 0.02428694946581279, "step_physics": 0.07425088945971639, "survival_time": 59.99999999999873, "driven_lanedir": 5.480786398025241, "get_state_dump": 0.0040186511586845965, "get_robot_state": 0.0032813408094877804, "sim_render-ego0": 0.0034705865988624183, "get_duckie_state": 1.0156115326258063e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.698721672840796, "agent_compute-ego0": 0.022180473278404573, "complete-iteration": 0.1442094839780555, "set_robot_commands": 0.0018847310275062733, "deviation-center-line": 2.28715121878434, "driven_lanedir_consec": 5.480786398025241, "sim_compute_sim_state": 0.0090073759013866, "sim_compute_performance-ego0": 0.001752791456338468}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.841822436462023, "get_ui_image": 0.03067332878398657, "step_physics": 0.08475792378211994, "survival_time": 59.99999999999873, "driven_lanedir": 5.206872178412581, "get_state_dump": 0.0039627291975569265, "get_robot_state": 0.003136834732995839, "sim_render-ego0": 0.0033261152627962415, "get_duckie_state": 1.0181922499682882e-06, "in-drivable-lane": 5.699999999999676, "deviation-heading": 11.63813683141236, "agent_compute-ego0": 0.020357366803285978, "complete-iteration": 0.15926353004353927, "set_robot_commands": 0.001758326896521372, "deviation-center-line": 2.4728099194065294, "driven_lanedir_consec": 4.315042614848884, "sim_compute_sim_state": 0.009592784830771518, "sim_compute_performance-ego0": 0.001624145476049825}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.981523861915662, "get_ui_image": 0.028317009975868494, "step_physics": 0.08480433063840588, "survival_time": 59.99999999999873, "driven_lanedir": 5.797275290348408, "get_state_dump": 0.004211976466627542, "get_robot_state": 0.0033363370871563737, "sim_render-ego0": 0.0035099655662746256, "get_duckie_state": 1.0533297091697677e-06, "in-drivable-lane": 0.30000000000000426, "deviation-heading": 10.182553646247989, "agent_compute-ego0": 0.020859017161703627, "complete-iteration": 0.15994812566771496, "set_robot_commands": 0.0018727773432926176, "deviation-center-line": 2.8415514870950225, "driven_lanedir_consec": 5.797275290348408, "sim_compute_sim_state": 0.011213810021037563, "sim_compute_performance-ego0": 0.0017441170698002317}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.525516792775436, "get_ui_image": 0.022994400068771008, "step_physics": 0.07082168046818223, "survival_time": 53.699999999999086, "driven_lanedir": 4.190905296166417, "get_state_dump": 0.0040512304527815, "get_robot_state": 0.0032359804109085436, "sim_render-ego0": 0.003359772881796194, "get_duckie_state": 1.0962818944176965e-06, "in-drivable-lane": 17.499999999999005, "deviation-heading": 2.8772600331580187, "agent_compute-ego0": 0.02087311212406602, "complete-iteration": 0.13399523180584574, "set_robot_commands": 0.0018161197041356289, "deviation-center-line": 0.8569701060591971, "driven_lanedir_consec": 4.190905296166417, "sim_compute_sim_state": 0.005099760987037836, "sim_compute_performance-ego0": 0.0016658232932867006}}
set_robot_commands_max0.0018847310275062733
set_robot_commands_mean0.0018329887428639728
set_robot_commands_median0.0018444485237141231
set_robot_commands_min0.001758326896521372
sim_compute_performance-ego0_max0.001752791456338468
sim_compute_performance-ego0_mean0.0016967193238688063
sim_compute_performance-ego0_median0.001704970181543466
sim_compute_performance-ego0_min0.001624145476049825
sim_compute_sim_state_max0.011213810021037563
sim_compute_sim_state_mean0.00872843293505838
sim_compute_sim_state_median0.009300080366079058
sim_compute_sim_state_min0.005099760987037836
sim_render-ego0_max0.0035099655662746256
sim_render-ego0_mean0.0034166100774323696
sim_render-ego0_median0.003415179740329306
sim_render-ego0_min0.0033261152627962415
simulation-passed1
step_physics_max0.08480433063840588
step_physics_mean0.07865870608710611
step_physics_median0.07950440662091816
step_physics_min0.07082168046818223
survival_time_max59.99999999999873
survival_time_mean58.42499999999882
survival_time_min53.699999999999086
No reset possible
5914110358Liam PaullΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sanitysanity-checkhost-erroryesnogpu-prod-021:02:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

β”‚ container_ids: [8a25b07528541d1972f3e59d86dfda02c0e3fc28f10e4c4306e5c868efe5bb3b,
β”‚                 7f92e31680a1b81dd56e8793a18199a0a897a25ed8c9fed056b648056dc46b29,
β”‚                 6e44b1d908d6a068706c5ee998f0f3fd7654327ace1b5abd4b56959a89e3a5b3]
β”‚      services: dict[4]
β”‚                β”‚ solution:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/liampaull/aido-submissions@sha256:0e949626786b51f9df4f546bb81a1b9bc0114c511f3696869184e0b1510135ac
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[12]
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_IN: /fifos/ego-in
β”‚                β”‚ β”‚ β”‚ AIDO_REQUIRE_GPU: 1
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10358
β”‚                β”‚ β”‚ β”‚ submitter_name: Liam Paull
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/liampaull/aido-submissions:2020_09_30_06_14_23@sha256:0e949626786b51f9df4f546bb81a1b9bc0114c511f3696869184e0b1510135ac
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-02_57b05230aafe}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10358/sanity-check-nogpu-prod-02_57b05230aafe-job59141-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10358/sanity-check-nogpu-prod-02_57b05230aafe-job59141-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_58-33398/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚                β”‚ evaluator:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:9f8c352de4d76e7de198d4dea8278469907949f1ca0595b4e2e12c509be34491
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[10]
β”‚                β”‚ β”‚ β”‚ experiment_manager_parameters:
β”‚                β”‚ β”‚ β”‚ |episodes_per_scenario: 1
β”‚                β”‚ β”‚ β”‚ |episode_length_s: 0.5
β”‚                β”‚ β”‚ β”‚ |min_episode_length_s: 0.0
β”‚                β”‚ β”‚ β”‚ |seed: 20200922
β”‚                β”‚ β”‚ β”‚ |physics_dt: 0.05
β”‚                β”‚ β”‚ β”‚ |max_failures: 2
β”‚                β”‚ β”‚ β”‚ |fifo_dir: /fifos
β”‚                β”‚ β”‚ β”‚ |sim_in: /fifos/simulator-in
β”‚                β”‚ β”‚ β”‚ |sim_out: /fifos/simulator-out
β”‚                β”‚ β”‚ β”‚ |sm_in: /fifos/scenario_maker-in
β”‚                β”‚ β”‚ β”‚ |sm_out: /fifos/scenario_maker-out
β”‚                β”‚ β”‚ β”‚ |timeout_initialization: 120
β”‚                β”‚ β”‚ β”‚ |timeout_regular: 120
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ |port: 10123 # visualization port
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10358
β”‚                β”‚ β”‚ β”‚ submitter_name: Liam Paull
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/liampaull/aido-submissions:2020_09_30_06_14_23@sha256:0e949626786b51f9df4f546bb81a1b9bc0114c511f3696869184e0b1510135ac
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-02_57b05230aafe}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10358/sanity-check-nogpu-prod-02_57b05230aafe-job59141-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10358/sanity-check-nogpu-prod-02_57b05230aafe-job59141-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_58-33398/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚                β”‚ simulator:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:af0283a494930b4d3448453526d9c22469233f65218cb6c37753c3aae5162cbb
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[12]
β”‚                β”‚ β”‚ β”‚ AIDONODE_CONFIG:
β”‚                β”‚ β”‚ β”‚ |env_constructor: Simulator
β”‚                β”‚ β”‚ β”‚ |env_parameters:
β”‚                β”‚ β”‚ β”‚ |  max_steps: 500001 # we don't want the gym to reset itself
β”‚                β”‚ β”‚ β”‚ |  domain_rand: 0
β”‚                β”‚ β”‚ β”‚ |  camera_width: 640
β”‚                β”‚ β”‚ β”‚ |  camera_height: 480
β”‚                β”‚ β”‚ β”‚ |  distortion: true
β”‚                β”‚ β”‚ β”‚ |  num_tris_distractors: 0
β”‚                β”‚ β”‚ β”‚ |  color_ground: [0, 0.3, 0] # green
β”‚                β”‚ β”‚ β”‚ |  enable_leds: true
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_IN: /fifos/simulator-in
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10358
β”‚                β”‚ β”‚ β”‚ submitter_name: Liam Paull
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/liampaull/aido-submissions:2020_09_30_06_14_23@sha256:0e949626786b51f9df4f546bb81a1b9bc0114c511f3696869184e0b1510135ac
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-02_57b05230aafe}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10358/sanity-check-nogpu-prod-02_57b05230aafe-job59141-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10358/sanity-check-nogpu-prod-02_57b05230aafe-job59141-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_58-33398/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚                β”‚ scenario_maker:
β”‚                β”‚ dict[6]
β”‚                β”‚ β”‚ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:e980f12a61e1e1b37982b6b2a5bc22ef89144f627bf1e6ebaeeac554e4bfb877
β”‚                β”‚ β”‚ environment:
β”‚                β”‚ β”‚ dict[12]
β”‚                β”‚ β”‚ β”‚ AIDONODE_CONFIG:
β”‚                β”‚ β”‚ β”‚ |maps:
β”‚                β”‚ β”‚ β”‚ |- udem1
β”‚                β”‚ β”‚ β”‚ |scenarios_per_map: 1
β”‚                β”‚ β”‚ β”‚ |robots_npcs: []
β”‚                β”‚ β”‚ β”‚ |robots_pcs: [ego]
β”‚                β”‚ β”‚ β”‚ |robots_parked: [parked]
β”‚                β”‚ β”‚ β”‚ |nduckies: 1
β”‚                β”‚ β”‚ β”‚ |
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_IN: /fifos/scenario_maker-in
β”‚                β”‚ β”‚ β”‚ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
β”‚                β”‚ β”‚ β”‚ challenge_name: aido5-LF-sanity
β”‚                β”‚ β”‚ β”‚ challenge_step_name: sanity-check
β”‚                β”‚ β”‚ β”‚ submission_id: 10358
β”‚                β”‚ β”‚ β”‚ submitter_name: Liam Paull
β”‚                β”‚ β”‚ β”‚ SUBMISSION_CONTAINER: docker.io/liampaull/aido-submissions:2020_09_30_06_14_23@sha256:0e949626786b51f9df4f546bb81a1b9bc0114c511f3696869184e0b1510135ac
β”‚                β”‚ β”‚ β”‚ username: ubuntu
β”‚                β”‚ β”‚ β”‚ uid: 0
β”‚                β”‚ β”‚ β”‚ USER: ubuntu
β”‚                β”‚ β”‚ β”‚ HOME: /fake-home/ubuntu
β”‚                β”‚ β”‚ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-02_57b05230aafe}
β”‚                β”‚ β”‚ user: 0:0
β”‚                β”‚ β”‚ volumes:
β”‚                β”‚ β”‚ [
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10358/sanity-check-nogpu-prod-02_57b05230aafe-job59141-a-wd:/challenges:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/aido5-LF-sanity/submission10358/sanity-check-nogpu-prod-02_57b05230aafe-job59141-a-fifos:/fifos:rw,
β”‚                β”‚ β”‚  /tmp/duckietown/dt-challenges-runner/20_12_05_13_02_58-33398/fake-ubuntu-home:/fake-home/ubuntu:rw]
β”‚                β”‚ β”‚ networks: {evaluation: {aliases: [evaluation]} }
β”‚           res: dict[3]
β”‚                β”‚ evaluator: 8a25b07528541d1972f3e59d86dfda02c0e3fc28f10e4c4306e5c868efe5bb3b
β”‚                β”‚ simulator: 7f92e31680a1b81dd56e8793a18199a0a897a25ed8c9fed056b648056dc46b29
β”‚                β”‚ solution: 6e44b1d908d6a068706c5ee998f0f3fd7654327ace1b5abd4b56959a89e3a5b3
β”‚         names: dict[3]
β”‚                β”‚ 8a25b07528541d1972f3e59d86dfda02c0e3fc28f10e4c4306e5c868efe5bb3b: nogpu-prod-02_57b05230aafe-job59141-919222_evaluator_1
β”‚                β”‚ 7f92e31680a1b81dd56e8793a18199a0a897a25ed8c9fed056b648056dc46b29: nogpu-prod-02_57b05230aafe-job59141-919222_simulator_1
β”‚                β”‚ 6e44b1d908d6a068706c5ee998f0f3fd7654327ace1b5abd4b56959a89e3a5b3: nogpu-prod-02_57b05230aafe-job59141-919222_solution_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
β”‚ output: |8a25b07528541d1972f3e59d86dfda02c0e3fc28f10e4c4306e5c868efe5bb3b
β”‚         |7f92e31680a1b81dd56e8793a18199a0a897a25ed8c9fed056b648056dc46b29
β”‚         |6e44b1d908d6a068706c5ee998f0f3fd7654327ace1b5abd4b56959a89e3a5b3
β”‚         |
β”‚  names: dict[3]
β”‚         β”‚ 8a25b07528541d1972f3e59d86dfda02c0e3fc28f10e4c4306e5c868efe5bb3b: nogpu-prod-02_57b05230aafe-job59141-919222_evaluator_1
β”‚         β”‚ 7f92e31680a1b81dd56e8793a18199a0a897a25ed8c9fed056b648056dc46b29: nogpu-prod-02_57b05230aafe-job59141-919222_simulator_1
β”‚         β”‚ 6e44b1d908d6a068706c5ee998f0f3fd7654327ace1b5abd4b56959a89e3a5b3: nogpu-prod-02_57b05230aafe-job59141-919222_solution_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5906512772Anastasiya NikolskayaΒ πŸ‡·πŸ‡ΊJetBrains Researchaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesnogpu-prod-021:58:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.829863075760713
survival_time_median44.5999999999996
deviation-center-line_median3.3124846314700447
in-drivable-lane_median0.9250000000000024


other stats
agent_compute-ego0_max0.07267943798673049
agent_compute-ego0_mean0.06022973023735704
agent_compute-ego0_median0.07201526279812565
agent_compute-ego0_min0.04251305070348227
agent_compute-ego1_max0.06003377069643181
agent_compute-ego1_mean0.0421395996997689
agent_compute-ego1_median0.04303519082363082
agent_compute-ego1_min0.027500974447105846
complete-iteration_max1.46506769446216
complete-iteration_mean1.2165751435791825
complete-iteration_median1.3765881146916144
complete-iteration_min0.3873561055932216
deviation-center-line_max10.003283854284051
deviation-center-line_mean3.59886883051031
deviation-center-line_min0.2335611127062102
deviation-heading_max27.27650089628277
deviation-heading_mean12.99920920811586
deviation-heading_median11.773694614710887
deviation-heading_min1.5231196403909717
driven_any_max26.896399430839207
driven_any_mean11.021457124028595
driven_any_median9.547377738734555
driven_any_min0.19274954341445727
driven_lanedir_consec_max26.00390382000138
driven_lanedir_consec_mean10.05468340928121
driven_lanedir_consec_min0.1698915031221575
driven_lanedir_max26.00390382000138
driven_lanedir_mean10.05468340928121
driven_lanedir_median8.829863075760713
driven_lanedir_min0.1698915031221575
get_duckie_state_max1.479369929229292e-06
get_duckie_state_mean1.4151189538257354e-06
get_duckie_state_median1.473887502174904e-06
get_duckie_state_min1.2010261478471715e-06
get_robot_state_max0.014820155714506488
get_robot_state_mean0.013402750570157194
get_robot_state_median0.014436328798232126
get_robot_state_min0.006903770662763533
get_state_dump_max0.00966347684824332
get_state_dump_mean0.008992803850343562
get_state_dump_median0.009635551512441604
get_state_dump_min0.005956178898616794
get_ui_image_max0.04820133190005517
get_ui_image_mean0.04275502166675479
get_ui_image_median0.043945390715587146
get_ui_image_min0.028231432594724937
in-drivable-lane_max54.599999999998744
in-drivable-lane_mean5.296428571428467
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 14.427086661642091, "get_ui_image": 0.04338013692063699, "step_physics": 0.8503196048018624, "survival_time": 39.79999999999987, "driven_lanedir": 12.439304922841476, "get_state_dump": 0.00966347684824332, "get_robot_state": 0.014820155714506488, "sim_render-ego0": 0.0040452175188244064, "sim_render-ego1": 0.0037869889583611576, "sim_render-ego2": 0.0037124147977553768, "sim_render-ego3": 0.003676666070705974, "get_duckie_state": 1.473887502174904e-06, "in-drivable-lane": 3.3999999999999915, "deviation-heading": 12.597363894210131, "agent_compute-ego0": 0.07267943798673049, "agent_compute-ego1": 0.06003377069643181, "agent_compute-ego2": 0.05925982868955605, "agent_compute-ego3": 0.05773688978053994, "complete-iteration": 1.222679140576754, "set_robot_commands": 0.0021814866227517315, "deviation-center-line": 2.1009643914740197, "driven_lanedir_consec": 12.439304922841476, "sim_compute_sim_state": 0.02249412434911788, "sim_compute_performance-ego0": 0.00215321143567936, "sim_compute_performance-ego1": 0.001926328486750087, "sim_compute_performance-ego2": 0.0019210746028043397, "sim_compute_performance-ego3": 0.001882043357475788}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 8.608756432272669, "get_ui_image": 0.04338013692063699, "step_physics": 0.8503196048018624, "survival_time": 39.79999999999987, "driven_lanedir": 8.210662174560742, "get_state_dump": 0.00966347684824332, "get_robot_state": 0.014820155714506488, "sim_render-ego0": 0.0040452175188244064, "sim_render-ego1": 0.0037869889583611576, "sim_render-ego2": 0.0037124147977553768, "sim_render-ego3": 0.003676666070705974, "get_duckie_state": 1.473887502174904e-06, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 8.490436965972615, "agent_compute-ego0": 0.07267943798673049, "agent_compute-ego1": 0.06003377069643181, "agent_compute-ego2": 0.05925982868955605, "agent_compute-ego3": 0.05773688978053994, "complete-iteration": 1.222679140576754, "set_robot_commands": 0.0021814866227517315, "deviation-center-line": 1.6886476147439906, "driven_lanedir_consec": 8.210662174560742, "sim_compute_sim_state": 0.02249412434911788, "sim_compute_performance-ego0": 0.00215321143567936, "sim_compute_performance-ego1": 0.001926328486750087, "sim_compute_performance-ego2": 0.0019210746028043397, "sim_compute_performance-ego3": 0.001882043357475788}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.831130526957928, "get_ui_image": 0.04338013692063699, "step_physics": 0.8503196048018624, "survival_time": 39.79999999999987, "driven_lanedir": 7.008462304423755, "get_state_dump": 0.00966347684824332, "get_robot_state": 0.014820155714506488, "sim_render-ego0": 0.0040452175188244064, "sim_render-ego1": 0.0037869889583611576, "sim_render-ego2": 0.0037124147977553768, "sim_render-ego3": 0.003676666070705974, "get_duckie_state": 1.473887502174904e-06, "in-drivable-lane": 1.1000000000000072, "deviation-heading": 9.98884436482775, "agent_compute-ego0": 0.07267943798673049, "agent_compute-ego1": 0.06003377069643181, "agent_compute-ego2": 0.05925982868955605, "agent_compute-ego3": 0.05773688978053994, "complete-iteration": 1.222679140576754, "set_robot_commands": 0.0021814866227517315, "deviation-center-line": 4.592250512181642, "driven_lanedir_consec": 7.008462304423755, "sim_compute_sim_state": 0.02249412434911788, "sim_compute_performance-ego0": 0.00215321143567936, "sim_compute_performance-ego1": 0.001926328486750087, "sim_compute_performance-ego2": 0.0019210746028043397, "sim_compute_performance-ego3": 0.001882043357475788}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 15.157792506896454, "get_ui_image": 0.04338013692063699, "step_physics": 0.8503196048018624, "survival_time": 39.79999999999987, "driven_lanedir": 14.565262133381252, "get_state_dump": 0.00966347684824332, "get_robot_state": 0.014820155714506488, "sim_render-ego0": 0.0040452175188244064, "sim_render-ego1": 0.0037869889583611576, "sim_render-ego2": 0.0037124147977553768, "sim_render-ego3": 0.003676666070705974, "get_duckie_state": 1.473887502174904e-06, "in-drivable-lane": 0.30000000000000426, "deviation-heading": 9.091400055305495, "agent_compute-ego0": 0.07267943798673049, "agent_compute-ego1": 0.06003377069643181, "agent_compute-ego2": 0.05925982868955605, "agent_compute-ego3": 0.05773688978053994, "complete-iteration": 1.222679140576754, "set_robot_commands": 0.0021814866227517315, "deviation-center-line": 1.8424964998712448, "driven_lanedir_consec": 14.565262133381252, "sim_compute_sim_state": 0.02249412434911788, "sim_compute_performance-ego0": 0.00215321143567936, "sim_compute_performance-ego1": 0.001926328486750087, "sim_compute_performance-ego2": 0.0019210746028043397, "sim_compute_performance-ego3": 0.001882043357475788}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 5.216592968114662, "get_ui_image": 0.04820133190005517, "step_physics": 1.1072992234587802, "survival_time": 44.5999999999996, "driven_lanedir": 4.788013466226515, "get_state_dump": 0.009635551512441604, "get_robot_state": 0.014436328798232126, "sim_render-ego0": 0.004073307735789129, "sim_render-ego1": 0.003747218400073078, "sim_render-ego2": 0.003691148384154043, "sim_render-ego3": 0.003655482513239776, "get_duckie_state": 1.479369929229292e-06, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 9.691802868360408, "agent_compute-ego0": 0.07201526279812565, "agent_compute-ego1": 0.04303519082363082, "agent_compute-ego2": 0.0575660631344273, "agent_compute-ego3": 0.0505834351995624, "complete-iteration": 1.46506769446216, "set_robot_commands": 0.0021705811661808915, "deviation-center-line": 5.362961939735832, "driven_lanedir_consec": 4.788013466226515, "sim_compute_sim_state": 0.029945745980752943, "sim_compute_performance-ego0": 0.0021272664107507447, "sim_compute_performance-ego1": 0.0019541627749350143, "sim_compute_performance-ego2": 0.0019339535297765444, "sim_compute_performance-ego3": 0.0018805154627408052}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 4.615394530159255, "get_ui_image": 0.04820133190005517, "step_physics": 1.1072992234587802, "survival_time": 44.5999999999996, "driven_lanedir": 4.357728353775005, "get_state_dump": 0.009635551512441604, "get_robot_state": 0.014436328798232126, "sim_render-ego0": 0.004073307735789129, "sim_render-ego1": 0.003747218400073078, "sim_render-ego2": 0.003691148384154043, "sim_render-ego3": 0.003655482513239776, "get_duckie_state": 1.479369929229292e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.27650089628277, "agent_compute-ego0": 0.07201526279812565, "agent_compute-ego1": 0.04303519082363082, "agent_compute-ego2": 0.0575660631344273, "agent_compute-ego3": 0.0505834351995624, "complete-iteration": 1.46506769446216, "set_robot_commands": 0.0021705811661808915, "deviation-center-line": 3.855622539663792, "driven_lanedir_consec": 4.357728353775005, "sim_compute_sim_state": 0.029945745980752943, "sim_compute_performance-ego0": 0.0021272664107507447, "sim_compute_performance-ego1": 0.0019541627749350143, "sim_compute_performance-ego2": 0.0019339535297765444, "sim_compute_performance-ego3": 0.0018805154627408052}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 16.172642594463696, "get_ui_image": 0.04820133190005517, "step_physics": 1.1072992234587802, "survival_time": 44.5999999999996, "driven_lanedir": 13.440561857148245, "get_state_dump": 0.009635551512441604, "get_robot_state": 0.014436328798232126, "sim_render-ego0": 0.004073307735789129, "sim_render-ego1": 0.003747218400073078, "sim_render-ego2": 0.003691148384154043, "sim_render-ego3": 0.003655482513239776, "get_duckie_state": 1.479369929229292e-06, "in-drivable-lane": 5.09999999999999, "deviation-heading": 14.564785434998695, "agent_compute-ego0": 0.07201526279812565, "agent_compute-ego1": 0.04303519082363082, "agent_compute-ego2": 0.0575660631344273, "agent_compute-ego3": 0.0505834351995624, "complete-iteration": 1.46506769446216, "set_robot_commands": 0.0021705811661808915, "deviation-center-line": 2.678823760399375, "driven_lanedir_consec": 13.440561857148245, "sim_compute_sim_state": 0.029945745980752943, "sim_compute_performance-ego0": 0.0021272664107507447, "sim_compute_performance-ego1": 0.0019541627749350143, "sim_compute_performance-ego2": 0.0019339535297765444, "sim_compute_performance-ego3": 0.0018805154627408052}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 16.92336793448616, "get_ui_image": 0.04820133190005517, "step_physics": 1.1072992234587802, "survival_time": 44.5999999999996, "driven_lanedir": 15.618340726365568, "get_state_dump": 0.009635551512441604, "get_robot_state": 0.014436328798232126, "sim_render-ego0": 0.004073307735789129, "sim_render-ego1": 0.003747218400073078, "sim_render-ego2": 0.003691148384154043, "sim_render-ego3": 0.003655482513239776, "get_duckie_state": 1.479369929229292e-06, "in-drivable-lane": 1.8499999999999837, "deviation-heading": 10.950025335211642, "agent_compute-ego0": 0.07201526279812565, "agent_compute-ego1": 0.04303519082363082, "agent_compute-ego2": 0.0575660631344273, "agent_compute-ego3": 0.0505834351995624, "complete-iteration": 1.46506769446216, "set_robot_commands": 0.0021705811661808915, "deviation-center-line": 2.34876495915706, "driven_lanedir_consec": 15.618340726365568, "sim_compute_sim_state": 0.029945745980752943, "sim_compute_performance-ego0": 0.0021272664107507447, "sim_compute_performance-ego1": 0.0019541627749350143, "sim_compute_performance-ego2": 0.0019339535297765444, "sim_compute_performance-ego3": 0.0018805154627408052}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.19274954341445727, "get_ui_image": 0.043945390715587146, "step_physics": 1.1355352163513337, "survival_time": 59.99999999999873, "driven_lanedir": 0.1698915031221575, "get_state_dump": 0.00919769566620915, "get_robot_state": 0.014201257151429798, "sim_render-ego0": 0.003946936001487815, "sim_render-ego1": 0.003633896377461836, "sim_render-ego2": 0.0035799524369188192, "sim_render-ego3": 0.0035942539783639775, "get_duckie_state": 1.399145833062292e-06, "in-drivable-lane": 0.0, "deviation-heading": 20.193639449713643, "agent_compute-ego0": 0.04251305070348227, "agent_compute-ego1": 0.027500974447105846, "agent_compute-ego2": 0.03096724429992117, "agent_compute-ego3": 0.024747767515920976, "complete-iteration": 1.3765881146916144, "set_robot_commands": 0.00210388177241215, "deviation-center-line": 10.003283854284051, "driven_lanedir_consec": 0.1698915031221575, "sim_compute_sim_state": 0.016573642910172003, "sim_compute_performance-ego0": 0.0020328503067944073, "sim_compute_performance-ego1": 0.001891495881727792, "sim_compute_performance-ego2": 0.0018381113612979377, "sim_compute_performance-ego3": 0.0018252687192181565}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 10.485999045196444, "get_ui_image": 0.043945390715587146, "step_physics": 1.1355352163513337, "survival_time": 59.99999999999873, "driven_lanedir": 9.449063976960684, "get_state_dump": 0.00919769566620915, "get_robot_state": 0.014201257151429798, "sim_render-ego0": 0.003946936001487815, "sim_render-ego1": 0.003633896377461836, "sim_render-ego2": 0.0035799524369188192, "sim_render-ego3": 0.0035942539783639775, "get_duckie_state": 1.399145833062292e-06, "in-drivable-lane": 1.200000000000017, "deviation-heading": 9.95836240249194, "agent_compute-ego0": 0.04251305070348227, "agent_compute-ego1": 0.027500974447105846, "agent_compute-ego2": 0.03096724429992117, "agent_compute-ego3": 0.024747767515920976, "complete-iteration": 1.3765881146916144, "set_robot_commands": 0.00210388177241215, "deviation-center-line": 4.4292180310805325, "driven_lanedir_consec": 9.449063976960684, "sim_compute_sim_state": 0.016573642910172003, "sim_compute_performance-ego0": 0.0020328503067944073, "sim_compute_performance-ego1": 0.001891495881727792, "sim_compute_performance-ego2": 0.0018381113612979377, "sim_compute_performance-ego3": 0.0018252687192181565}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 4.072035147933128, "get_ui_image": 0.043945390715587146, "step_physics": 1.1355352163513337, "survival_time": 59.99999999999873, "driven_lanedir": 3.755055181789228, "get_state_dump": 0.00919769566620915, "get_robot_state": 0.014201257151429798, "sim_render-ego0": 0.003946936001487815, "sim_render-ego1": 0.003633896377461836, "sim_render-ego2": 0.0035799524369188192, "sim_render-ego3": 0.0035942539783639775, "get_duckie_state": 1.399145833062292e-06, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 15.303753571689636, "agent_compute-ego0": 0.04251305070348227, "agent_compute-ego1": 0.027500974447105846, "agent_compute-ego2": 0.03096724429992117, "agent_compute-ego3": 0.024747767515920976, "complete-iteration": 1.3765881146916144, "set_robot_commands": 0.00210388177241215, "deviation-center-line": 4.62259914890648, "driven_lanedir_consec": 3.755055181789228, "sim_compute_sim_state": 0.016573642910172003, "sim_compute_performance-ego0": 0.0020328503067944073, "sim_compute_performance-ego1": 0.001891495881727792, "sim_compute_performance-ego2": 0.0018381113612979377, "sim_compute_performance-ego3": 0.0018252687192181565}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.2550440490780432, "get_ui_image": 0.043945390715587146, "step_physics": 1.1355352163513337, "survival_time": 59.99999999999873, "driven_lanedir": 1.8059496194978872, "get_state_dump": 0.00919769566620915, "get_robot_state": 0.014201257151429798, "sim_render-ego0": 0.003946936001487815, "sim_render-ego1": 0.003633896377461836, "sim_render-ego2": 0.0035799524369188192, "sim_render-ego3": 0.0035942539783639775, "get_duckie_state": 1.399145833062292e-06, "in-drivable-lane": 54.599999999998744, "deviation-heading": 1.5231196403909717, "agent_compute-ego0": 0.04251305070348227, "agent_compute-ego1": 0.027500974447105846, "agent_compute-ego2": 0.03096724429992117, "agent_compute-ego3": 0.024747767515920976, "complete-iteration": 1.3765881146916144, "set_robot_commands": 0.00210388177241215, "deviation-center-line": 0.2335611127062102, "driven_lanedir_consec": 1.8059496194978872, "sim_compute_sim_state": 0.016573642910172003, "sim_compute_performance-ego0": 0.0020328503067944073, "sim_compute_performance-ego1": 0.001891495881727792, "sim_compute_performance-ego2": 0.0018381113612979377, "sim_compute_performance-ego3": 0.0018252687192181565}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 26.896399430839207, "get_ui_image": 0.028231432594724937, "step_physics": 0.24059405096563868, "survival_time": 59.99999999999873, "driven_lanedir": 26.00390382000138, "get_state_dump": 0.005956178898616794, "get_robot_state": 0.006903770662763533, "sim_render-ego0": 0.003696930200035229, "sim_render-ego1": 0.0035175469197599616, "get_duckie_state": 1.2010261478471715e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.187545685062062, "agent_compute-ego0": 0.04719260868482248, "agent_compute-ego1": 0.03383732596404546, "complete-iteration": 0.3873561055932216, "set_robot_commands": 0.0020448839932456797, "deviation-center-line": 3.1713638878508768, "driven_lanedir_consec": 26.00390382000138, "sim_compute_sim_state": 0.009550615115328492, "sim_compute_performance-ego0": 0.0018969864571322808, "sim_compute_performance-ego1": 0.0017724007392902355}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 21.445408364946136, "get_ui_image": 0.028231432594724937, "step_physics": 0.24059405096563868, "survival_time": 59.99999999999873, "driven_lanedir": 19.153367689843037, "get_state_dump": 0.005956178898616794, "get_robot_state": 0.006903770662763533, "sim_render-ego0": 0.003696930200035229, "sim_render-ego1": 0.0035175469197599616, "get_duckie_state": 1.2010261478471715e-06, "in-drivable-lane": 5.249999999999821, "deviation-heading": 19.171348349104296, "agent_compute-ego0": 0.04719260868482248, "agent_compute-ego1": 0.03383732596404546, "complete-iteration": 0.3873561055932216, "set_robot_commands": 0.0020448839932456797, "deviation-center-line": 3.453605375089213, "driven_lanedir_consec": 19.153367689843037, "sim_compute_sim_state": 0.009550615115328492, "sim_compute_performance-ego0": 0.0018969864571322808, "sim_compute_performance-ego1": 0.0017724007392902355}}
set_robot_commands_max0.0021814866227517315
set_robot_commands_mean0.002136683302276461
set_robot_commands_median0.0021705811661808915
set_robot_commands_min0.0020448839932456797
sim_compute_performance-ego0_max0.00215321143567936
sim_compute_performance-ego0_mean0.002074806109083043
sim_compute_performance-ego0_median0.0021272664107507447
sim_compute_performance-ego0_min0.0018969864571322808
sim_compute_performance-ego1_max0.0019541627749350143
sim_compute_performance-ego1_mean0.001902339289445146
sim_compute_performance-ego1_median0.001926328486750087
sim_compute_performance-ego1_min0.0017724007392902355
sim_compute_sim_state_max0.029945745980752943
sim_compute_sim_state_mean0.021082520227916308
sim_compute_sim_state_median0.02249412434911788
sim_compute_sim_state_min0.009550615115328492
sim_render-ego0_max0.004073307735789129
sim_render-ego0_mean0.003975407530319703
sim_render-ego0_median0.0040452175188244064
sim_render-ego0_min0.003696930200035229
sim_render-ego1_max0.0037869889583611576
sim_render-ego1_mean0.003693393484507444
sim_render-ego1_median0.003747218400073078
sim_render-ego1_min0.0035175469197599616
simulation-passed1
step_physics_max1.1355352163513337
step_physics_mean0.9181288771699416
step_physics_median1.1072992234587802
step_physics_min0.24059405096563868
survival_time_max59.99999999999873
survival_time_mean49.82857142857074
survival_time_min39.79999999999987
No reset possible
5905312756Raphael Jeansim-exercise-1aido5-LFVI-sim-testingLFVIt-simsuccessyesnogpu-prod-020:14:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2658968183885113
survival_time_median13.00000000000005
deviation-center-line_median0.4502729210360886
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013533322417101609
agent_compute-ego0_mean0.013491199433666955
agent_compute-ego0_median0.013491199433666955
agent_compute-ego0_min0.013449076450232304
agent_compute-npc0_max0.05229421623614656
agent_compute-npc0_mean0.048938352885002215
agent_compute-npc0_median0.048938352885002215
agent_compute-npc0_min0.045582489533857865
agent_compute-npc1_max0.045109166484587
agent_compute-npc1_mean0.0385330597377473
agent_compute-npc1_median0.0385330597377473
agent_compute-npc1_min0.03195695299090761
agent_compute-npc2_max0.04361402287202723
agent_compute-npc2_mean0.038130941280494185
agent_compute-npc2_median0.038130941280494185
agent_compute-npc2_min0.032647859688961146
complete-iteration_max1.2051082405389524
complete-iteration_mean1.1295394621218375
complete-iteration_median1.1295394621218375
complete-iteration_min1.053970683704723
deviation-center-line_max0.587836052853812
deviation-center-line_mean0.4502729210360886
deviation-center-line_min0.31270978921836523
deviation-heading_max3.161374782313446
deviation-heading_mean2.2481678789184505
deviation-heading_median2.2481678789184505
deviation-heading_min1.3349609755234553
driven_any_max3.3473308067491203
driven_any_mean2.507548517529137
driven_any_median2.507548517529137
driven_any_min1.667766228309154
driven_lanedir_consec_max3.283993751742866
driven_lanedir_consec_mean2.2658968183885113
driven_lanedir_consec_min1.2477998850341565
driven_lanedir_max3.283994840214164
driven_lanedir_mean2.4663567133153035
driven_lanedir_median2.4663567133153035
driven_lanedir_min1.6487185864164429
get_duckie_state_max1.544711970481552e-06
get_duckie_state_mean1.4811093976608754e-06
get_duckie_state_median1.4811093976608754e-06
get_duckie_state_min1.4175068248401988e-06
get_robot_state_max0.015283788334239611
get_robot_state_mean0.015240200117765446
get_robot_state_median0.015240200117765446
get_robot_state_min0.015196611901291278
get_state_dump_max0.010024110810095525
get_state_dump_mean0.009821602598170394
get_state_dump_median0.009821602598170394
get_state_dump_min0.009619094386245265
get_ui_image_max0.0565568926621552
get_ui_image_mean0.055923295877105504
get_ui_image_median0.055923295877105504
get_ui_image_min0.05528969909205581
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 1.667766228309154, "get_ui_image": 0.05528969909205581, "step_physics": 0.7735791249708696, "survival_time": 8.199999999999982, "driven_lanedir": 1.6487185864164429, "get_state_dump": 0.009619094386245265, "get_robot_state": 0.015283788334239611, "sim_render-ego0": 0.004100123318758878, "sim_render-npc0": 0.004207531611124675, "sim_render-npc1": 0.004217475833314838, "sim_render-npc2": 0.00411470297611121, "get_duckie_state": 1.4175068248401988e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.3349609755234553, "agent_compute-ego0": 0.013449076450232304, "agent_compute-npc0": 0.045582489533857865, "agent_compute-npc1": 0.03195695299090761, "agent_compute-npc2": 0.032647859688961146, "complete-iteration": 1.053970683704723, "set_robot_commands": 0.0024448423674612333, "deviation-center-line": 0.31270978921836523, "driven_lanedir_consec": 1.2477998850341565, "sim_compute_sim_state": 0.04130819060585716, "sim_compute_performance-ego0": 0.00222097888137355, "sim_compute_performance-npc0": 0.002103713064482718, "sim_compute_performance-npc1": 0.0021574005936131333, "sim_compute_performance-npc2": 0.0021162871158484256}, "LFVI-norm-udem1-000-ego0": {"driven_any": 3.3473308067491203, "get_ui_image": 0.0565568926621552, "step_physics": 0.8872796059990463, "survival_time": 17.800000000000118, "driven_lanedir": 3.283994840214164, "get_state_dump": 0.010024110810095525, "get_robot_state": 0.015196611901291278, "sim_render-ego0": 0.00410879292741877, "sim_render-npc0": 0.004282902602721997, "sim_render-npc1": 0.00416976731030547, "sim_render-npc2": 0.004154057061972739, "get_duckie_state": 1.544711970481552e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.161374782313446, "agent_compute-ego0": 0.013533322417101609, "agent_compute-npc0": 0.05229421623614656, "agent_compute-npc1": 0.045109166484587, "agent_compute-npc2": 0.04361402287202723, "complete-iteration": 1.2051082405389524, "set_robot_commands": 0.002548313274436972, "deviation-center-line": 0.587836052853812, "driven_lanedir_consec": 3.283993751742866, "sim_compute_sim_state": 0.046054718541164025, "sim_compute_performance-ego0": 0.002246825301012739, "sim_compute_performance-npc0": 0.002099552074400317, "sim_compute_performance-npc1": 0.0021710202139632708, "sim_compute_performance-npc2": 0.002153526835080956}}
set_robot_commands_max0.002548313274436972
set_robot_commands_mean0.002496577820949103
set_robot_commands_median0.002496577820949103
set_robot_commands_min0.0024448423674612333
sim_compute_performance-ego0_max0.002246825301012739
sim_compute_performance-ego0_mean0.0022339020911931445
sim_compute_performance-ego0_median0.0022339020911931445
sim_compute_performance-ego0_min0.00222097888137355
sim_compute_performance-npc0_max0.002103713064482718
sim_compute_performance-npc0_mean0.002101632569441518
sim_compute_performance-npc0_median0.002101632569441518
sim_compute_performance-npc0_min0.002099552074400317
sim_compute_performance-npc1_max0.0021710202139632708
sim_compute_performance-npc1_mean0.0021642104037882023
sim_compute_performance-npc1_median0.0021642104037882023
sim_compute_performance-npc1_min0.0021574005936131333
sim_compute_performance-npc2_max0.002153526835080956
sim_compute_performance-npc2_mean0.0021349069754646906
sim_compute_performance-npc2_median0.0021349069754646906
sim_compute_performance-npc2_min0.0021162871158484256
sim_compute_sim_state_max0.046054718541164025
sim_compute_sim_state_mean0.043681454573510595
sim_compute_sim_state_median0.043681454573510595
sim_compute_sim_state_min0.04130819060585716
sim_render-ego0_max0.00410879292741877
sim_render-ego0_mean0.004104458123088824
sim_render-ego0_median0.004104458123088824
sim_render-ego0_min0.004100123318758878
sim_render-npc0_max0.004282902602721997
sim_render-npc0_mean0.004245217106923336
sim_render-npc0_median0.004245217106923336
sim_render-npc0_min0.004207531611124675
sim_render-npc1_max0.004217475833314838
sim_render-npc1_mean0.004193621571810155
sim_render-npc1_median0.004193621571810155
sim_render-npc1_min0.00416976731030547
sim_render-npc2_max0.004154057061972739
sim_render-npc2_mean0.004134380019041975
sim_render-npc2_median0.004134380019041975
sim_render-npc2_min0.00411470297611121
simulation-passed1
step_physics_max0.8872796059990463
step_physics_mean0.8304293654849579
step_physics_median0.8304293654849579
step_physics_min0.7735791249708696
survival_time_max17.800000000000118
survival_time_mean13.00000000000005
survival_time_min8.199999999999982
No reset possible
5896412819Yishu MalhotraΒ πŸ‡¨πŸ‡¦sim-exercise-2aido5-LFVI_multi-sim-validationLFVIv-simsuccessyesnogpu-prod-021:35:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.166814603639857
survival_time_median59.99999999999873
deviation-center-line_median4.148953653829019
in-drivable-lane_median1.2499999999999556


other stats
agent_compute-ego0_max0.012728948577258313
agent_compute-ego0_mean0.01262605269683787
agent_compute-ego0_median0.01262605269683787
agent_compute-ego0_min0.01252315681641743
agent_compute-ego1_max0.012959643664903982
agent_compute-ego1_mean0.012544857969292
agent_compute-ego1_median0.012544857969292
agent_compute-ego1_min0.012130072273680017
agent_compute-ego2_max0.01248161858265644
agent_compute-ego2_mean0.01239924675022732
agent_compute-ego2_median0.01239924675022732
agent_compute-ego2_min0.012316874917798195
agent_compute-ego3_max0.013238497121844264
agent_compute-ego3_mean0.012726198624413178
agent_compute-ego3_median0.012726198624413178
agent_compute-ego3_min0.012213900126982091
complete-iteration_max1.413911288822819
complete-iteration_mean1.323762653670045
complete-iteration_median1.323762653670045
complete-iteration_min1.233614018517271
deviation-center-line_max9.460224085619055
deviation-center-line_mean5.298431770652294
deviation-center-line_min1.2430525841086435
deviation-heading_max71.11155347142095
deviation-heading_mean31.83216066471915
deviation-heading_median20.298467495938297
deviation-heading_min10.60132036145986
driven_any_max12.604300345996707
driven_any_mean6.709562754051698
driven_any_median4.1480298868422585
driven_any_min2.3332209047795645
driven_lanedir_consec_max10.914889939919554
driven_lanedir_consec_mean5.374027214168523
driven_lanedir_consec_min1.3415793819509627
driven_lanedir_max11.64423226540997
driven_lanedir_mean6.070433147259616
driven_lanedir_median3.6153473943270074
driven_lanedir_min1.9951286596295172
get_duckie_state_max2.635309440110942e-06
get_duckie_state_mean2.610792625357368e-06
get_duckie_state_median2.610792625357368e-06
get_duckie_state_min2.5862758106037937e-06
get_robot_state_max0.015527276770459128
get_robot_state_mean0.0153860121742077
get_robot_state_median0.0153860121742077
get_robot_state_min0.015244747577956276
get_state_dump_max0.010077770703241886
get_state_dump_mean0.01001379164331263
get_state_dump_median0.01001379164331263
get_state_dump_min0.009949812583383375
get_ui_image_max0.05583780790546554
get_ui_image_mean0.054915828768359334
get_ui_image_median0.054915828768359334
get_ui_image_min0.05399384963125313
in-drivable-lane_max2.6499999999999986
in-drivable-lane_mean1.243749999999994
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 12.18742153172581, "get_ui_image": 0.05583780790546554, "step_physics": 1.0366525868392804, "survival_time": 59.99999999999873, "driven_lanedir": 11.2274149736381, "get_state_dump": 0.010077770703241886, "get_robot_state": 0.015244747577956276, "sim_render-ego0": 0.004191797440693241, "sim_render-ego1": 0.004324262088581883, "sim_render-ego2": 0.004269936995939053, "sim_render-ego3": 0.004249896137640935, "get_duckie_state": 2.5862758106037937e-06, "in-drivable-lane": 1.0499999999999403, "deviation-heading": 17.846113744248758, "agent_compute-ego0": 0.01252315681641743, "agent_compute-ego1": 0.012130072273680017, "agent_compute-ego2": 0.012316874917798195, "agent_compute-ego3": 0.012213900126982091, "complete-iteration": 1.233614018517271, "set_robot_commands": 0.0025900249973522635, "deviation-center-line": 4.1342267026507145, "driven_lanedir_consec": 9.764009566180365, "sim_compute_sim_state": 0.030396535732069185, "sim_compute_performance-ego0": 0.002334481572032868, "sim_compute_performance-ego1": 0.0021713591932158586, "sim_compute_performance-ego2": 0.0022227089172795252, "sim_compute_performance-ego3": 0.002175872867847859}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 3.455965992358576, "get_ui_image": 0.05583780790546554, "step_physics": 1.0366525868392804, "survival_time": 59.99999999999873, "driven_lanedir": 2.8104271990961855, "get_state_dump": 0.010077770703241886, "get_robot_state": 0.015244747577956276, "sim_render-ego0": 0.004191797440693241, "sim_render-ego1": 0.004324262088581883, "sim_render-ego2": 0.004269936995939053, "sim_render-ego3": 0.004249896137640935, "get_duckie_state": 2.5862758106037937e-06, "in-drivable-lane": 1.7500000000000204, "deviation-heading": 60.93507272582757, "agent_compute-ego0": 0.01252315681641743, "agent_compute-ego1": 0.012130072273680017, "agent_compute-ego2": 0.012316874917798195, "agent_compute-ego3": 0.012213900126982091, "complete-iteration": 1.233614018517271, "set_robot_commands": 0.0025900249973522635, "deviation-center-line": 1.2430525841086435, "driven_lanedir_consec": 2.7622551507618947, "sim_compute_sim_state": 0.030396535732069185, "sim_compute_performance-ego0": 0.002334481572032868, "sim_compute_performance-ego1": 0.0021713591932158586, "sim_compute_performance-ego2": 0.0022227089172795252, "sim_compute_performance-ego3": 0.002175872867847859}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 12.268510889678783, "get_ui_image": 0.05583780790546554, "step_physics": 1.0366525868392804, "survival_time": 59.99999999999873, "driven_lanedir": 11.592483050161242, "get_state_dump": 0.010077770703241886, "get_robot_state": 0.015244747577956276, "sim_render-ego0": 0.004191797440693241, "sim_render-ego1": 0.004324262088581883, "sim_render-ego2": 0.004269936995939053, "sim_render-ego3": 0.004249896137640935, "get_duckie_state": 2.5862758106037937e-06, "in-drivable-lane": 0.0, "deviation-heading": 16.90898745775935, "agent_compute-ego0": 0.01252315681641743, "agent_compute-ego1": 0.012130072273680017, "agent_compute-ego2": 0.012316874917798195, "agent_compute-ego3": 0.012213900126982091, "complete-iteration": 1.233614018517271, "set_robot_commands": 0.0025900249973522635, "deviation-center-line": 4.163680605007324, "driven_lanedir_consec": 10.605954037761297, "sim_compute_sim_state": 0.030396535732069185, "sim_compute_performance-ego0": 0.002334481572032868, "sim_compute_performance-ego1": 0.0021713591932158586, "sim_compute_performance-ego2": 0.0022227089172795252, "sim_compute_performance-ego3": 0.002175872867847859}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 3.4878716636512905, "get_ui_image": 0.05583780790546554, "step_physics": 1.0366525868392804, "survival_time": 59.99999999999873, "driven_lanedir": 3.264910752404535, "get_state_dump": 0.010077770703241886, "get_robot_state": 0.015244747577956276, "sim_render-ego0": 0.004191797440693241, "sim_render-ego1": 0.004324262088581883, "sim_render-ego2": 0.004269936995939053, "sim_render-ego3": 0.004249896137640935, "get_duckie_state": 2.5862758106037937e-06, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 10.60132036145986, "agent_compute-ego0": 0.01252315681641743, "agent_compute-ego1": 0.012130072273680017, "agent_compute-ego2": 0.012316874917798195, "agent_compute-ego3": 0.012213900126982091, "complete-iteration": 1.233614018517271, "set_robot_commands": 0.0025900249973522635, "deviation-center-line": 8.11323364211532, "driven_lanedir_consec": 1.9935910277495543, "sim_compute_sim_state": 0.030396535732069185, "sim_compute_performance-ego0": 0.002334481572032868, "sim_compute_performance-ego1": 0.0021713591932158586, "sim_compute_performance-ego2": 0.0022227089172795252, "sim_compute_performance-ego3": 0.002175872867847859}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 12.604300345996707, "get_ui_image": 0.05399384963125313, "step_physics": 1.2216152932423536, "survival_time": 59.99999999999873, "driven_lanedir": 11.64423226540997, "get_state_dump": 0.009949812583383375, "get_robot_state": 0.015527276770459128, "sim_render-ego0": 0.0041867275222155775, "sim_render-ego1": 0.0043891167064987555, "sim_render-ego2": 0.004376801721857152, "sim_render-ego3": 0.004364922084379553, "get_duckie_state": 2.635309440110942e-06, "in-drivable-lane": 1.4499999999999709, "deviation-heading": 15.927181175321431, "agent_compute-ego0": 0.012728948577258313, "agent_compute-ego1": 0.012959643664903982, "agent_compute-ego2": 0.01248161858265644, "agent_compute-ego3": 0.013238497121844264, "complete-iteration": 1.413911288822819, "set_robot_commands": 0.002631931479626353, "deviation-center-line": 3.7738570166391816, "driven_lanedir_consec": 10.914889939919554, "sim_compute_sim_state": 0.02473727511327332, "sim_compute_performance-ego0": 0.0022734480039166174, "sim_compute_performance-ego1": 0.0021670353005668903, "sim_compute_performance-ego2": 0.0021941651908880862, "sim_compute_performance-ego3": 0.002203987202576853}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 2.531022594189633, "get_ui_image": 0.05399384963125313, "step_physics": 1.2216152932423536, "survival_time": 59.99999999999873, "driven_lanedir": 2.0630842414879016, "get_state_dump": 0.009949812583383375, "get_robot_state": 0.015527276770459128, "sim_render-ego0": 0.0041867275222155775, "sim_render-ego1": 0.0043891167064987555, "sim_render-ego2": 0.004376801721857152, "sim_render-ego3": 0.004364922084379553, "get_duckie_state": 2.635309440110942e-06, "in-drivable-lane": 2.0000000000000195, "deviation-heading": 71.11155347142095, "agent_compute-ego0": 0.012728948577258313, "agent_compute-ego1": 0.012959643664903982, "agent_compute-ego2": 0.01248161858265644, "agent_compute-ego3": 0.013238497121844264, "complete-iteration": 1.413911288822819, "set_robot_commands": 0.002631931479626353, "deviation-center-line": 8.163625985642723, "driven_lanedir_consec": 2.038564552506743, "sim_compute_sim_state": 0.02473727511327332, "sim_compute_performance-ego0": 0.0022734480039166174, "sim_compute_performance-ego1": 0.0021670353005668903, "sim_compute_performance-ego2": 0.0021941651908880862, "sim_compute_performance-ego3": 0.002203987202576853}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 4.808188110033226, "get_ui_image": 0.05399384963125313, "step_physics": 1.2216152932423536, "survival_time": 59.99999999999873, "driven_lanedir": 3.965784036249479, "get_state_dump": 0.009949812583383375, "get_robot_state": 0.015527276770459128, "sim_render-ego0": 0.0041867275222155775, "sim_render-ego1": 0.0043891167064987555, "sim_render-ego2": 0.004376801721857152, "sim_render-ego3": 0.004364922084379553, "get_duckie_state": 2.635309440110942e-06, "in-drivable-lane": 2.6499999999999986, "deviation-heading": 38.57623513408748, "agent_compute-ego0": 0.012728948577258313, "agent_compute-ego1": 0.012959643664903982, "agent_compute-ego2": 0.01248161858265644, "agent_compute-ego3": 0.013238497121844264, "complete-iteration": 1.413911288822819, "set_robot_commands": 0.002631931479626353, "deviation-center-line": 3.3355535434353905, "driven_lanedir_consec": 3.5713740565178194, "sim_compute_sim_state": 0.02473727511327332, "sim_compute_performance-ego0": 0.0022734480039166174, "sim_compute_performance-ego1": 0.0021670353005668903, "sim_compute_performance-ego2": 0.0021941651908880862, "sim_compute_performance-ego3": 0.002203987202576853}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 2.3332209047795645, "get_ui_image": 0.05399384963125313, "step_physics": 1.2216152932423536, "survival_time": 59.99999999999873, "driven_lanedir": 1.9951286596295172, "get_state_dump": 0.009949812583383375, "get_robot_state": 0.015527276770459128, "sim_render-ego0": 0.0041867275222155775, "sim_render-ego1": 0.0043891167064987555, "sim_render-ego2": 0.004376801721857152, "sim_render-ego3": 0.004364922084379553, "get_duckie_state": 2.635309440110942e-06, "in-drivable-lane": 0.7500000000000027, "deviation-heading": 22.75082124762783, "agent_compute-ego0": 0.012728948577258313, "agent_compute-ego1": 0.012959643664903982, "agent_compute-ego2": 0.01248161858265644, "agent_compute-ego3": 0.013238497121844264, "complete-iteration": 1.413911288822819, "set_robot_commands": 0.002631931479626353, "deviation-center-line": 9.460224085619055, "driven_lanedir_consec": 1.3415793819509627, "sim_compute_sim_state": 0.02473727511327332, "sim_compute_performance-ego0": 0.0022734480039166174, "sim_compute_performance-ego1": 0.0021670353005668903, "sim_compute_performance-ego2": 0.0021941651908880862, "sim_compute_performance-ego3": 0.002203987202576853}}
set_robot_commands_max0.002631931479626353
set_robot_commands_mean0.002610978238489308
set_robot_commands_median0.002610978238489308
set_robot_commands_min0.0025900249973522635
sim_compute_performance-ego0_max0.002334481572032868
sim_compute_performance-ego0_mean0.0023039647879747427
sim_compute_performance-ego0_median0.0023039647879747427
sim_compute_performance-ego0_min0.0022734480039166174
sim_compute_performance-ego1_max0.0021713591932158586
sim_compute_performance-ego1_mean0.0021691972468913744
sim_compute_performance-ego1_median0.0021691972468913744
sim_compute_performance-ego1_min0.0021670353005668903
sim_compute_performance-ego2_max0.0022227089172795252
sim_compute_performance-ego2_mean0.0022084370540838057
sim_compute_performance-ego2_median0.0022084370540838057
sim_compute_performance-ego2_min0.0021941651908880862
sim_compute_performance-ego3_max0.002203987202576853
sim_compute_performance-ego3_mean0.0021899300352123557
sim_compute_performance-ego3_median0.0021899300352123557
sim_compute_performance-ego3_min0.002175872867847859
sim_compute_sim_state_max0.030396535732069185
sim_compute_sim_state_mean0.02756690542267125
sim_compute_sim_state_median0.02756690542267125
sim_compute_sim_state_min0.02473727511327332
sim_render-ego0_max0.004191797440693241
sim_render-ego0_mean0.004189262481454409
sim_render-ego0_median0.004189262481454409
sim_render-ego0_min0.0041867275222155775
sim_render-ego1_max0.0043891167064987555
sim_render-ego1_mean0.004356689397540319
sim_render-ego1_median0.004356689397540319
sim_render-ego1_min0.004324262088581883
sim_render-ego2_max0.004376801721857152
sim_render-ego2_mean0.004323369358898103
sim_render-ego2_median0.004323369358898103
sim_render-ego2_min0.004269936995939053
sim_render-ego3_max0.004364922084379553
sim_render-ego3_mean0.004307409111010244
sim_render-ego3_median0.004307409111010244
sim_render-ego3_min0.004249896137640935
simulation-passed1
step_physics_max1.2216152932423536
step_physics_mean1.1291339400408171
step_physics_median1.1291339400408171
step_physics_min1.0366525868392804
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5895712766Anastasiya NikolskayaΒ πŸ‡·πŸ‡ΊJetBrains Researchaido5-LFP-sim-validationLFP-simsuccessnonogpu-prod-020:05:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.149999999999986
in-drivable-lane_median0.0
driven_lanedir_consec_median1.6700998441725898
deviation-center-line_median0.3320116784695889


other stats
agent_compute-ego0_max0.055443951179241314
agent_compute-ego0_mean0.050262071873750314
agent_compute-ego0_median0.053074642446820405
agent_compute-ego0_min0.03945505142211914
complete-iteration_max0.3797647767853968
complete-iteration_mean0.3459592981740787
complete-iteration_median0.3561749982833862
complete-iteration_min0.29172241934414567
deviation-center-line_max0.5858437583448596
deviation-center-line_mean0.34933759000160813
deviation-center-line_min0.1474832447223949
deviation-heading_max2.1430259798880575
deviation-heading_mean1.54382278372664
deviation-heading_median1.7866576025586256
deviation-heading_min0.4589499499012514
driven_any_max2.388939092819927
driven_any_mean1.6552547079594262
driven_any_median1.8452474667276169
driven_any_min0.5415848055625437
driven_lanedir_consec_max2.2567264002183403
driven_lanedir_consec_mean1.5323009041581277
driven_lanedir_consec_min0.5322775280689903
driven_lanedir_max2.2567264002183403
driven_lanedir_mean1.5323009041581277
driven_lanedir_median1.6700998441725898
driven_lanedir_min0.5322775280689903
get_duckie_state_max0.025989995002746583
get_duckie_state_mean0.018811849910836977
get_duckie_state_median0.02225596226534797
get_duckie_state_min0.004745480109905375
get_robot_state_max0.003998958653417127
get_robot_state_mean0.003979381368623462
get_robot_state_median0.003981459835200634
get_robot_state_min0.003955647150675456
get_state_dump_max0.00906096617380778
get_state_dump_mean0.007986408960418821
get_state_dump_median0.008526553714159623
get_state_dump_min0.005831562239548256
get_ui_image_max0.040240478515625
get_ui_image_mean0.03470986090325282
get_ui_image_median0.03481499399567885
get_ui_image_min0.02896897710602859
in-drivable-lane_max0.4999999999999982
in-drivable-lane_mean0.12499999999999956
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.154395577398295, "get_ui_image": 0.03342525641123454, "step_physics": 0.19684047222137452, "survival_time": 7.449999999999981, "driven_lanedir": 2.0258478305146967, "get_state_dump": 0.00906096617380778, "get_robot_state": 0.003955647150675456, "sim_render-ego0": 0.003929759661356608, "get_duckie_state": 0.025989995002746583, "in-drivable-lane": 0.0, "deviation-heading": 2.1430259798880575, "agent_compute-ego0": 0.05116008122762044, "complete-iteration": 0.3370524024963379, "set_robot_commands": 0.0024636157353719076, "deviation-center-line": 0.5858437583448596, "driven_lanedir_consec": 2.0258478305146967, "sim_compute_sim_state": 0.00805843194325765, "sim_compute_performance-ego0": 0.002052777608235677}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5415848055625437, "get_ui_image": 0.040240478515625, "step_physics": 0.2426133680343628, "survival_time": 2.4499999999999993, "driven_lanedir": 0.5322775280689903, "get_state_dump": 0.008620057106018066, "get_robot_state": 0.003988051414489746, "sim_render-ego0": 0.003927474021911621, "get_duckie_state": 0.02225398540496826, "in-drivable-lane": 0.0, "deviation-heading": 0.4589499499012514, "agent_compute-ego0": 0.03945505142211914, "complete-iteration": 0.37529759407043456, "set_robot_commands": 0.002619748115539551, "deviation-center-line": 0.1474832447223949, "driven_lanedir_consec": 0.5322775280689903, "sim_compute_sim_state": 0.009364047050476077, "sim_compute_performance-ego0": 0.002102365493774414}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.5360993560569387, "get_ui_image": 0.03620473158012316, "step_physics": 0.23071787426772628, "survival_time": 5.09999999999999, "driven_lanedir": 1.314351857830483, "get_state_dump": 0.00843305032230118, "get_robot_state": 0.0039748682559115215, "sim_render-ego0": 0.004052740856281762, "get_duckie_state": 0.022257939125727683, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 1.6827025907793602, "agent_compute-ego0": 0.05498920366602037, "complete-iteration": 0.3797647767853968, "set_robot_commands": 0.002543539676851439, "deviation-center-line": 0.26787037380379725, "driven_lanedir_consec": 1.314351857830483, "sim_compute_sim_state": 0.01413657595810381, "sim_compute_performance-ego0": 0.0023300393113812197}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.388939092819927, "get_ui_image": 0.02896897710602859, "step_physics": 0.17731766371891416, "survival_time": 7.199999999999982, "driven_lanedir": 2.2567264002183403, "get_state_dump": 0.005831562239548256, "get_robot_state": 0.003998958653417127, "sim_render-ego0": 0.003961418414938039, "get_duckie_state": 0.004745480109905375, "in-drivable-lane": 0.0, "deviation-heading": 1.8906126143378912, "agent_compute-ego0": 0.055443951179241314, "complete-iteration": 0.29172241934414567, "set_robot_commands": 0.002803960339776401, "deviation-center-line": 0.3961529831353806, "driven_lanedir_consec": 2.2567264002183403, "sim_compute_sim_state": 0.0063900536504285085, "sim_compute_performance-ego0": 0.00214694121788288}}
set_robot_commands_max0.002803960339776401
set_robot_commands_mean0.0026077159668848244
set_robot_commands_median0.002581643896195495
set_robot_commands_min0.0024636157353719076
sim_compute_performance-ego0_max0.0023300393113812197
sim_compute_performance-ego0_mean0.002158030907818548
sim_compute_performance-ego0_median0.0021246533558286467
sim_compute_performance-ego0_min0.002052777608235677
sim_compute_sim_state_max0.01413657595810381
sim_compute_sim_state_mean0.009487277150566511
sim_compute_sim_state_median0.008711239496866863
sim_compute_sim_state_min0.0063900536504285085
sim_render-ego0_max0.004052740856281762
sim_render-ego0_mean0.003967848238622007
sim_render-ego0_median0.003945589038147323
sim_render-ego0_min0.003927474021911621
simulation-passed1
step_physics_max0.2426133680343628
step_physics_mean0.21187234456059445
step_physics_median0.2137791732445504
step_physics_min0.17731766371891416
survival_time_max7.449999999999981
survival_time_mean5.549999999999988
survival_time_min2.4499999999999993
No reset possible
5888312876Raphael Jeansim-exercise-2aido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesnogpu-prod-021:45:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median12.070614784784077
survival_time_median59.99999999999873
deviation-center-line_median3.4088650977272854
in-drivable-lane_median0.3749999999999995


other stats
agent_compute-ego0_max0.013268918419360716
agent_compute-ego0_mean0.012815182684530297
agent_compute-ego0_median0.01300148860699529
agent_compute-ego0_min0.011930891724883532
agent_compute-ego1_max0.013048331008961953
agent_compute-ego1_mean0.012737908120598575
agent_compute-ego1_median0.012822815421022642
agent_compute-ego1_min0.012343513101771258
complete-iteration_max0.9492892248247388
complete-iteration_mean0.8438657891473414
complete-iteration_median0.9406396473178658
complete-iteration_min0.32921377296656207
deviation-center-line_max5.858065661681612
deviation-center-line_mean2.849180977350056
deviation-center-line_min0.2834329343025304
deviation-heading_max15.223467542832966
deviation-heading_mean10.178070931817178
deviation-heading_median11.447069144393843
deviation-heading_min1.1944336282200023
driven_any_max14.421519938178704
driven_any_mean10.350826803388282
driven_any_median13.369370314782806
driven_any_min3.005006857325468
driven_lanedir_consec_max13.983888197438462
driven_lanedir_consec_mean9.69366550914729
driven_lanedir_consec_min1.823836687566121
driven_lanedir_max13.983888197438462
driven_lanedir_mean9.746170772679088
driven_lanedir_median12.25813307611411
driven_lanedir_min1.823836687566121
get_duckie_state_max2.6043408320011643e-06
get_duckie_state_mean2.448389418455596e-06
get_duckie_state_median2.4680354169025514e-06
get_duckie_state_min2.143812961265689e-06
get_robot_state_max0.01615393251106205
get_robot_state_mean0.01437925609103929
get_robot_state_median0.01524066071426938
get_robot_state_min0.0076275412502184595
get_state_dump_max0.010466067221242124
get_state_dump_mean0.009626872283131483
get_state_dump_median0.010005753602116037
get_state_dump_min0.00652726556434006
get_ui_image_max0.052340443386424094
get_ui_image_mean0.04687416735432477
get_ui_image_median0.051852473807672377
get_ui_image_min0.03175840221467565
in-drivable-lane_max52.89999999999874
in-drivable-lane_mean4.717857142857037
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 6.62184500295551, "get_ui_image": 0.043987467438702424, "step_physics": 0.7215046659183962, "survival_time": 51.6999999999992, "driven_lanedir": 6.449550933265373, "get_state_dump": 0.009958599385432, "get_robot_state": 0.01511903246819685, "sim_render-ego0": 0.004145865279119372, "sim_render-ego1": 0.004233395765369065, "sim_render-ego2": 0.00426651314260879, "sim_render-ego3": 0.0042398116438861055, "get_duckie_state": 2.4680354169025514e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.799411450406582, "agent_compute-ego0": 0.012617286507058258, "agent_compute-ego1": 0.012343513101771258, "agent_compute-ego2": 0.012800139735862252, "agent_compute-ego3": 0.012914613364399342, "complete-iteration": 0.89899450338981, "set_robot_commands": 0.0023603464670227344, "deviation-center-line": 1.5278907898973837, "driven_lanedir_consec": 6.449550933265373, "sim_compute_sim_state": 0.022011246888533884, "sim_compute_performance-ego0": 0.00220212337475468, "sim_compute_performance-ego1": 0.0021621492173936633, "sim_compute_performance-ego2": 0.002180766828970057, "sim_compute_performance-ego3": 0.002185862075879378}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 7.1114930480116305, "get_ui_image": 0.043987467438702424, "step_physics": 0.7215046659183962, "survival_time": 51.6999999999992, "driven_lanedir": 6.899803361934294, "get_state_dump": 0.009958599385432, "get_robot_state": 0.01511903246819685, "sim_render-ego0": 0.004145865279119372, "sim_render-ego1": 0.004233395765369065, "sim_render-ego2": 0.00426651314260879, "sim_render-ego3": 0.0042398116438861055, "get_duckie_state": 2.4680354169025514e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.955343395701457, "agent_compute-ego0": 0.012617286507058258, "agent_compute-ego1": 0.012343513101771258, "agent_compute-ego2": 0.012800139735862252, "agent_compute-ego3": 0.012914613364399342, "complete-iteration": 0.89899450338981, "set_robot_commands": 0.0023603464670227344, "deviation-center-line": 5.858065661681612, "driven_lanedir_consec": 6.899803361934294, "sim_compute_sim_state": 0.022011246888533884, "sim_compute_performance-ego0": 0.00220212337475468, "sim_compute_performance-ego1": 0.0021621492173936633, "sim_compute_performance-ego2": 0.002180766828970057, "sim_compute_performance-ego3": 0.002185862075879378}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 8.808664598665572, "get_ui_image": 0.043987467438702424, "step_physics": 0.7215046659183962, "survival_time": 51.6999999999992, "driven_lanedir": 8.327260678401624, "get_state_dump": 0.009958599385432, "get_robot_state": 0.01511903246819685, "sim_render-ego0": 0.004145865279119372, "sim_render-ego1": 0.004233395765369065, "sim_render-ego2": 0.00426651314260879, "sim_render-ego3": 0.0042398116438861055, "get_duckie_state": 2.4680354169025514e-06, "in-drivable-lane": 1.3000000000000185, "deviation-heading": 7.8052432670363725, "agent_compute-ego0": 0.012617286507058258, "agent_compute-ego1": 0.012343513101771258, "agent_compute-ego2": 0.012800139735862252, "agent_compute-ego3": 0.012914613364399342, "complete-iteration": 0.89899450338981, "set_robot_commands": 0.0023603464670227344, "deviation-center-line": 2.2944568744587457, "driven_lanedir_consec": 8.327260678401624, "sim_compute_sim_state": 0.022011246888533884, "sim_compute_performance-ego0": 0.00220212337475468, "sim_compute_performance-ego1": 0.0021621492173936633, "sim_compute_performance-ego2": 0.002180766828970057, "sim_compute_performance-ego3": 0.002185862075879378}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 13.917406552785591, "get_ui_image": 0.043987467438702424, "step_physics": 0.7215046659183962, "survival_time": 51.6999999999992, "driven_lanedir": 13.497117599941165, "get_state_dump": 0.009958599385432, "get_robot_state": 0.01511903246819685, "sim_render-ego0": 0.004145865279119372, "sim_render-ego1": 0.004233395765369065, "sim_render-ego2": 0.00426651314260879, "sim_render-ego3": 0.0042398116438861055, "get_duckie_state": 2.4680354169025514e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.819198490726908, "agent_compute-ego0": 0.012617286507058258, "agent_compute-ego1": 0.012343513101771258, "agent_compute-ego2": 0.012800139735862252, "agent_compute-ego3": 0.012914613364399342, "complete-iteration": 0.89899450338981, "set_robot_commands": 0.0023603464670227344, "deviation-center-line": 2.713515937175177, "driven_lanedir_consec": 13.497117599941165, "sim_compute_sim_state": 0.022011246888533884, "sim_compute_performance-ego0": 0.00220212337475468, "sim_compute_performance-ego1": 0.0021621492173936633, "sim_compute_performance-ego2": 0.002180766828970057, "sim_compute_performance-ego3": 0.002185862075879378}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 13.424662925268716, "get_ui_image": 0.051852473807672377, "step_physics": 0.7247990037281249, "survival_time": 59.99999999999873, "driven_lanedir": 12.858452354845657, "get_state_dump": 0.010005753602116037, "get_robot_state": 0.01524066071426938, "sim_render-ego0": 0.0041821536970178255, "sim_render-ego1": 0.004246853471894149, "sim_render-ego2": 0.004315833862774775, "sim_render-ego3": 0.004335766926494665, "get_duckie_state": 2.425080235058025e-06, "in-drivable-lane": 0.34999999999999876, "deviation-heading": 13.326063928772411, "agent_compute-ego0": 0.01300148860699529, "agent_compute-ego1": 0.012822815421022642, "agent_compute-ego2": 0.013001645435203026, "agent_compute-ego3": 0.012921996954378736, "complete-iteration": 0.9406396473178658, "set_robot_commands": 0.002340815049424755, "deviation-center-line": 3.809378688597838, "driven_lanedir_consec": 12.858452354845657, "sim_compute_sim_state": 0.05134413422990302, "sim_compute_performance-ego0": 0.002312692972543734, "sim_compute_performance-ego1": 0.0021654352558145517, "sim_compute_performance-ego2": 0.002196290113844542, "sim_compute_performance-ego3": 0.0021599059696499256}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 13.3140777042969, "get_ui_image": 0.051852473807672377, "step_physics": 0.7247990037281249, "survival_time": 59.99999999999873, "driven_lanedir": 11.940375189530222, "get_state_dump": 0.010005753602116037, "get_robot_state": 0.01524066071426938, "sim_render-ego0": 0.0041821536970178255, "sim_render-ego1": 0.004246853471894149, "sim_render-ego2": 0.004315833862774775, "sim_render-ego3": 0.004335766926494665, "get_duckie_state": 2.425080235058025e-06, "in-drivable-lane": 4.2499999999999005, "deviation-heading": 13.60576842730253, "agent_compute-ego0": 0.01300148860699529, "agent_compute-ego1": 0.012822815421022642, "agent_compute-ego2": 0.013001645435203026, "agent_compute-ego3": 0.012921996954378736, "complete-iteration": 0.9406396473178658, "set_robot_commands": 0.002340815049424755, "deviation-center-line": 3.3919016262677393, "driven_lanedir_consec": 11.56533860687016, "sim_compute_sim_state": 0.05134413422990302, "sim_compute_performance-ego0": 0.002312692972543734, "sim_compute_performance-ego1": 0.0021654352558145517, "sim_compute_performance-ego2": 0.002196290113844542, "sim_compute_performance-ego3": 0.0021599059696499256}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.16823353264423, "get_ui_image": 0.051852473807672377, "step_physics": 0.7247990037281249, "survival_time": 59.99999999999873, "driven_lanedir": 13.425013600440948, "get_state_dump": 0.010005753602116037, "get_robot_state": 0.01524066071426938, "sim_render-ego0": 0.0041821536970178255, "sim_render-ego1": 0.004246853471894149, "sim_render-ego2": 0.004315833862774775, "sim_render-ego3": 0.004335766926494665, "get_duckie_state": 2.425080235058025e-06, "in-drivable-lane": 0.40000000000000024, "deviation-heading": 15.223467542832966, "agent_compute-ego0": 0.01300148860699529, "agent_compute-ego1": 0.012822815421022642, "agent_compute-ego2": 0.013001645435203026, "agent_compute-ego3": 0.012921996954378736, "complete-iteration": 0.9406396473178658, "set_robot_commands": 0.002340815049424755, "deviation-center-line": 3.703392994124913, "driven_lanedir_consec": 13.06497649365586, "sim_compute_sim_state": 0.05134413422990302, "sim_compute_performance-ego0": 0.002312692972543734, "sim_compute_performance-ego1": 0.0021654352558145517, "sim_compute_performance-ego2": 0.002196290113844542, "sim_compute_performance-ego3": 0.0021599059696499256}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 13.98648717473911, "get_ui_image": 0.051852473807672377, "step_physics": 0.7247990037281249, "survival_time": 59.99999999999873, "driven_lanedir": 13.358187304765758, "get_state_dump": 0.010005753602116037, "get_robot_state": 0.01524066071426938, "sim_render-ego0": 0.0041821536970178255, "sim_render-ego1": 0.004246853471894149, "sim_render-ego2": 0.004315833862774775, "sim_render-ego3": 0.004335766926494665, "get_duckie_state": 2.425080235058025e-06, "in-drivable-lane": 0.19999999999998863, "deviation-heading": 14.78656491014064, "agent_compute-ego0": 0.01300148860699529, "agent_compute-ego1": 0.012822815421022642, "agent_compute-ego2": 0.013001645435203026, "agent_compute-ego3": 0.012921996954378736, "complete-iteration": 0.9406396473178658, "set_robot_commands": 0.002340815049424755, "deviation-center-line": 3.6229930039001768, "driven_lanedir_consec": 13.358187304765758, "sim_compute_sim_state": 0.05134413422990302, "sim_compute_performance-ego0": 0.002312692972543734, "sim_compute_performance-ego1": 0.0021654352558145517, "sim_compute_performance-ego2": 0.002196290113844542, "sim_compute_performance-ego3": 0.0021599059696499256}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 14.421519938178704, "get_ui_image": 0.052340443386424094, "step_physics": 0.7414348794459106, "survival_time": 59.99999999999873, "driven_lanedir": 13.983888197438462, "get_state_dump": 0.010466067221242124, "get_robot_state": 0.01615393251106205, "sim_render-ego0": 0.004419204297411154, "sim_render-ego1": 0.004475503638820982, "sim_render-ego2": 0.00454566520417759, "sim_render-ego3": 0.004429512278027181, "get_duckie_state": 2.6043408320011643e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.07493979806078, "agent_compute-ego0": 0.013268918419360716, "agent_compute-ego1": 0.013048331008961953, "agent_compute-ego2": 0.01341771424362602, "agent_compute-ego3": 0.012747035634011451, "complete-iteration": 0.9492892248247388, "set_robot_commands": 0.0027800070852363836, "deviation-center-line": 3.533339979704822, "driven_lanedir_consec": 13.983888197438462, "sim_compute_sim_state": 0.03840305346632679, "sim_compute_performance-ego0": 0.002469089604932799, "sim_compute_performance-ego1": 0.0022974306101802983, "sim_compute_performance-ego2": 0.0023444171352847033, "sim_compute_performance-ego3": 0.002365232208785566}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 14.189287987628903, "get_ui_image": 0.052340443386424094, "step_physics": 0.7414348794459106, "survival_time": 59.99999999999873, "driven_lanedir": 13.661355004348527, "get_state_dump": 0.010466067221242124, "get_robot_state": 0.01615393251106205, "sim_render-ego0": 0.004419204297411154, "sim_render-ego1": 0.004475503638820982, "sim_render-ego2": 0.00454566520417759, "sim_render-ego3": 0.004429512278027181, "get_duckie_state": 2.6043408320011643e-06, "in-drivable-lane": 0.5499999999999687, "deviation-heading": 12.483757594768369, "agent_compute-ego0": 0.013268918419360716, "agent_compute-ego1": 0.013048331008961953, "agent_compute-ego2": 0.01341771424362602, "agent_compute-ego3": 0.012747035634011451, "complete-iteration": 0.9492892248247388, "set_robot_commands": 0.0027800070852363836, "deviation-center-line": 3.4258285691868315, "driven_lanedir_consec": 13.661355004348527, "sim_compute_sim_state": 0.03840305346632679, "sim_compute_performance-ego0": 0.002469089604932799, "sim_compute_performance-ego1": 0.0022974306101802983, "sim_compute_performance-ego2": 0.0023444171352847033, "sim_compute_performance-ego3": 0.002365232208785566}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 13.821871950561723, "get_ui_image": 0.052340443386424094, "step_physics": 0.7414348794459106, "survival_time": 59.99999999999873, "driven_lanedir": 12.575890962697995, "get_state_dump": 0.010466067221242124, "get_robot_state": 0.01615393251106205, "sim_render-ego0": 0.004419204297411154, "sim_render-ego1": 0.004475503638820982, "sim_render-ego2": 0.00454566520417759, "sim_render-ego3": 0.004429512278027181, "get_duckie_state": 2.6043408320011643e-06, "in-drivable-lane": 4.299999999999873, "deviation-heading": 12.535223182643234, "agent_compute-ego0": 0.013268918419360716, "agent_compute-ego1": 0.013048331008961953, "agent_compute-ego2": 0.01341771424362602, "agent_compute-ego3": 0.012747035634011451, "complete-iteration": 0.9492892248247388, "set_robot_commands": 0.0027800070852363836, "deviation-center-line": 3.676412241026533, "driven_lanedir_consec": 12.575890962697995, "sim_compute_sim_state": 0.03840305346632679, "sim_compute_performance-ego0": 0.002469089604932799, "sim_compute_performance-ego1": 0.0022974306101802983, "sim_compute_performance-ego2": 0.0023444171352847033, "sim_compute_performance-ego3": 0.002365232208785566}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 3.005006857325468, "get_ui_image": 0.052340443386424094, "step_physics": 0.7414348794459106, "survival_time": 59.99999999999873, "driven_lanedir": 1.823836687566121, "get_state_dump": 0.010466067221242124, "get_robot_state": 0.01615393251106205, "sim_render-ego0": 0.004419204297411154, "sim_render-ego1": 0.004475503638820982, "sim_render-ego2": 0.00454566520417759, "sim_render-ego3": 0.004429512278027181, "get_duckie_state": 2.6043408320011643e-06, "in-drivable-lane": 52.89999999999874, "deviation-heading": 1.1944336282200023, "agent_compute-ego0": 0.013268918419360716, "agent_compute-ego1": 0.013048331008961953, "agent_compute-ego2": 0.01341771424362602, "agent_compute-ego3": 0.012747035634011451, "complete-iteration": 0.9492892248247388, "set_robot_commands": 0.0027800070852363836, "deviation-center-line": 0.2834329343025304, "driven_lanedir_consec": 1.823836687566121, "sim_compute_sim_state": 0.03840305346632679, "sim_compute_performance-ego0": 0.002469089604932799, "sim_compute_performance-ego1": 0.0022974306101802983, "sim_compute_performance-ego2": 0.0023444171352847033, "sim_compute_performance-ego3": 0.002365232208785566}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 4.371306318760981, "get_ui_image": 0.03175840221467565, "step_physics": 0.2308362025380786, "survival_time": 18.250000000000124, "driven_lanedir": 4.212625400115506, "get_state_dump": 0.00652726556434006, "get_robot_state": 0.0076275412502184595, "sim_render-ego0": 0.004018433758469879, "sim_render-ego1": 0.004176786037090698, "get_duckie_state": 2.143812961265689e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.078479322522799, "agent_compute-ego0": 0.011930891724883532, "agent_compute-ego1": 0.012736037780678337, "complete-iteration": 0.32921377296656207, "set_robot_commands": 0.002450522829274662, "deviation-center-line": 0.9746201783119952, "driven_lanedir_consec": 4.212625400115506, "sim_compute_sim_state": 0.010349217659788704, "sim_compute_performance-ego0": 0.002140625578458192, "sim_compute_performance-ego1": 0.002082063200695267}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 3.749711655612926, "get_ui_image": 0.03175840221467565, "step_physics": 0.2308362025380786, "survival_time": 18.250000000000124, "driven_lanedir": 3.4330335422155676, "get_state_dump": 0.00652726556434006, "get_robot_state": 0.0076275412502184595, "sim_render-ego0": 0.004018433758469879, "sim_render-ego1": 0.004176786037090698, "get_duckie_state": 2.143812961265689e-06, "in-drivable-lane": 1.8000000000000256, "deviation-heading": 3.805098106305464, "agent_compute-ego0": 0.011930891724883532, "agent_compute-ego1": 0.012736037780678337, "complete-iteration": 0.32921377296656207, "set_robot_commands": 0.002450522829274662, "deviation-center-line": 1.0733042042644902, "driven_lanedir_consec": 3.4330335422155676, "sim_compute_sim_state": 0.010349217659788704, "sim_compute_performance-ego0": 0.002140625578458192, "sim_compute_performance-ego1": 0.002082063200695267}}
set_robot_commands_max0.0027800070852363836
set_robot_commands_mean0.0024875514332346298
set_robot_commands_median0.0023603464670227344
set_robot_commands_min0.002340815049424755
sim_compute_performance-ego0_max0.002469089604932799
sim_compute_performance-ego0_mean0.002301205354702945
sim_compute_performance-ego0_median0.002312692972543734
sim_compute_performance-ego0_min0.002140625578458192
sim_compute_performance-ego1_max0.0022974306101802983
sim_compute_performance-ego1_mean0.0021902990524960424
sim_compute_performance-ego1_median0.0021654352558145517
sim_compute_performance-ego1_min0.002082063200695267
sim_compute_sim_state_max0.05134413422990302
sim_compute_sim_state_mean0.033409440975616586
sim_compute_sim_state_median0.03840305346632679
sim_compute_sim_state_min0.010349217659788704
sim_render-ego0_max0.004419204297411154
sim_render-ego0_mean0.004216125757938083
sim_render-ego0_median0.0041821536970178255
sim_render-ego0_min0.004018433758469879
sim_render-ego1_max0.004475503638820982
sim_render-ego1_mean0.004298327398465585
sim_render-ego1_median0.004246853471894149
sim_render-ego1_min0.004176786037090698
simulation-passed1
step_physics_max0.7414348794459106
step_physics_mean0.6580447572461345
step_physics_median0.7247990037281249
step_physics_min0.2308362025380786
survival_time_max59.99999999999873
survival_time_mean51.66428571428479
survival_time_min18.250000000000124
No reset possible
5886912837Raphael Jeanexercise_state_estimationaido5-LFI-full-sim-testingLFVIv-simsuccessyesnogpu-prod-020:11:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.442644293167127
survival_time_median31.99999999999936
deviation-center-line_median1.2846980068379743
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013168862816892396
agent_compute-ego0_mean0.012764754608907504
agent_compute-ego0_median0.012764754608907504
agent_compute-ego0_min0.01236064640092261
complete-iteration_max0.22905447159284423
complete-iteration_mean0.21752635850895685
complete-iteration_median0.21752635850895685
complete-iteration_min0.20599824542506945
deviation-center-line_max2.3040869815933505
deviation-center-line_mean1.2846980068379743
deviation-center-line_min0.26530903208259804
deviation-heading_max9.651685532331532
deviation-heading_mean5.185314274400807
deviation-heading_median5.185314274400807
deviation-heading_min0.7189430164700817
driven_any_max15.838381255819083
driven_any_mean8.210168808939859
driven_any_median8.210168808939859
driven_any_min0.5819563620606304
driven_lanedir_consec_max14.31522826216671
driven_lanedir_consec_mean7.442644293167127
driven_lanedir_consec_min0.5700603241675429
driven_lanedir_max15.540509720154017
driven_lanedir_mean8.05528521585791
driven_lanedir_median8.05528521585791
driven_lanedir_min0.5700607115618063
get_duckie_state_max1.4737881192756035e-06
get_duckie_state_mean1.3888658531068897e-06
get_duckie_state_median1.3888658531068897e-06
get_duckie_state_min1.3039435869381752e-06
get_robot_state_max0.003724221087415252
get_robot_state_mean0.0036017832163090196
get_robot_state_median0.0036017832163090196
get_robot_state_min0.0034793453452027874
get_state_dump_max0.004732016024244119
get_state_dump_mean0.004579227077847127
get_state_dump_median0.004579227077847127
get_state_dump_min0.004426438131450135
get_ui_image_max0.03745603323181305
get_ui_image_mean0.03537977947228402
get_ui_image_median0.03537977947228402
get_ui_image_min0.033303525712754994
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 0.5819563620606304, "get_ui_image": 0.033303525712754994, "step_physics": 0.1578481521135495, "survival_time": 3.999999999999994, "driven_lanedir": 0.5700607115618063, "get_state_dump": 0.004426438131450135, "get_robot_state": 0.0034793453452027874, "sim_render-ego0": 0.003627618153889974, "get_duckie_state": 1.3039435869381752e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.7189430164700817, "agent_compute-ego0": 0.01236064640092261, "complete-iteration": 0.22905447159284423, "set_robot_commands": 0.0023123246652108653, "deviation-center-line": 0.26530903208259804, "driven_lanedir_consec": 0.5700603241675429, "sim_compute_sim_state": 0.00969349013434516, "sim_compute_performance-ego0": 0.0019189222359362944}, "LFI-full-udem1-000-ego0": {"driven_any": 15.838381255819083, "get_ui_image": 0.03745603323181305, "step_physics": 0.12631453602240544, "survival_time": 59.99999999999873, "driven_lanedir": 15.540509720154017, "get_state_dump": 0.004732016024244119, "get_robot_state": 0.003724221087415252, "sim_render-ego0": 0.0039760705136339634, "get_duckie_state": 1.4737881192756035e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.651685532331532, "agent_compute-ego0": 0.013168862816892396, "complete-iteration": 0.20599824542506945, "set_robot_commands": 0.0022804399612642743, "deviation-center-line": 2.3040869815933505, "driven_lanedir_consec": 14.31522826216671, "sim_compute_sim_state": 0.012196012381014478, "sim_compute_performance-ego0": 0.002060545771247044}}
set_robot_commands_max0.0023123246652108653
set_robot_commands_mean0.00229638231323757
set_robot_commands_median0.00229638231323757
set_robot_commands_min0.0022804399612642743
sim_compute_performance-ego0_max0.002060545771247044
sim_compute_performance-ego0_mean0.0019897340035916694
sim_compute_performance-ego0_median0.0019897340035916694
sim_compute_performance-ego0_min0.0019189222359362944
sim_compute_sim_state_max0.012196012381014478
sim_compute_sim_state_mean0.01094475125767982
sim_compute_sim_state_median0.01094475125767982
sim_compute_sim_state_min0.00969349013434516
sim_render-ego0_max0.0039760705136339634
sim_render-ego0_mean0.003801844333761969
sim_render-ego0_median0.003801844333761969
sim_render-ego0_min0.003627618153889974
simulation-passed1
step_physics_max0.1578481521135495
step_physics_mean0.14208134406797746
step_physics_median0.14208134406797746
step_physics_min0.12631453602240544
survival_time_max59.99999999999873
survival_time_mean31.99999999999936
survival_time_min3.999999999999994
No reset possible
5886212873Raphael Jeansim-exercise-2aido5-LFVI-sim-testingLFVIt-simsuccessyesnogpu-prod-020:13:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.176790295750103
survival_time_median11.075000000000022
deviation-center-line_median0.5392813160500741
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012763051694380368
agent_compute-ego0_mean0.01258023851229194
agent_compute-ego0_median0.01258023851229194
agent_compute-ego0_min0.012397425330203512
agent_compute-npc0_max0.04854755383341705
agent_compute-npc0_mean0.047975905990473494
agent_compute-npc0_median0.047975905990473494
agent_compute-npc0_min0.04740425814752993
agent_compute-npc1_max0.04900542529606728
agent_compute-npc1_mean0.04269225302386757
agent_compute-npc1_median0.04269225302386757
agent_compute-npc1_min0.036379080751667854
agent_compute-npc2_max0.04327924224151962
agent_compute-npc2_mean0.038250146993156195
agent_compute-npc2_median0.038250146993156195
agent_compute-npc2_min0.03322105174479277
complete-iteration_max1.2222225200170758
complete-iteration_mean1.16475771111378
complete-iteration_median1.16475771111378
complete-iteration_min1.1072929022104845
deviation-center-line_max0.5879719723816785
deviation-center-line_mean0.5392813160500741
deviation-center-line_min0.49059065971846977
deviation-heading_max2.698757654056037
deviation-heading_mean2.226228720369761
deviation-heading_median2.226228720369761
deviation-heading_min1.7536997866834847
driven_any_max3.0792405018081013
driven_any_mean2.4630262145057102
driven_any_median2.4630262145057102
driven_any_min1.8468119272033188
driven_lanedir_consec_max2.9835661008906884
driven_lanedir_consec_mean2.176790295750103
driven_lanedir_consec_min1.3700144906095175
driven_lanedir_max2.9835661008906884
driven_lanedir_mean2.3970227062084115
driven_lanedir_median2.3970227062084115
driven_lanedir_min1.8104793115261344
get_duckie_state_max1.7858556403967612e-06
get_duckie_state_mean1.7137874390072928e-06
get_duckie_state_median1.7137874390072928e-06
get_duckie_state_min1.6417192376178245e-06
get_robot_state_max0.016167000335751823
get_robot_state_mean0.015649323106090088
get_robot_state_median0.015649323106090088
get_robot_state_min0.015131645876428356
get_state_dump_max0.01048894860278601
get_state_dump_mean0.010362420646266184
get_state_dump_median0.010362420646266184
get_state_dump_min0.01023589268974636
get_ui_image_max0.05430266044148997
get_ui_image_mean0.05412712519950873
get_ui_image_median0.05412712519950873
get_ui_image_min0.05395158995752749
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 1.8468119272033188, "get_ui_image": 0.05395158995752749, "step_physics": 0.8215999162715414, "survival_time": 9.149999999999997, "driven_lanedir": 1.8104793115261344, "get_state_dump": 0.01023589268974636, "get_robot_state": 0.015131645876428356, "sim_render-ego0": 0.004095060669857523, "sim_render-npc0": 0.004113293212393056, "sim_render-npc1": 0.004199863775916721, "sim_render-npc2": 0.004045119752054629, "get_duckie_state": 1.6417192376178245e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.7536997866834847, "agent_compute-ego0": 0.012397425330203512, "agent_compute-npc0": 0.04740425814752993, "agent_compute-npc1": 0.036379080751667854, "agent_compute-npc2": 0.03322105174479277, "complete-iteration": 1.1072929022104845, "set_robot_commands": 0.0024050564869590426, "deviation-center-line": 0.49059065971846977, "driven_lanedir_consec": 1.3700144906095175, "sim_compute_sim_state": 0.04180007525112318, "sim_compute_performance-ego0": 0.0022150964840598726, "sim_compute_performance-npc0": 0.002128093138985012, "sim_compute_performance-npc1": 0.0022418952506521473, "sim_compute_performance-npc2": 0.002160308153732963}, "LFVI-norm-udem1-000-ego0": {"driven_any": 3.0792405018081013, "get_ui_image": 0.05430266044148997, "step_physics": 0.901594000301142, "survival_time": 13.00000000000005, "driven_lanedir": 2.9835661008906884, "get_state_dump": 0.01048894860278601, "get_robot_state": 0.016167000335751823, "sim_render-ego0": 0.004467986095910785, "sim_render-npc0": 0.004541091078542658, "sim_render-npc1": 0.004506510336280326, "sim_render-npc2": 0.00458001085624841, "get_duckie_state": 1.7858556403967612e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.698757654056037, "agent_compute-ego0": 0.012763051694380368, "agent_compute-npc0": 0.04854755383341705, "agent_compute-npc1": 0.04900542529606728, "agent_compute-npc2": 0.04327924224151962, "complete-iteration": 1.2222225200170758, "set_robot_commands": 0.0026997597281503494, "deviation-center-line": 0.5879719723816785, "driven_lanedir_consec": 2.9835661008906884, "sim_compute_sim_state": 0.04743065413844083, "sim_compute_performance-ego0": 0.002516136315590577, "sim_compute_performance-npc0": 0.0022682650335903824, "sim_compute_performance-npc1": 0.002384613300191945, "sim_compute_performance-npc2": 0.0023957340196631423}}
set_robot_commands_max0.0026997597281503494
set_robot_commands_mean0.002552408107554696
set_robot_commands_median0.002552408107554696
set_robot_commands_min0.0024050564869590426
sim_compute_performance-ego0_max0.002516136315590577
sim_compute_performance-ego0_mean0.002365616399825225
sim_compute_performance-ego0_median0.002365616399825225
sim_compute_performance-ego0_min0.0022150964840598726
sim_compute_performance-npc0_max0.0022682650335903824
sim_compute_performance-npc0_mean0.0021981790862876972
sim_compute_performance-npc0_median0.0021981790862876972
sim_compute_performance-npc0_min0.002128093138985012
sim_compute_performance-npc1_max0.002384613300191945
sim_compute_performance-npc1_mean0.002313254275422046
sim_compute_performance-npc1_median0.002313254275422046
sim_compute_performance-npc1_min0.0022418952506521473
sim_compute_performance-npc2_max0.0023957340196631423
sim_compute_performance-npc2_mean0.0022780210866980527
sim_compute_performance-npc2_median0.0022780210866980527
sim_compute_performance-npc2_min0.002160308153732963
sim_compute_sim_state_max0.04743065413844083
sim_compute_sim_state_mean0.044615364694782
sim_compute_sim_state_median0.044615364694782
sim_compute_sim_state_min0.04180007525112318
sim_render-ego0_max0.004467986095910785
sim_render-ego0_mean0.004281523382884154
sim_render-ego0_median0.004281523382884154
sim_render-ego0_min0.004095060669857523
sim_render-npc0_max0.004541091078542658
sim_render-npc0_mean0.004327192145467857
sim_render-npc0_median0.004327192145467857
sim_render-npc0_min0.004113293212393056
sim_render-npc1_max0.004506510336280326
sim_render-npc1_mean0.004353187056098523
sim_render-npc1_median0.004353187056098523
sim_render-npc1_min0.004199863775916721
sim_render-npc2_max0.00458001085624841
sim_render-npc2_mean0.004312565304151519
sim_render-npc2_median0.004312565304151519
sim_render-npc2_min0.004045119752054629
simulation-passed1
step_physics_max0.901594000301142
step_physics_mean0.8615969582863416
step_physics_median0.8615969582863416
step_physics_min0.8215999162715414
survival_time_max13.00000000000005
survival_time_mean11.075000000000022
survival_time_min9.149999999999997
No reset possible
5882812875Raphael Jeansim-exercise-2aido5-LFVI_multi-sim-validationLFVIv-simsuccessyesnogpu-prod-020:51:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.211142693260509
survival_time_median40.749999999999446
deviation-center-line_median2.2993986535518127
in-drivable-lane_median3.174999999999991


other stats
agent_compute-ego0_max0.01290160511852204
agent_compute-ego0_mean0.012486587670070983
agent_compute-ego0_median0.012486587670070983
agent_compute-ego0_min0.012071570221619927
agent_compute-ego1_max0.0132408868661034
agent_compute-ego1_mean0.013119124576703958
agent_compute-ego1_median0.013119124576703958
agent_compute-ego1_min0.012997362287304515
agent_compute-ego2_max0.013663340369231697
agent_compute-ego2_mean0.013304522187885972
agent_compute-ego2_median0.013304522187885972
agent_compute-ego2_min0.01294570400654025
agent_compute-ego3_max0.013019692788612435
agent_compute-ego3_mean0.012752887780213528
agent_compute-ego3_median0.012752887780213528
agent_compute-ego3_min0.012486082771814616
complete-iteration_max1.216539890196373
complete-iteration_mean1.0431397373392284
complete-iteration_median1.0431397373392284
complete-iteration_min0.8697395844820834
deviation-center-line_max3.066601864523534
deviation-center-line_mean2.0224625928917854
deviation-center-line_min0.20498821564781045
deviation-heading_max11.161085871749528
deviation-heading_mean6.998767009750711
deviation-heading_median7.165379391673385
deviation-heading_min0.7731476969966331
driven_any_max17.534839420174883
driven_any_mean8.850037758237821
driven_any_median6.690665650931369
driven_any_min1.1268506390371398
driven_lanedir_consec_max16.031952365989927
driven_lanedir_consec_mean7.592637100549688
driven_lanedir_consec_min0.6976441405329101
driven_lanedir_max17.143960389048665
driven_lanedir_mean8.061979795914281
driven_lanedir_median5.550744273080251
driven_lanedir_min0.6976441405329101
get_duckie_state_max1.7135963154077331e-06
get_duckie_state_mean1.6044146534248916e-06
get_duckie_state_median1.6044146534248916e-06
get_duckie_state_min1.4952329914420498e-06
get_robot_state_max0.016184938837348374
get_robot_state_mean0.0156176985408095
get_robot_state_median0.0156176985408095
get_robot_state_min0.015050458244270624
get_state_dump_max0.010459570960140942
get_state_dump_mean0.010203704301931932
get_state_dump_median0.010203704301931932
get_state_dump_min0.009947837643722923
get_ui_image_max0.05519913515381571
get_ui_image_mean0.05460219535457392
get_ui_image_median0.05460219535457392
get_ui_image_min0.05400525555533212
in-drivable-lane_max27.699999999998763
in-drivable-lane_mean7.09999999999987
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 1.9451017591552109, "get_ui_image": 0.05400525555533212, "step_physics": 1.020717550596339, "survival_time": 21.50000000000017, "driven_lanedir": 1.7381002608305582, "get_state_dump": 0.009947837643722923, "get_robot_state": 0.015050458244270624, "sim_render-ego0": 0.004059594634514121, "sim_render-ego1": 0.004179499265489335, "sim_render-ego2": 0.0041141947018298085, "sim_render-ego3": 0.004148346088878516, "get_duckie_state": 1.4952329914420498e-06, "in-drivable-lane": 16.40000000000018, "deviation-heading": 0.7731476969966331, "agent_compute-ego0": 0.012071570221619927, "agent_compute-ego1": 0.012997362287304515, "agent_compute-ego2": 0.01294570400654025, "agent_compute-ego3": 0.012486082771814616, "complete-iteration": 1.216539890196373, "set_robot_commands": 0.002265674055590707, "deviation-center-line": 0.20498821564781045, "driven_lanedir_consec": 1.7381002608305582, "sim_compute_sim_state": 0.031289389957684655, "sim_compute_performance-ego0": 0.0022157538517998433, "sim_compute_performance-ego1": 0.00215711615754944, "sim_compute_performance-ego2": 0.002120745430966264, "sim_compute_performance-ego3": 0.0021395771796631426}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 4.915376132817917, "get_ui_image": 0.05400525555533212, "step_physics": 1.020717550596339, "survival_time": 21.50000000000017, "driven_lanedir": 3.474889553917609, "get_state_dump": 0.009947837643722923, "get_robot_state": 0.015050458244270624, "sim_render-ego0": 0.004059594634514121, "sim_render-ego1": 0.004179499265489335, "sim_render-ego2": 0.0041141947018298085, "sim_render-ego3": 0.004148346088878516, "get_duckie_state": 1.4952329914420498e-06, "in-drivable-lane": 6.15000000000003, "deviation-heading": 3.4350009888764874, "agent_compute-ego0": 0.012071570221619927, "agent_compute-ego1": 0.012997362287304515, "agent_compute-ego2": 0.01294570400654025, "agent_compute-ego3": 0.012486082771814616, "complete-iteration": 1.216539890196373, "set_robot_commands": 0.002265674055590707, "deviation-center-line": 1.295704952255295, "driven_lanedir_consec": 3.474889553917609, "sim_compute_sim_state": 0.031289389957684655, "sim_compute_performance-ego0": 0.0022157538517998433, "sim_compute_performance-ego1": 0.00215711615754944, "sim_compute_performance-ego2": 0.002120745430966264, "sim_compute_performance-ego3": 0.0021395771796631426}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 1.1268506390371398, "get_ui_image": 0.05400525555533212, "step_physics": 1.020717550596339, "survival_time": 21.50000000000017, "driven_lanedir": 0.6976441405329101, "get_state_dump": 0.009947837643722923, "get_robot_state": 0.015050458244270624, "sim_render-ego0": 0.004059594634514121, "sim_render-ego1": 0.004179499265489335, "sim_render-ego2": 0.0041141947018298085, "sim_render-ego3": 0.004148346088878516, "get_duckie_state": 1.4952329914420498e-06, "in-drivable-lane": 1.599999999999997, "deviation-heading": 5.478028270869018, "agent_compute-ego0": 0.012071570221619927, "agent_compute-ego1": 0.012997362287304515, "agent_compute-ego2": 0.01294570400654025, "agent_compute-ego3": 0.012486082771814616, "complete-iteration": 1.216539890196373, "set_robot_commands": 0.002265674055590707, "deviation-center-line": 2.5827065316224926, "driven_lanedir_consec": 0.6976441405329101, "sim_compute_sim_state": 0.031289389957684655, "sim_compute_performance-ego0": 0.0022157538517998433, "sim_compute_performance-ego1": 0.00215711615754944, "sim_compute_performance-ego2": 0.002120745430966264, "sim_compute_performance-ego3": 0.0021395771796631426}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 4.683876375569373, "get_ui_image": 0.05400525555533212, "step_physics": 1.020717550596339, "survival_time": 21.50000000000017, "driven_lanedir": 4.366294074318151, "get_state_dump": 0.009947837643722923, "get_robot_state": 0.015050458244270624, "sim_render-ego0": 0.004059594634514121, "sim_render-ego1": 0.004179499265489335, "sim_render-ego2": 0.0041141947018298085, "sim_render-ego3": 0.004148346088878516, "get_duckie_state": 1.4952329914420498e-06, "in-drivable-lane": 0.20000000000000284, "deviation-heading": 6.941006321372074, "agent_compute-ego0": 0.012071570221619927, "agent_compute-ego1": 0.012997362287304515, "agent_compute-ego2": 0.01294570400654025, "agent_compute-ego3": 0.012486082771814616, "complete-iteration": 1.216539890196373, "set_robot_commands": 0.002265674055590707, "deviation-center-line": 1.2893771235120055, "driven_lanedir_consec": 3.789938731986005, "sim_compute_sim_state": 0.031289389957684655, "sim_compute_performance-ego0": 0.0022157538517998433, "sim_compute_performance-ego1": 0.00215711615754944, "sim_compute_performance-ego2": 0.002120745430966264, "sim_compute_performance-ego3": 0.0021395771796631426}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 17.534839420174883, "get_ui_image": 0.05519913515381571, "step_physics": 0.653851548797582, "survival_time": 59.99999999999873, "driven_lanedir": 17.143960389048665, "get_state_dump": 0.010459570960140942, "get_robot_state": 0.016184938837348374, "sim_render-ego0": 0.004400761498698187, "sim_render-ego1": 0.004427257525136727, "sim_render-ego2": 0.004495535762383479, "sim_render-ego3": 0.004495283447634072, "get_duckie_state": 1.7135963154077331e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.094040234131088, "agent_compute-ego0": 0.01290160511852204, "agent_compute-ego1": 0.0132408868661034, "agent_compute-ego2": 0.013663340369231697, "agent_compute-ego3": 0.013019692788612435, "complete-iteration": 0.8697395844820834, "set_robot_commands": 0.002467469907025314, "deviation-center-line": 2.880769579441105, "driven_lanedir_consec": 16.031952365989927, "sim_compute_sim_state": 0.04358034229199158, "sim_compute_performance-ego0": 0.002500598178517312, "sim_compute_performance-ego1": 0.002301131358849417, "sim_compute_performance-ego2": 0.002328045461497438, "sim_compute_performance-ego3": 0.002354958571561866}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 16.575971582374287, "get_ui_image": 0.05519913515381571, "step_physics": 0.653851548797582, "survival_time": 59.99999999999873, "driven_lanedir": 16.162506546353438, "get_state_dump": 0.010459570960140942, "get_robot_state": 0.016184938837348374, "sim_render-ego0": 0.004400761498698187, "sim_render-ego1": 0.004427257525136727, "sim_render-ego2": 0.004495535762383479, "sim_render-ego3": 0.004495283447634072, "get_duckie_state": 1.7135963154077331e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.718074232036162, "agent_compute-ego0": 0.01290160511852204, "agent_compute-ego1": 0.0132408868661034, "agent_compute-ego2": 0.013663340369231697, "agent_compute-ego3": 0.013019692788612435, "complete-iteration": 0.8697395844820834, "set_robot_commands": 0.002467469907025314, "deviation-center-line": 3.066601864523534, "driven_lanedir_consec": 15.046136457464392, "sim_compute_sim_state": 0.04358034229199158, "sim_compute_performance-ego0": 0.002500598178517312, "sim_compute_performance-ego1": 0.002301131358849417, "sim_compute_performance-ego2": 0.002328045461497438, "sim_compute_performance-ego3": 0.002354958571561866}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 8.465955169044822, "get_ui_image": 0.05519913515381571, "step_physics": 0.653851548797582, "survival_time": 59.99999999999873, "driven_lanedir": 6.735194471842351, "get_state_dump": 0.010459570960140942, "get_robot_state": 0.016184938837348374, "sim_render-ego0": 0.004400761498698187, "sim_render-ego1": 0.004427257525136727, "sim_render-ego2": 0.004495535762383479, "sim_render-ego3": 0.004495283447634072, "get_duckie_state": 1.7135963154077331e-06, "in-drivable-lane": 27.699999999998763, "deviation-heading": 7.389752461974696, "agent_compute-ego0": 0.01290160511852204, "agent_compute-ego1": 0.0132408868661034, "agent_compute-ego2": 0.013663340369231697, "agent_compute-ego3": 0.013019692788612435, "complete-iteration": 0.8697395844820834, "set_robot_commands": 0.002467469907025314, "deviation-center-line": 2.0160907754811324, "driven_lanedir_consec": 6.632346654535014, "sim_compute_sim_state": 0.04358034229199158, "sim_compute_performance-ego0": 0.002500598178517312, "sim_compute_performance-ego1": 0.002301131358849417, "sim_compute_performance-ego2": 0.002328045461497438, "sim_compute_performance-ego3": 0.002354958571561866}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 15.552330987728933, "get_ui_image": 0.05519913515381571, "step_physics": 0.653851548797582, "survival_time": 59.99999999999873, "driven_lanedir": 14.177248930470562, "get_state_dump": 0.010459570960140942, "get_robot_state": 0.016184938837348374, "sim_render-ego0": 0.004400761498698187, "sim_render-ego1": 0.004427257525136727, "sim_render-ego2": 0.004495535762383479, "sim_render-ego3": 0.004495283447634072, "get_duckie_state": 1.7135963154077331e-06, "in-drivable-lane": 4.749999999999985, "deviation-heading": 11.161085871749528, "agent_compute-ego0": 0.01290160511852204, "agent_compute-ego1": 0.0132408868661034, "agent_compute-ego2": 0.013663340369231697, "agent_compute-ego3": 0.013019692788612435, "complete-iteration": 0.8697395844820834, "set_robot_commands": 0.002467469907025314, "deviation-center-line": 2.8434617006509093, "driven_lanedir_consec": 13.330088639141088, "sim_compute_sim_state": 0.04358034229199158, "sim_compute_performance-ego0": 0.002500598178517312, "sim_compute_performance-ego1": 0.002301131358849417, "sim_compute_performance-ego2": 0.002328045461497438, "sim_compute_performance-ego3": 0.002354958571561866}}
set_robot_commands_max0.002467469907025314
set_robot_commands_mean0.0023665719813080106
set_robot_commands_median0.0023665719813080106
set_robot_commands_min0.002265674055590707
sim_compute_performance-ego0_max0.002500598178517312
sim_compute_performance-ego0_mean0.0023581760151585775
sim_compute_performance-ego0_median0.0023581760151585775
sim_compute_performance-ego0_min0.0022157538517998433
sim_compute_performance-ego1_max0.002301131358849417
sim_compute_performance-ego1_mean0.002229123758199428
sim_compute_performance-ego1_median0.002229123758199428
sim_compute_performance-ego1_min0.00215711615754944
sim_compute_performance-ego2_max0.002328045461497438
sim_compute_performance-ego2_mean0.002224395446231851
sim_compute_performance-ego2_median0.002224395446231851
sim_compute_performance-ego2_min0.002120745430966264
sim_compute_performance-ego3_max0.002354958571561866
sim_compute_performance-ego3_mean0.002247267875612504
sim_compute_performance-ego3_median0.002247267875612504
sim_compute_performance-ego3_min0.0021395771796631426
sim_compute_sim_state_max0.04358034229199158
sim_compute_sim_state_mean0.03743486612483811
sim_compute_sim_state_median0.03743486612483811
sim_compute_sim_state_min0.031289389957684655
sim_render-ego0_max0.004400761498698187
sim_render-ego0_mean0.004230178066606154
sim_render-ego0_median0.004230178066606154
sim_render-ego0_min0.004059594634514121
sim_render-ego1_max0.004427257525136727
sim_render-ego1_mean0.004303378395313031
sim_render-ego1_median0.004303378395313031
sim_render-ego1_min0.004179499265489335
sim_render-ego2_max0.004495535762383479
sim_render-ego2_mean0.004304865232106644
sim_render-ego2_median0.004304865232106644
sim_render-ego2_min0.0041141947018298085
sim_render-ego3_max0.004495283447634072
sim_render-ego3_mean0.004321814768256294
sim_render-ego3_median0.004321814768256294
sim_render-ego3_min0.004148346088878516
simulation-passed1
step_physics_max1.020717550596339
step_physics_mean0.8372845496969605
step_physics_median0.8372845496969605
step_physics_min0.653851548797582
survival_time_max59.99999999999873
survival_time_mean40.749999999999446
survival_time_min21.50000000000017
No reset possible
5881112864Raphael Jeansim-exercise-2aido5-LF-sim-testingLFt-simsuccessyesnogpu-prod-020:39:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median14.948996497979412
survival_time_median59.99999999999873
deviation-center-line_median3.276522338991965
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013174308924551908
agent_compute-ego0_mean0.012753875924586058
agent_compute-ego0_median0.012643664008274762
agent_compute-ego0_min0.012553866757242804
complete-iteration_max0.2424487096880199
complete-iteration_mean0.2197703509703961
complete-iteration_median0.2206824972270232
complete-iteration_min0.1952676997395181
deviation-center-line_max3.902293910764119
deviation-center-line_mean3.3924990932101453
deviation-center-line_min3.114657784092532
deviation-heading_max13.72500257202516
deviation-heading_mean12.71048782800575
deviation-heading_median13.18637256912334
deviation-heading_min10.744203601751154
driven_any_max16.703844890944154
driven_any_mean15.344813773674186
driven_any_median15.550751170962531
driven_any_min13.573907861827523
driven_lanedir_consec_max16.29627961626197
driven_lanedir_consec_mean14.821486026939809
driven_lanedir_consec_min13.09167149553844
driven_lanedir_max16.29627961626197
driven_lanedir_mean14.821486026939809
driven_lanedir_median14.948996497979412
driven_lanedir_min13.09167149553844
get_duckie_state_max1.6844143577658266e-06
get_duckie_state_mean1.4609837909225224e-06
get_duckie_state_median1.4030169090760142e-06
get_duckie_state_min1.3534869877722342e-06
get_robot_state_max0.004181228212075468
get_robot_state_mean0.004018323109807024
get_robot_state_median0.004017605868902532
get_robot_state_min0.003856852489347561
get_state_dump_max0.005383875447447155
get_state_dump_mean0.005013535610345083
get_state_dump_median0.0049079944450194195
get_state_dump_min0.004854278103894338
get_ui_image_max0.035496837590556655
get_ui_image_mean0.03327629429216091
get_ui_image_median0.03388958390209697
get_ui_image_min0.029829171773893052
in-drivable-lane_max0.5500000000000005
in-drivable-lane_mean0.13750000000000012
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 16.703844890944154, "get_ui_image": 0.03303192696106821, "step_physics": 0.14078507693383616, "survival_time": 59.99999999999873, "driven_lanedir": 16.29627961626197, "get_state_dump": 0.005383875447447155, "get_robot_state": 0.004181228212075468, "sim_render-ego0": 0.0042021187219294185, "get_duckie_state": 1.6844143577658266e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.744203601751154, "agent_compute-ego0": 0.013174308924551908, "complete-iteration": 0.21583682829692505, "set_robot_commands": 0.002473881202970913, "deviation-center-line": 3.114657784092532, "driven_lanedir_consec": 16.29627961626197, "sim_compute_sim_state": 0.010248746998998942, "sim_compute_performance-ego0": 0.0022523160977327853}, "LF-norm-zigzag-000-ego0": {"driven_any": 13.573907861827523, "get_ui_image": 0.035496837590556655, "step_physics": 0.1633702870908129, "survival_time": 59.99999999999873, "driven_lanedir": 13.09167149553844, "get_state_dump": 0.00487296607075484, "get_robot_state": 0.003856852489347561, "sim_render-ego0": 0.00394980337697203, "get_duckie_state": 1.445003195071002e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.27503946280178, "agent_compute-ego0": 0.012553866757242804, "complete-iteration": 0.2424487096880199, "set_robot_commands": 0.0023455998978944344, "deviation-center-line": 3.902293910764119, "driven_lanedir_consec": 13.09167149553844, "sim_compute_sim_state": 0.01376397841975254, "sim_compute_performance-ego0": 0.002147922309411753}, "LF-norm-techtrack-000-ego0": {"driven_any": 15.908543756723388, "get_ui_image": 0.03474724084312572, "step_physics": 0.1467688407230933, "survival_time": 59.99999999999873, "driven_lanedir": 15.368463144636678, "get_state_dump": 0.004854278103894338, "get_robot_state": 0.004009241863253909, "sim_render-ego0": 0.00406470247152743, "get_duckie_state": 1.3610306230810263e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.0977056754449, "agent_compute-ego0": 0.0126270560995923, "complete-iteration": 0.22552816615712137, "set_robot_commands": 0.0024110175092254054, "deviation-center-line": 3.3447622640258774, "driven_lanedir_consec": 15.368463144636678, "sim_compute_sim_state": 0.013724948643248445, "sim_compute_performance-ego0": 0.0022289987209933087}, "LF-norm-small_loop-000-ego0": {"driven_any": 15.192958585201676, "get_ui_image": 0.029829171773893052, "step_physics": 0.12817891154261454, "survival_time": 59.99999999999873, "driven_lanedir": 14.529529851322147, "get_state_dump": 0.004943022819283999, "get_robot_state": 0.004025969874551155, "sim_render-ego0": 0.004073058635765667, "get_duckie_state": 1.3534869877722342e-06, "in-drivable-lane": 0.5500000000000005, "deviation-heading": 13.72500257202516, "agent_compute-ego0": 0.012660271916957224, "complete-iteration": 0.1952676997395181, "set_robot_commands": 0.0024691835033407218, "deviation-center-line": 3.2082824139580532, "driven_lanedir_consec": 14.529529851322147, "sim_compute_sim_state": 0.006785695697743132, "sim_compute_performance-ego0": 0.002213374661168488}}
set_robot_commands_max0.002473881202970913
set_robot_commands_mean0.0024249205283578684
set_robot_commands_median0.002440100506283064
set_robot_commands_min0.0023455998978944344
sim_compute_performance-ego0_max0.0022523160977327853
sim_compute_performance-ego0_mean0.002210652947326584
sim_compute_performance-ego0_median0.0022211866910808982
sim_compute_performance-ego0_min0.002147922309411753
sim_compute_sim_state_max0.01376397841975254
sim_compute_sim_state_mean0.011130842439935769
sim_compute_sim_state_median0.011986847821123692
sim_compute_sim_state_min0.006785695697743132
sim_render-ego0_max0.0042021187219294185
sim_render-ego0_mean0.004072420801548637
sim_render-ego0_median0.004068880553646548
sim_render-ego0_min0.00394980337697203
simulation-passed1
step_physics_max0.1633702870908129
step_physics_mean0.1447757790725892
step_physics_median0.14377695882846472
step_physics_min0.12817891154261454
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5877712755Raphael Jeansim-exercise-1aido5-LFV-sim-validationLFVv-simsuccessyesnogpu-prod-020:55:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.78078270901588
survival_time_median23.6000000000002
deviation-center-line_median1.254855217509018
in-drivable-lane_median1.525000000000004


other stats
agent_compute-ego0_max0.01326035435451642
agent_compute-ego0_mean0.013171075453558547
agent_compute-ego0_median0.01321512498975596
agent_compute-ego0_min0.01299369748020585
agent_compute-npc0_max0.026070210893275377
agent_compute-npc0_mean0.023426011215079617
agent_compute-npc0_median0.023037864397771113
agent_compute-npc0_min0.021558105171500863
agent_compute-npc1_max0.03418012837733119
agent_compute-npc1_mean0.03308728264365841
agent_compute-npc1_median0.032778916262257186
agent_compute-npc1_min0.03230280329138686
agent_compute-npc2_max0.03688910822847705
agent_compute-npc2_mean0.031051774942076435
agent_compute-npc2_median0.02839055819597926
agent_compute-npc2_min0.02787565840177299
agent_compute-npc3_max0.04588718256674522
agent_compute-npc3_mean0.040024591917793
agent_compute-npc3_median0.040024591917793
agent_compute-npc3_min0.03416200126884078
complete-iteration_max1.360288832459913
complete-iteration_mean0.9707947324080896
complete-iteration_median1.0700884920224951
complete-iteration_min0.3827131131274552
deviation-center-line_max3.2842634033376465
deviation-center-line_mean1.5013218867704436
deviation-center-line_min0.21131370872609245
deviation-heading_max13.013219748448671
deviation-heading_mean6.918428325645191
deviation-heading_median6.608845819482994
deviation-heading_min1.442801915166104
driven_any_max8.238420446834224
driven_any_mean4.518660530059862
driven_any_median4.274640502050772
driven_any_min1.2869406693036798
driven_lanedir_consec_max7.647212649720258
driven_lanedir_consec_mean3.957227707950782
driven_lanedir_consec_min0.6201327640511112
driven_lanedir_max7.647212649720258
driven_lanedir_mean3.957227707950782
driven_lanedir_median3.78078270901588
driven_lanedir_min0.6201327640511112
get_duckie_state_max2.5103924241366228e-06
get_duckie_state_mean2.3453464864903716e-06
get_duckie_state_median2.377430128797871e-06
get_duckie_state_min2.1161332642291223e-06
get_robot_state_max0.019215176420763504
get_robot_state_mean0.015220090143494056
get_robot_state_median0.0170499486398943
get_robot_state_min0.00756528687342412
get_state_dump_max0.011876824473546556
get_state_dump_mean0.010020245528537143
get_state_dump_median0.010744679165373782
get_state_dump_min0.006714799309854453
get_ui_image_max0.06150380829736797
get_ui_image_mean0.05062410668600312
get_ui_image_median0.05246649483722385
get_ui_image_min0.0360596287721968
in-drivable-lane_max4.499999999999997
in-drivable-lane_mean2.0625000000000018
in-drivable-lane_min0.700000000000002
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 4.180608876949126, "get_ui_image": 0.04646137008419285, "step_physics": 0.6323746349904444, "survival_time": 23.050000000000193, "driven_lanedir": 3.8674240242425872, "get_state_dump": 0.00983023282253381, "get_robot_state": 0.014958664452358758, "sim_render-ego0": 0.004011505609982973, "sim_render-npc0": 0.0040876813781209834, "sim_render-npc1": 0.003963757386971346, "sim_render-npc2": 0.003974449066888718, "get_duckie_state": 2.368704065099939e-06, "in-drivable-lane": 0.700000000000002, "deviation-heading": 6.598971882752091, "agent_compute-ego0": 0.01299369748020585, "agent_compute-npc0": 0.021558105171500863, "agent_compute-npc1": 0.03230280329138686, "agent_compute-npc2": 0.03688910822847705, "complete-iteration": 0.8679098030189415, "set_robot_commands": 0.00239936097875818, "deviation-center-line": 1.3202046739911837, "driven_lanedir_consec": 3.8674240242425872, "sim_compute_sim_state": 0.026139997300647554, "sim_compute_performance-ego0": 0.002221167345583697, "sim_compute_performance-npc0": 0.0020793640252315636, "sim_compute_performance-npc1": 0.002118219028819691, "sim_compute_performance-npc2": 0.002109576097298494}, "LFV-norm-zigzag-000-ego0": {"driven_any": 8.238420446834224, "get_ui_image": 0.06150380829736797, "step_physics": 1.0259840239073958, "survival_time": 46.79999999999948, "driven_lanedir": 7.647212649720258, "get_state_dump": 0.011659125508213755, "get_robot_state": 0.01914123282742984, "sim_render-ego0": 0.004158392278209185, "sim_render-npc0": 0.00416747457571447, "sim_render-npc1": 0.004140759226861097, "sim_render-npc2": 0.004119501042645922, "sim_render-npc3": 0.004088927994670074, "get_duckie_state": 2.5103924241366228e-06, "in-drivable-lane": 1.050000000000015, "deviation-heading": 13.013219748448671, "agent_compute-ego0": 0.01326035435451642, "agent_compute-npc0": 0.023166940713514005, "agent_compute-npc1": 0.032778916262257186, "agent_compute-npc2": 0.02839055819597926, "agent_compute-npc3": 0.03416200126884078, "complete-iteration": 1.360288832459913, "set_robot_commands": 0.002528097993408985, "deviation-center-line": 3.2842634033376465, "driven_lanedir_consec": 7.647212649720258, "sim_compute_sim_state": 0.06548210752684636, "sim_compute_performance-ego0": 0.002367855517815882, "sim_compute_performance-npc0": 0.0021732657543495856, "sim_compute_performance-npc1": 0.0022036652682048915, "sim_compute_performance-npc2": 0.002227113748181973, "sim_compute_performance-npc3": 0.0021755298402800502}, "LFV-norm-techtrack-000-ego0": {"driven_any": 4.368672127152419, "get_ui_image": 0.058471619590254854, "step_physics": 0.9310951725510528, "survival_time": 24.150000000000208, "driven_lanedir": 3.694141393789173, "get_state_dump": 0.011876824473546556, "get_robot_state": 0.019215176420763504, "sim_render-ego0": 0.004060798440097778, "sim_render-npc0": 0.004171996569830524, "sim_render-npc1": 0.0041461695324290886, "sim_render-npc2": 0.004142271585700926, "sim_render-npc3": 0.0041036477758864725, "get_duckie_state": 2.386156192495803e-06, "in-drivable-lane": 1.999999999999993, "deviation-heading": 6.618719756213896, "agent_compute-ego0": 0.013197676701979204, "agent_compute-npc0": 0.022908788082028224, "agent_compute-npc1": 0.03418012837733119, "agent_compute-npc2": 0.02787565840177299, "agent_compute-npc3": 0.04588718256674522, "complete-iteration": 1.2722671810260489, "set_robot_commands": 0.0024627343682218188, "deviation-center-line": 1.1895057610268522, "driven_lanedir_consec": 3.694141393789173, "sim_compute_sim_state": 0.06315277479896861, "sim_compute_performance-ego0": 0.002359772024075847, "sim_compute_performance-npc0": 0.002160822064423364, "sim_compute_performance-npc1": 0.0021996552293950863, "sim_compute_performance-npc2": 0.002196069098701162, "sim_compute_performance-npc3": 0.002156391124094813}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.2869406693036798, "get_ui_image": 0.0360596287721968, "step_physics": 0.2650671341998429, "survival_time": 8.79999999999999, "driven_lanedir": 0.6201327640511112, "get_state_dump": 0.006714799309854453, "get_robot_state": 0.00756528687342412, "sim_render-ego0": 0.0039965837015270515, "sim_render-npc0": 0.00414609774357855, "get_duckie_state": 2.1161332642291223e-06, "in-drivable-lane": 4.499999999999997, "deviation-heading": 1.442801915166104, "agent_compute-ego0": 0.013232573277532718, "agent_compute-npc0": 0.026070210893275377, "complete-iteration": 0.3827131131274552, "set_robot_commands": 0.00244228314545195, "deviation-center-line": 0.21131370872609245, "driven_lanedir_consec": 0.6201327640511112, "sim_compute_sim_state": 0.010718671615514378, "sim_compute_performance-ego0": 0.002131563121989622, "sim_compute_performance-npc0": 0.0020993092639298087}}
set_robot_commands_max0.002528097993408985
set_robot_commands_mean0.0024581191214602333
set_robot_commands_median0.0024525087568368843
set_robot_commands_min0.00239936097875818
sim_compute_performance-ego0_max0.002367855517815882
sim_compute_performance-ego0_mean0.002270089502366262
sim_compute_performance-ego0_median0.002290469684829772
sim_compute_performance-ego0_min0.002131563121989622
sim_compute_performance-npc0_max0.0021732657543495856
sim_compute_performance-npc0_mean0.0021281902769835805
sim_compute_performance-npc0_median0.0021300656641765866
sim_compute_performance-npc0_min0.0020793640252315636
sim_compute_performance-npc1_max0.0022036652682048915
sim_compute_performance-npc1_mean0.002173846508806556
sim_compute_performance-npc1_median0.0021996552293950863
sim_compute_performance-npc1_min0.002118219028819691
sim_compute_performance-npc2_max0.002227113748181973
sim_compute_performance-npc2_mean0.0021775863147272096
sim_compute_performance-npc2_median0.002196069098701162
sim_compute_performance-npc2_min0.002109576097298494
sim_compute_performance-npc3_max0.0021755298402800502
sim_compute_performance-npc3_mean0.0021659604821874317
sim_compute_performance-npc3_median0.0021659604821874317
sim_compute_performance-npc3_min0.002156391124094813
sim_compute_sim_state_max0.06548210752684636
sim_compute_sim_state_mean0.041373387810494225
sim_compute_sim_state_median0.04464638604980808
sim_compute_sim_state_min0.010718671615514378
sim_render-ego0_max0.004158392278209185
sim_render-ego0_mean0.004056820007454247
sim_render-ego0_median0.0040361520250403755
sim_render-ego0_min0.0039965837015270515
sim_render-npc0_max0.004171996569830524
sim_render-npc0_mean0.004143312566811132
sim_render-npc0_median0.00415678615964651
sim_render-npc0_min0.0040876813781209834
sim_render-npc1_max0.0041461695324290886
sim_render-npc1_mean0.004083562048753844
sim_render-npc1_median0.004140759226861097
sim_render-npc1_min0.003963757386971346
sim_render-npc2_max0.004142271585700926
sim_render-npc2_mean0.004078740565078522
sim_render-npc2_median0.004119501042645922
sim_render-npc2_min0.003974449066888718
sim_render-npc3_max0.0041036477758864725
sim_render-npc3_mean0.004096287885278273
sim_render-npc3_median0.004096287885278273
sim_render-npc3_min0.004088927994670074
simulation-passed1
step_physics_max1.0259840239073958
step_physics_mean0.713630241412184
step_physics_median0.7817349037707486
step_physics_min0.2650671341998429
survival_time_max46.79999999999948
survival_time_mean25.699999999999967
survival_time_min8.79999999999999
No reset possible
5870711772Ehsan AhmadiΒ πŸ‡¨πŸ‡¦template-randomaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-020:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586856728Andrea CensiΒ πŸ‡¨πŸ‡­template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:04:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.01158672571182251
agent_compute-ego0_mean0.011093091520365828
agent_compute-ego0_median0.01105733772654683
agent_compute-ego0_min0.01067096491654714
complete-iteration_max0.21492159107457037
complete-iteration_mean0.19039593623025167
complete-iteration_median0.19049690517108317
complete-iteration_min0.16566834350426993
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.4875246130901834e-06
get_duckie_state_mean1.390192662037411e-06
get_duckie_state_median1.4041515090797522e-06
get_duckie_state_min1.2649430168999566e-06
get_robot_state_max0.0039032623171806335
get_robot_state_mean0.003834234579526481
get_robot_state_median0.0038457819735800494
get_robot_state_min0.0037421120537651903
get_state_dump_max0.004931410153706868
get_state_dump_mean0.00482746087072082
get_state_dump_median0.004853075235218242
get_state_dump_min0.004672282858739925
get_ui_image_max0.0370084487873575
get_ui_image_mean0.03133999370869997
get_ui_image_median0.030827645552979913
get_ui_image_min0.026696234941482544
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.028236271459845048, "step_physics": 0.10682627370085895, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004672282858739925, "get_robot_state": 0.003815030749840073, "sim_render-ego0": 0.003895490984373455, "get_duckie_state": 1.385242124147053e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.010968021199673036, "complete-iteration": 0.17288199104840243, "set_robot_commands": 0.0022587806363649006, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.010065206998511206, "sim_compute_performance-ego0": 0.0020594566683225994}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.0370084487873575, "step_physics": 0.139925523944523, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.004837774712106456, "get_robot_state": 0.003876533197320026, "sim_render-ego0": 0.003950715065002441, "get_duckie_state": 1.4875246130901834e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.011146654253420622, "complete-iteration": 0.21492159107457037, "set_robot_commands": 0.002410981966101605, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.009572985379592232, "sim_compute_performance-ego0": 0.0021017297454502273}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.033419019646114774, "step_physics": 0.13792050215933058, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004931410153706868, "get_robot_state": 0.0037421120537651903, "sim_render-ego0": 0.003938913345336914, "get_duckie_state": 1.2649430168999566e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.01158672571182251, "complete-iteration": 0.2081118192937639, "set_robot_commands": 0.002352896663877699, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.008106589317321777, "sim_compute_performance-ego0": 0.002028985155953301}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.026696234941482544, "step_physics": 0.1061045949657758, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.0048683757583300276, "get_robot_state": 0.0039032623171806335, "sim_render-ego0": 0.003881951173146566, "get_duckie_state": 1.4230608940124512e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.01067096491654714, "complete-iteration": 0.16566834350426993, "set_robot_commands": 0.002236679196357727, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.005169890820980072, "sim_compute_performance-ego0": 0.0020499577124913535}}
set_robot_commands_max0.002410981966101605
set_robot_commands_mean0.002314834615675483
set_robot_commands_median0.0023058386501213
set_robot_commands_min0.002236679196357727
sim_compute_performance-ego0_max0.0021017297454502273
sim_compute_performance-ego0_mean0.00206003232055437
sim_compute_performance-ego0_median0.0020547071904069764
sim_compute_performance-ego0_min0.002028985155953301
sim_compute_sim_state_max0.010065206998511206
sim_compute_sim_state_mean0.008228668129101321
sim_compute_sim_state_median0.008839787348457005
sim_compute_sim_state_min0.005169890820980072
sim_render-ego0_max0.003950715065002441
sim_render-ego0_mean0.003916767641964844
sim_render-ego0_median0.003917202164855185
sim_render-ego0_min0.003881951173146566
simulation-passed1
step_physics_max0.139925523944523
step_physics_mean0.12269422369262208
step_physics_median0.12237338793009478
step_physics_min0.1061045949657758
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
586716758Liam PaullΒ πŸ‡¨πŸ‡¦template-rosaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:02:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586526760Anthony CourchesneΒ πŸ‡¨πŸ‡¦template-rosaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:02:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586456800Anthony CourchesneΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 39, in on_received_observations
              ||     jpg_data = data['camera']['jpg_data']
              || TypeError: 'Duckiebot1Observations' object is not subscriptable
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 474, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
              ||     raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
              || zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method ROSBaselineAgent.on_received_observations of <__main__.ROSBaselineAgent object at 0x7f0a6dd803d0>>.
              || β”‚       f: <bound method ROSBaselineAgent.on_received_observations of <__main__.ROSBaselineAgent object at 0x7f0a6dd803d0>>
              || β”‚    args: dict[2]
              || β”‚          β”‚ data:
              || β”‚          β”‚ Duckiebot1Observations
              || β”‚          β”‚ β”‚ camera: JPGImage(jpg_data=70367 bytes b'\xff\xd8\xff\xe0\x00\x10JFIF')
              || β”‚          β”‚ context: <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f0a55880d90>
              || β”‚ argspec: <class 'inspect.FullArgSpec'>[7]
              || β”‚          #0 [self, context, data]
              || β”‚          #1 None
              || β”‚          #2 None
              || β”‚          #3 None
              || β”‚          #4 []
              || β”‚          #5 None
              || β”‚          #6 dict[2]
              || β”‚             β”‚ context: <class 'zuper_nodes_wrapper.interface.Context'>
              || β”‚             β”‚ data:
              || β”‚             β”‚ dataclass aido_schemas.schemas.Duckiebot1Observations
              || β”‚             β”‚  field  camera : dataclass aido_schemas.protocol_simulator.JPGImage
              || β”‚             β”‚                   field jpg_data : bytes
              || β”‚             β”‚                          __doc__
              || β”‚             β”‚                                            An image in JPG format.
              || β”‚             β”‚
              || β”‚             β”‚                                            jpg_data
              || β”‚             β”‚        __doc__   Duckiebot1Observations(camera: aido_schemas.protoc
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586386802Anthony CourchesneΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:00:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 474, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 66, in on_received_get_commands
              ||     context.write('commands', commands)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 99, in write
              ||     self._write(topic, data, timing, with_schema)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 112, in _write
              ||     check_isinstance(data, klass)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_checks.py", line 13, in check_isinstance
              ||     raise_type_mismatch(ob, expected, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_checks.py", line 25, in raise_type_mismatch
              ||     raise ZValueError(msg, expected=expected, obtained=type(ob), **kwargs)
              || zuper_commons.types.exceptions.ZValueError: Object not of expected type:
              || β”‚ expected: dataclass aido_schemas.schemas.Duckiebot1Commands
              || β”‚            field  wheels : dataclass aido_schemas.schemas.PWMCommands
              || β”‚                             field  motor_left : float
              || β”‚                             field motor_right : float
              || β”‚                                       __doc__
              || β”‚                                                         PWM commands are floats between -1 and 1.
              || β”‚            field    LEDS : dataclass aido_schemas.schemas.LEDSCommands
              || β”‚                             field      center : dataclass aido_schemas.schemas.RGB
              || β”‚                                                  field       r : float
              || β”‚                                                  field       g : float
              || β”‚                                                  field       b : float
              || β”‚                                                        __doc__   RGB(r: float, g: float, b: float)
              || β”‚                             field  front_left : dataclass aido_schemas.schemas.RGB
              || β”‚                                                  field       r : float
              || β”‚                                                  field       g : float
              || β”‚                                                  field       b : float
              || β”‚                                                        __doc__   RGB(r: float, g: float, b: float)
              || β”‚                             field front_right : dataclass aido_schemas.schemas.RGB
              || β”‚                                                  field       r : float
              || β”‚                                                  field       g : float
              || β”‚                                                  field       b : float
              || β”‚                                                        __doc__   RGB(r: float, g: float, b: float)
              || β”‚                             field   back_left : dataclass aido_schemas.schemas.RGB
              || β”‚                                                  field       r : float
              || β”‚                                                  field       g : float
              || β”‚                                                  field       b : float
              || β”‚                                                        __doc__   RGB(r: float, g: float, b: float)
              || β”‚                             field  back_right : dataclass aido_schemas.schemas.RGB
              || β”‚                                                  field       r : float
              || β”‚                                                  field       g : float
              || β”‚                                                  field       b : float
              || β”‚                                                        __doc__   RGB(r: float, g: float, b: float)
              || β”‚                                       __doc__   LEDSCommands(center: aido_schemas.schemas.RGB, fro
              || β”‚                  __doc__   Duckiebot1Commands(wheels: aido_schemas.schemas.PW
              || β”‚ obtained: dict
              || β”‚   object: dict[2]
              || β”‚           β”‚ wheels: {motor_left: 0.0, motor_right: 0.0}
              || β”‚           β”‚ LEDS:
              || β”‚           β”‚ dict[5]
              || β”‚           β”‚ β”‚ center: {r: 0.5, g: 0.5, b: 0.5}
              || β”‚           β”‚ β”‚ front_left: {r: 0.5, g: 0.5, b: 0.5}
              || β”‚           β”‚ β”‚ front_right: {r: 0.5, g: 0.5, b: 0.5}
              || β”‚           β”‚ β”‚ back_left: {r: 0.5, g: 0.5, b: 0.5}
              || β”‚           β”‚ β”‚ back_right: {r: 0.5, g: 0.5, b: 0.5}
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
586316802Anthony CourchesneΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 474, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 66, in on_received_get_commands
              ||     context.write('commands', commands)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 99, in write
              ||     self._write(topic, data, timing, with_schema)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 112, in _write
              ||     check_isinstance(data, klass)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_checks.py", line 13, in check_isinstance
              ||     raise_type_mismatch(ob, expected, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_commons/types/zc_checks.py", line 25, in raise_type_mismatch
              ||     raise ZValueError(msg, expected=expected, obtained=type(ob), **kwargs)
              || zuper_commons.types.exceptions.ZValueError: Object not of expected type:
              || β”‚ expected: dataclass aido_schemas.schemas.Duckiebot1Commands
              || β”‚            field  wheels : dataclass aido_schemas.schemas.PWMCommands
              || β”‚                             field  motor_left : float
              || β”‚                             field motor_right : float
              || β”‚                                       __doc__
              || β”‚                                                         PWM commands are floats between -1 and 1.
              || β”‚            field    LEDS : dataclass aido_schemas.schemas.LEDSCommands
              || β”‚                             field      center : dataclass aido_schemas.schemas.RGB
              || β”‚                                                  field       r : float
              || β”‚                                                  field       g : float
              || β”‚                                                  field       b : float
              || β”‚                                                        __doc__   RGB(r: float, g: float, b: float)
              || β”‚                             field  front_left : dataclass aido_schemas.schemas.RGB
              || β”‚                                                  field       r : float
              || β”‚                                                  field       g : float
              || β”‚                                                  field       b : float
              || β”‚                                                        __doc__   RGB(r: float, g: float, b: float)
              || β”‚                             field front_right : dataclass aido_schemas.schemas.RGB
              || β”‚                                                  field       r : float
              || β”‚                                                  field       g : float
              || β”‚                                                  field       b : float
              || β”‚                                                        __doc__   RGB(r: float, g: float, b: float)
              || β”‚                             field   back_left : dataclass aido_schemas.schemas.RGB
              || β”‚                                                  field       r : float
              || β”‚                                                  field       g : float
              || β”‚                                                  field       b : float
              || β”‚                                                        __doc__   RGB(r: float, g: float, b: float)
              || β”‚                             field  back_right : dataclass aido_schemas.schemas.RGB
              || β”‚                                                  field       r : float
              || β”‚                                                  field       g : float
              || β”‚                                                  field       b : float
              || β”‚                                                        __doc__   RGB(r: float, g: float, b: float)
              || β”‚                                       __doc__   LEDSCommands(center: aido_schemas.schemas.RGB, fro
              || β”‚                  __doc__   Duckiebot1Commands(wheels: aido_schemas.schemas.PW
              || β”‚ obtained: dict
              || β”‚   object: dict[2]
              || β”‚           β”‚ wheels: {motor_left: 0.0, motor_right: 0.0}
              || β”‚           β”‚ LEDS:
              || β”‚           β”‚ dict[5]
              || β”‚           β”‚ β”‚ center: {r: 0.5, g: 0.5, b: 0.5}
              || β”‚           β”‚ β”‚ front_left: {r: 0.5, g: 0.5, b: 0.5}
              || β”‚           β”‚ β”‚ front_right: {r: 0.5, g: 0.5, b: 0.5}
              || β”‚           β”‚ β”‚ back_left: {r: 0.5, g: 0.5, b: 0.5}
              || β”‚           β”‚ β”‚ back_right: {r: 0.5, g: 0.5, b: 0.5}
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
585876825Liam PaullΒ πŸ‡¨πŸ‡¦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:36:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.047641601770212
survival_time_median59.99999999999873
deviation-center-line_median3.1399467597283923
in-drivable-lane_median5.1249999999998535


other stats
agent_compute-ego0_max0.034737217734000965
agent_compute-ego0_mean0.020900229828046027
agent_compute-ego0_median0.018126502521429135
agent_compute-ego0_min0.012610696535324872
complete-iteration_max0.226680628167501
complete-iteration_mean0.19878782906401263
complete-iteration_median0.19903053818495448
complete-iteration_min0.17040961171864075
deviation-center-line_max4.035506260077588
deviation-center-line_mean3.194574481749471
deviation-center-line_min2.4628981474635108
deviation-heading_max10.582488401607112
deviation-heading_mean9.345666066457484
deviation-heading_median9.27948495959313
deviation-heading_min8.241205945036551
driven_any_max7.921155624232377
driven_any_mean7.919382823970436
driven_any_median7.920988092315975
driven_any_min7.914399487017415
driven_lanedir_consec_max7.072220950280483
driven_lanedir_consec_mean5.633792020589162
driven_lanedir_consec_min3.3676639285357393
driven_lanedir_max7.149468353977479
driven_lanedir_mean6.295145816080397
driven_lanedir_median6.969534113757955
driven_lanedir_min4.0920466828281965
get_duckie_state_max1.4563186480341903e-06
get_duckie_state_mean1.3971606658757676e-06
get_duckie_state_median1.398748799624987e-06
get_duckie_state_min1.3348264162189062e-06
get_robot_state_max0.00392673990311571
get_robot_state_mean0.00380206217277457
get_robot_state_median0.003782677213714879
get_robot_state_min0.003716154360552811
get_state_dump_max0.004909593199413087
get_state_dump_mean0.004779232878371341
get_state_dump_median0.004789532868689442
get_state_dump_min0.004628272576693393
get_ui_image_max0.03616510541313991
get_ui_image_mean0.03147044735685376
get_ui_image_median0.03112521983503204
get_ui_image_min0.02746624434421104
in-drivable-lane_max26.499999999999073
in-drivable-lane_mean10.12499999999966
in-drivable-lane_min3.7499999999998543
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.921155624232377, "get_ui_image": 0.0283963382492256, "step_physics": 0.10374553197627262, "survival_time": 59.99999999999873, "driven_lanedir": 7.090964111559856, "get_state_dump": 0.004628272576693393, "get_robot_state": 0.0037250306385939167, "sim_render-ego0": 0.0038529528269263527, "get_duckie_state": 1.3348264162189062e-06, "in-drivable-lane": 3.7499999999998543, "deviation-heading": 9.596686171817575, "agent_compute-ego0": 0.012610696535324872, "complete-iteration": 0.17040961171864075, "set_robot_commands": 0.002283595781540692, "deviation-center-line": 3.7293046176540248, "driven_lanedir_consec": 5.247179087584369, "sim_compute_sim_state": 0.009039509207084712, "sim_compute_performance-ego0": 0.0020462531630542256}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.920942229409558, "get_ui_image": 0.03616510541313991, "step_physics": 0.13833046872649565, "survival_time": 59.99999999999873, "driven_lanedir": 6.848104115956055, "get_state_dump": 0.004685544054474461, "get_robot_state": 0.003716154360552811, "sim_render-ego0": 0.00389301092003307, "get_duckie_state": 1.394976981970591e-06, "in-drivable-lane": 6.14999999999972, "deviation-heading": 10.582488401607112, "agent_compute-ego0": 0.022446172819050227, "complete-iteration": 0.226680628167501, "set_robot_commands": 0.0022930247301265264, "deviation-center-line": 4.035506260077588, "driven_lanedir_consec": 6.848104115956055, "sim_compute_sim_state": 0.012999417482069588, "sim_compute_performance-ego0": 0.002065955351830323}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.914399487017415, "get_ui_image": 0.03385410142083847, "step_physics": 0.13031422764335843, "survival_time": 59.99999999999873, "driven_lanedir": 4.0920466828281965, "get_state_dump": 0.004909593199413087, "get_robot_state": 0.00392673990311571, "sim_render-ego0": 0.0040391904924632505, "get_duckie_state": 1.4563186480341903e-06, "in-drivable-lane": 26.499999999999073, "deviation-heading": 8.962283747368684, "agent_compute-ego0": 0.01380683222380804, "complete-iteration": 0.20730189121732304, "set_robot_commands": 0.0023859194375196167, "deviation-center-line": 2.4628981474635108, "driven_lanedir_consec": 3.3676639285357393, "sim_compute_sim_state": 0.011847739811245348, "sim_compute_performance-ego0": 0.002127640451817191}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.9210339552223905, "get_ui_image": 0.02746624434421104, "step_physics": 0.10465367330698844, "survival_time": 59.99999999999873, "driven_lanedir": 7.149468353977479, "get_state_dump": 0.004893521682904424, "get_robot_state": 0.003840323788835842, "sim_render-ego0": 0.003943359921318009, "get_duckie_state": 1.402520617279383e-06, "in-drivable-lane": 4.099999999999987, "deviation-heading": 8.241205945036551, "agent_compute-ego0": 0.034737217734000965, "complete-iteration": 0.19075918515258583, "set_robot_commands": 0.0024339924446252067, "deviation-center-line": 2.55058890180276, "driven_lanedir_consec": 7.072220950280483, "sim_compute_sim_state": 0.006604263526414654, "sim_compute_performance-ego0": 0.002093622229875474}}
set_robot_commands_max0.0024339924446252067
set_robot_commands_mean0.0023491330984530103
set_robot_commands_median0.0023394720838230713
set_robot_commands_min0.002283595781540692
sim_compute_performance-ego0_max0.002127640451817191
sim_compute_performance-ego0_mean0.0020833677991443033
sim_compute_performance-ego0_median0.0020797887908528987
sim_compute_performance-ego0_min0.0020462531630542256
sim_compute_sim_state_max0.012999417482069588
sim_compute_sim_state_mean0.010122732506703576
sim_compute_sim_state_median0.010443624509165032
sim_compute_sim_state_min0.006604263526414654
sim_render-ego0_max0.0040391904924632505
sim_render-ego0_mean0.00393212854018517
sim_render-ego0_median0.00391818542067554
sim_render-ego0_min0.0038529528269263527
simulation-passed1
step_physics_max0.13833046872649565
step_physics_mean0.11926097541327878
step_physics_median0.11748395047517345
step_physics_min0.10374553197627262
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
585516838Himanshu AroraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:45:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013696543084493189
agent_compute-ego0_mean0.01306881709063083
agent_compute-ego0_median0.013137733112465431
agent_compute-ego0_min0.012303259053099263
complete-iteration_max0.3835765624622024
complete-iteration_mean0.31913257136531514
complete-iteration_median0.31311583419723577
complete-iteration_min0.2667220546045867
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.3421715348090458e-06
get_duckie_state_mean1.3175554616961453e-06
get_duckie_state_median1.3158680695875995e-06
get_duckie_state_min1.2963141728003355e-06
get_robot_state_max0.0039414221996272435
get_robot_state_mean0.0038773495886943224
get_robot_state_median0.003914942054526196
get_robot_state_min0.003738092046097653
get_state_dump_max0.004942384985066969
get_state_dump_mean0.004895568291015371
get_state_dump_median0.004919694424866637
get_state_dump_min0.0048004993292612395
get_ui_image_max0.03876139420851581
get_ui_image_mean0.03276991203960829
get_ui_image_median0.031826145940775874
get_ui_image_min0.028665962068365577
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03078198194702301, "step_physics": 0.2382985503349971, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.0049415127026052105, "get_robot_state": 0.003915089949481592, "sim_render-ego0": 0.004032975728069118, "get_duckie_state": 1.332047182157772e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.012730811061112709, "complete-iteration": 0.30844139258728537, "set_robot_commands": 0.0023907187777097577, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009141096564554156, "sim_compute_performance-ego0": 0.0021145292166170728}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03876139420851581, "step_physics": 0.3008477862530406, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004942384985066969, "get_robot_state": 0.0039414221996272435, "sim_render-ego0": 0.004105467085635831, "get_duckie_state": 1.3421715348090458e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013696543084493189, "complete-iteration": 0.3835765624622024, "set_robot_commands": 0.002359164346763236, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.01266488187219777, "sim_compute_performance-ego0": 0.0021654376380151755}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03287030993452874, "step_physics": 0.24687072696733436, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.0048004993292612395, "get_robot_state": 0.003738092046097653, "sim_render-ego0": 0.0038536549805602265, "get_duckie_state": 1.299688957017427e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012303259053099263, "complete-iteration": 0.3177902758071861, "set_robot_commands": 0.00223167234416012, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009010901756826586, "sim_compute_performance-ego0": 0.0020236992816146863}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.028665962068365577, "step_physics": 0.20060105863756977, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004897876147128065, "get_robot_state": 0.0039147941595708, "sim_render-ego0": 0.003940013326474967, "get_duckie_state": 1.2963141728003355e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.013544655163818156, "complete-iteration": 0.2667220546045867, "set_robot_commands": 0.00239638265820963, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006526094987727919, "sim_compute_performance-ego0": 0.0021446237556146247}}
set_robot_commands_max0.00239638265820963
set_robot_commands_mean0.002344484531710686
set_robot_commands_median0.002374941562236497
set_robot_commands_min0.00223167234416012
sim_compute_performance-ego0_max0.0021654376380151755
sim_compute_performance-ego0_mean0.0021120724729653895
sim_compute_performance-ego0_median0.0021295764861158487
sim_compute_performance-ego0_min0.0020236992816146863
sim_compute_sim_state_max0.01266488187219777
sim_compute_sim_state_mean0.009335743795326607
sim_compute_sim_state_median0.009075999160690372
sim_compute_sim_state_min0.006526094987727919
sim_render-ego0_max0.004105467085635831
sim_render-ego0_mean0.003983027780185036
sim_render-ego0_median0.003986494527272042
sim_render-ego0_min0.0038536549805602265
simulation-passed1
step_physics_max0.3008477862530406
step_physics_mean0.24665453054823544
step_physics_median0.24258463865116575
step_physics_min0.20060105863756977
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
585436842Himanshu AroraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:17:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0093239546936743
survival_time_median27.22500000000025
deviation-center-line_median0.6496442485298326
in-drivable-lane_median21.975000000000264


other stats
agent_compute-ego0_max0.013217136879597814
agent_compute-ego0_mean0.012828646298960756
agent_compute-ego0_median0.012877417532381178
agent_compute-ego0_min0.012342613251482854
complete-iteration_max0.1874338205799436
complete-iteration_mean0.1741804524214275
complete-iteration_median0.1770647109037305
complete-iteration_min0.1551585672983055
deviation-center-line_max1.9766866486519656
deviation-center-line_mean0.9044675504505536
deviation-center-line_min0.34189505609058396
deviation-heading_max2.613162791034698
deviation-heading_mean2.0232154822049577
deviation-heading_median2.2757769291701027
deviation-heading_min0.928145279444927
driven_any_max6.640067447884479
driven_any_mean4.089421493126113
driven_any_median3.656159643134538
driven_any_min2.405299238350898
driven_lanedir_consec_max2.653391962007609
driven_lanedir_consec_mean1.3073873545153003
driven_lanedir_consec_min0.5575095466662442
driven_lanedir_max2.653391962007609
driven_lanedir_mean1.3073873545153003
driven_lanedir_median1.0093239546936743
driven_lanedir_min0.5575095466662442
get_duckie_state_max1.5610505726711809e-06
get_duckie_state_mean1.526276518687105e-06
get_duckie_state_median1.5310448029742083e-06
get_duckie_state_min1.4819658961288226e-06
get_robot_state_max0.0039916114552030835
get_robot_state_mean0.003911417719763309
get_robot_state_median0.003915290203614123
get_robot_state_min0.003823479016621908
get_state_dump_max0.005020511003188145
get_state_dump_mean0.0049834382614228675
get_state_dump_median0.00498585443521894
get_state_dump_min0.004941533172065443
get_ui_image_max0.035384574478501345
get_ui_image_mean0.03037079429770992
get_ui_image_median0.03020207681056006
get_ui_image_min0.025694449091218208
in-drivable-lane_max28.949999999999235
in-drivable-lane_mean20.23749999999997
in-drivable-lane_min8.050000000000114
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.640067447884479, "get_ui_image": 0.028604096836513944, "step_physics": 0.10367491289421364, "survival_time": 48.54999999999938, "driven_lanedir": 2.653391962007609, "get_state_dump": 0.005020511003188145, "get_robot_state": 0.0039916114552030835, "sim_render-ego0": 0.0040654800065750936, "get_duckie_state": 1.5156259262022168e-06, "in-drivable-lane": 28.949999999999235, "deviation-heading": 2.5951875227506065, "agent_compute-ego0": 0.01275711393160094, "complete-iteration": 0.17295444060745557, "set_robot_commands": 0.002337478315879288, "deviation-center-line": 1.9766866486519656, "driven_lanedir_consec": 2.653391962007609, "sim_compute_sim_state": 0.010142909891811418, "sim_compute_performance-ego0": 0.002249389028352965}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.089419283355012, "get_ui_image": 0.035384574478501345, "step_physics": 0.11064250975896342, "survival_time": 30.300000000000296, "driven_lanedir": 0.7161062812692769, "get_state_dump": 0.004970379677007383, "get_robot_state": 0.003914712877603497, "sim_render-ego0": 0.004121677486664773, "get_duckie_state": 1.4819658961288226e-06, "in-drivable-lane": 24.30000000000031, "deviation-heading": 1.956366335589599, "agent_compute-ego0": 0.012997721133161416, "complete-iteration": 0.1874338205799436, "set_robot_commands": 0.0023643876221859476, "deviation-center-line": 0.34189505609058396, "driven_lanedir_consec": 0.7161062812692769, "sim_compute_sim_state": 0.0107064907004845, "sim_compute_performance-ego0": 0.0022213525787806}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.2229000029140633, "get_ui_image": 0.03180005678460618, "step_physics": 0.10817753086405352, "survival_time": 24.150000000000208, "driven_lanedir": 0.5575095466662442, "get_state_dump": 0.005001329193430499, "get_robot_state": 0.003915867529624749, "sim_render-ego0": 0.004025318898445319, "get_duckie_state": 1.5610505726711809e-06, "in-drivable-lane": 19.650000000000215, "deviation-heading": 0.928145279444927, "agent_compute-ego0": 0.013217136879597814, "complete-iteration": 0.1811749812000054, "set_robot_commands": 0.002359563161518948, "deviation-center-line": 0.3954103565486175, "driven_lanedir_consec": 0.5575095466662442, "sim_compute_sim_state": 0.010460171325147644, "sim_compute_performance-ego0": 0.0021068709940949746}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.405299238350898, "get_ui_image": 0.025694449091218208, "step_physics": 0.09409286089933636, "survival_time": 18.250000000000124, "driven_lanedir": 1.3025416281180724, "get_state_dump": 0.004941533172065443, "get_robot_state": 0.003823479016621908, "sim_render-ego0": 0.003911787694920608, "get_duckie_state": 1.5464636797462004e-06, "in-drivable-lane": 8.050000000000114, "deviation-heading": 2.613162791034698, "agent_compute-ego0": 0.012342613251482854, "complete-iteration": 0.1551585672983055, "set_robot_commands": 0.0022929620221664344, "deviation-center-line": 0.9038781405110476, "driven_lanedir_consec": 1.3025416281180724, "sim_compute_sim_state": 0.0058417281166451875, "sim_compute_performance-ego0": 0.0021137898085547275}}
set_robot_commands_max0.0023643876221859476
set_robot_commands_mean0.0023385977804376546
set_robot_commands_median0.002348520738699118
set_robot_commands_min0.0022929620221664344
sim_compute_performance-ego0_max0.002249389028352965
sim_compute_performance-ego0_mean0.002172850602445817
sim_compute_performance-ego0_median0.0021675711936676636
sim_compute_performance-ego0_min0.0021068709940949746
sim_compute_sim_state_max0.0107064907004845
sim_compute_sim_state_mean0.00928782500852219
sim_compute_sim_state_median0.010301540608479532
sim_compute_sim_state_min0.0058417281166451875
sim_render-ego0_max0.004121677486664773
sim_render-ego0_mean0.004031066021651449
sim_render-ego0_median0.004045399452510206
sim_render-ego0_min0.003911787694920608
simulation-passed1
step_physics_max0.11064250975896342
step_physics_mean0.10414695360414172
step_physics_median0.1059262218791336
step_physics_min0.09409286089933636
survival_time_max48.54999999999938
survival_time_mean30.312500000000004
survival_time_min18.250000000000124
No reset possible
585196848Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:09:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 1092 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
584899240Liam PaullΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:22:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.751612020546338
survival_time_median45.37499999999952
deviation-center-line_median2.1117828464919417
in-drivable-lane_median5.10000000000003


other stats
agent_compute-ego0_max0.01366548710041218
agent_compute-ego0_mean0.012714014273859998
agent_compute-ego0_median0.0126657926021272
agent_compute-ego0_min0.011858984790773417
complete-iteration_max0.22099168236191208
complete-iteration_mean0.18307323038386425
complete-iteration_median0.17871206607125162
complete-iteration_min0.15387710703104163
deviation-center-line_max3.6269228302847862
deviation-center-line_mean1.997222895209572
deviation-center-line_min0.1384030575696179
deviation-heading_max5.4644974815916845
deviation-heading_mean3.877193823388895
deviation-heading_median4.448545160046676
deviation-heading_min1.1471874918705427
driven_any_max7.921235371656832
driven_any_mean5.093123173536743
driven_any_median5.929544217869555
driven_any_min0.5921688867510286
driven_lanedir_consec_max7.494490605114086
driven_lanedir_consec_mean4.292946515929577
driven_lanedir_consec_min0.17407141751154587
driven_lanedir_max7.494490605114086
driven_lanedir_mean4.292946515929577
driven_lanedir_median4.751612020546338
driven_lanedir_min0.17407141751154587
get_duckie_state_max2.0683585823356333e-06
get_duckie_state_mean1.9008008037709744e-06
get_duckie_state_median1.866652705488753e-06
get_duckie_state_min1.8015392217707575e-06
get_robot_state_max0.0038580486366340703
get_robot_state_mean0.0037357476613641663
get_robot_state_median0.003739540974509661
get_robot_state_min0.003605860059803273
get_state_dump_max0.004911156388016435
get_state_dump_mean0.0047317229110769195
get_state_dump_median0.00475019455676
get_state_dump_min0.004515346142771242
get_ui_image_max0.03665031613530339
get_ui_image_mean0.03073210114996231
get_ui_image_median0.030443140648743136
get_ui_image_min0.025391807167059577
in-drivable-lane_max10.349999999999412
in-drivable-lane_mean5.79999999999983
in-drivable-lane_min2.64999999999985
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.921235371656832, "get_ui_image": 0.02764119772390958, "step_physics": 0.09494066198699976, "survival_time": 59.99999999999873, "driven_lanedir": 7.494490605114086, "get_state_dump": 0.004515346142771242, "get_robot_state": 0.003636186267811492, "sim_render-ego0": 0.003749920863295276, "get_duckie_state": 1.8259567781650055e-06, "in-drivable-lane": 2.64999999999985, "deviation-heading": 5.4644974815916845, "agent_compute-ego0": 0.01228203920400907, "complete-iteration": 0.16039166541818178, "set_robot_commands": 0.0021901196186786685, "deviation-center-line": 3.6269228302847862, "driven_lanedir_consec": 7.494490605114086, "sim_compute_sim_state": 0.009374394007864642, "sim_compute_performance-ego0": 0.001981421970110154}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.5921688867510286, "get_ui_image": 0.03665031613530339, "step_physics": 0.14249891848177523, "survival_time": 5.4999999999999885, "driven_lanedir": 0.17407141751154587, "get_state_dump": 0.004911156388016435, "get_robot_state": 0.0038580486366340703, "sim_render-ego0": 0.003956240576666755, "get_duckie_state": 1.9073486328125e-06, "in-drivable-lane": 3.5499999999999874, "deviation-heading": 1.1471874918705427, "agent_compute-ego0": 0.01366548710041218, "complete-iteration": 0.22099168236191208, "set_robot_commands": 0.002266183629766241, "deviation-center-line": 0.1384030575696179, "driven_lanedir_consec": 0.17407141751154587, "sim_compute_sim_state": 0.010970768627819712, "sim_compute_performance-ego0": 0.002126500413224504}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.938000507795264, "get_ui_image": 0.033245083573576695, "step_physics": 0.1221372713516285, "survival_time": 30.750000000000306, "driven_lanedir": 3.0794246221682187, "get_state_dump": 0.004855105242171845, "get_robot_state": 0.0038428956812078304, "sim_render-ego0": 0.003937083018290532, "get_duckie_state": 2.0683585823356333e-06, "in-drivable-lane": 6.650000000000073, "deviation-heading": 3.5733750125625052, "agent_compute-ego0": 0.01304954600024533, "complete-iteration": 0.19703246672432145, "set_robot_commands": 0.0023079828008428795, "deviation-center-line": 1.508064099386757, "driven_lanedir_consec": 3.0794246221682187, "sim_compute_sim_state": 0.01143386960029602, "sim_compute_performance-ego0": 0.0021291123582171155}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.921087927943845, "get_ui_image": 0.025391807167059577, "step_physics": 0.0943751996204716, "survival_time": 59.99999999999873, "driven_lanedir": 6.423799418924458, "get_state_dump": 0.004645283871348156, "get_robot_state": 0.003605860059803273, "sim_render-ego0": 0.003724156172448253, "get_duckie_state": 1.8015392217707575e-06, "in-drivable-lane": 10.349999999999412, "deviation-heading": 5.323715307530847, "agent_compute-ego0": 0.011858984790773417, "complete-iteration": 0.15387710703104163, "set_robot_commands": 0.002179429096345798, "deviation-center-line": 2.7155015935971267, "driven_lanedir_consec": 6.423799418924458, "sim_compute_sim_state": 0.006042083633829414, "sim_compute_performance-ego0": 0.001975118071709346}}
set_robot_commands_max0.0023079828008428795
set_robot_commands_mean0.0022359287864083966
set_robot_commands_median0.002228151624222455
set_robot_commands_min0.002179429096345798
sim_compute_performance-ego0_max0.0021291123582171155
sim_compute_performance-ego0_mean0.0020530382033152796
sim_compute_performance-ego0_median0.0020539611916673287
sim_compute_performance-ego0_min0.001975118071709346
sim_compute_sim_state_max0.01143386960029602
sim_compute_sim_state_mean0.009455278967452447
sim_compute_sim_state_median0.010172581317842178
sim_compute_sim_state_min0.006042083633829414
sim_render-ego0_max0.003956240576666755
sim_render-ego0_mean0.003841850157675205
sim_render-ego0_median0.003843501940792905
sim_render-ego0_min0.003724156172448253
simulation-passed1
step_physics_max0.14249891848177523
step_physics_mean0.11348801286021878
step_physics_median0.10853896666931412
step_physics_min0.0943751996204716
survival_time_max59.99999999999873
survival_time_mean39.06249999999944
survival_time_min5.4999999999999885
No reset possible
5842812737Thomas WiggersΒ πŸ‡³πŸ‡±ppo_v1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:38:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.098437507674304
survival_time_median59.99999999999873
deviation-center-line_median1.7074626517164864
in-drivable-lane_median18.949999999999285


other stats
agent_compute-ego0_max0.07797841326977986
agent_compute-ego0_mean0.07149382317698069
agent_compute-ego0_median0.07191914146289938
agent_compute-ego0_min0.06415859651234415
complete-iteration_max0.25832457903719863
complete-iteration_mean0.2328148446601904
complete-iteration_median0.2365372160274543
complete-iteration_min0.19986036754865433
deviation-center-line_max1.824911212193572
deviation-center-line_mean1.6788098336782846
deviation-center-line_min1.4754028190865938
deviation-heading_max13.680942552647158
deviation-heading_mean8.632437373489594
deviation-heading_median7.321827139894802
deviation-heading_min6.205152661521617
driven_any_max8.348544715571203
driven_any_mean7.599710430447963
driven_any_median8.093645212318226
driven_any_min5.8630065815842
driven_lanedir_consec_max6.214460363875263
driven_lanedir_consec_mean4.654453062893881
driven_lanedir_consec_min2.206476872351655
driven_lanedir_max6.407779730568016
driven_lanedir_mean5.4364739345739785
driven_lanedir_median6.2713744420596615
driven_lanedir_min2.79536712360857
get_duckie_state_max1.5772465202543472e-06
get_duckie_state_mean1.4555820079794512e-06
get_duckie_state_median1.4542342224883395e-06
get_duckie_state_min1.336613066686778e-06
get_robot_state_max0.004021543181604809
get_robot_state_mean0.0038656166132833496
get_robot_state_median0.0038480353692886137
get_robot_state_min0.0037448525329513618
get_state_dump_max0.005096544408135944
get_state_dump_mean0.004927187059903517
get_state_dump_median0.004975714155478243
get_state_dump_min0.004660775520521636
get_ui_image_max0.03803673890309965
get_ui_image_mean0.03249879559971243
get_ui_image_median0.03279586790532952
get_ui_image_min0.02636670768509102
in-drivable-lane_max29.49999999999917
in-drivable-lane_mean20.33749999999947
in-drivable-lane_min13.95000000000014
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.348544715571203, "get_ui_image": 0.03059976821537319, "step_physics": 0.1012127431207255, "survival_time": 59.99999999999873, "driven_lanedir": 6.407779730568016, "get_state_dump": 0.005006633531441796, "get_robot_state": 0.003921452410314403, "sim_render-ego0": 0.0040381562203590715, "get_duckie_state": 1.5418793537733855e-06, "in-drivable-lane": 16.649999999999054, "deviation-heading": 7.527892459616273, "agent_compute-ego0": 0.07605301390877374, "complete-iteration": 0.2357307695330033, "set_robot_commands": 0.002337776155495624, "deviation-center-line": 1.6455577889686472, "driven_lanedir_consec": 6.214460363875263, "sim_compute_sim_state": 0.010295049038457434, "sim_compute_performance-ego0": 0.0021692094556695716}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.8630065815842, "get_ui_image": 0.03803673890309965, "step_physics": 0.11356539273639206, "survival_time": 59.99999999999873, "driven_lanedir": 2.79536712360857, "get_state_dump": 0.00494479477951469, "get_robot_state": 0.003774618328262825, "sim_render-ego0": 0.0038818546774782407, "get_duckie_state": 1.336613066686778e-06, "in-drivable-lane": 29.49999999999917, "deviation-heading": 13.680942552647158, "agent_compute-ego0": 0.07797841326977986, "complete-iteration": 0.25832457903719863, "set_robot_commands": 0.00224412033500322, "deviation-center-line": 1.7693675144643255, "driven_lanedir_consec": 2.206476872351655, "sim_compute_sim_state": 0.01178986146785536, "sim_compute_performance-ego0": 0.002016984255089549}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.340507961506484, "get_ui_image": 0.03499196759528584, "step_physics": 0.10829000920057295, "survival_time": 57.54999999999887, "driven_lanedir": 6.152801555612796, "get_state_dump": 0.005096544408135944, "get_robot_state": 0.004021543181604809, "sim_render-ego0": 0.004123791224426693, "get_duckie_state": 1.5772465202543472e-06, "in-drivable-lane": 21.249999999999517, "deviation-heading": 7.115761820173331, "agent_compute-ego0": 0.06415859651234415, "complete-iteration": 0.23734366252190536, "set_robot_commands": 0.0023996498849656847, "deviation-center-line": 1.4754028190865938, "driven_lanedir_consec": 5.689493206404562, "sim_compute_sim_state": 0.011935899861984782, "sim_compute_performance-ego0": 0.002223021868202422}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.846782463129966, "get_ui_image": 0.02636670768509102, "step_physics": 0.08344477400196085, "survival_time": 59.99999999999873, "driven_lanedir": 6.389947328506528, "get_state_dump": 0.004660775520521636, "get_robot_state": 0.0037448525329513618, "sim_render-ego0": 0.003793960804744724, "get_duckie_state": 1.366589091203294e-06, "in-drivable-lane": 13.95000000000014, "deviation-heading": 6.205152661521617, "agent_compute-ego0": 0.067785269017025, "complete-iteration": 0.19986036754865433, "set_robot_commands": 0.00218036430860737, "deviation-center-line": 1.824911212193572, "driven_lanedir_consec": 4.5073818089440465, "sim_compute_sim_state": 0.005798411309768715, "sim_compute_performance-ego0": 0.001996509836277894}}
set_robot_commands_max0.0023996498849656847
set_robot_commands_mean0.0022904776710179747
set_robot_commands_median0.002290948245249422
set_robot_commands_min0.00218036430860737
sim_compute_performance-ego0_max0.002223021868202422
sim_compute_performance-ego0_mean0.0021014313538098594
sim_compute_performance-ego0_median0.0020930968553795606
sim_compute_performance-ego0_min0.001996509836277894
sim_compute_sim_state_max0.011935899861984782
sim_compute_sim_state_mean0.009954805419516571
sim_compute_sim_state_median0.011042455253156397
sim_compute_sim_state_min0.005798411309768715
sim_render-ego0_max0.004123791224426693
sim_render-ego0_mean0.003959440731752182
sim_render-ego0_median0.0039600054489186565
sim_render-ego0_min0.003793960804744724
simulation-passed1
step_physics_max0.11356539273639206
step_physics_mean0.10162822976491284
step_physics_median0.10475137616064924
step_physics_min0.08344477400196085
survival_time_max59.99999999999873
survival_time_mean59.38749999999876
survival_time_min57.54999999999887
No reset possible
584129276Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:03:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
584009286Liam PaullΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:03:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
583849294Yishu MalhotraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:02:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
582389315Jerome LabonteΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:36:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.141291064492529
survival_time_median59.99999999999873
deviation-center-line_median3.4646899476492825
in-drivable-lane_median4.6249999999999005


other stats
agent_compute-ego0_max0.04299204970875151
agent_compute-ego0_mean0.035449628131177205
agent_compute-ego0_median0.042466204926731387
agent_compute-ego0_min0.013874052962494532
complete-iteration_max0.23635767778687236
complete-iteration_mean0.20561771691589925
complete-iteration_median0.19895473030782757
complete-iteration_min0.18820372926106957
deviation-center-line_max3.9936821142594496
deviation-center-line_mean3.5125970022135875
deviation-center-line_min3.1273259992963354
deviation-heading_max19.283312540424134
deviation-heading_mean14.484392580221837
deviation-heading_median13.679018711576042
deviation-heading_min11.296220357311128
driven_any_max11.70773560957308
driven_any_mean10.482914376375016
driven_any_median10.421838640462472
driven_any_min9.380244615002049
driven_lanedir_consec_max7.336132288497249
driven_lanedir_consec_mean5.315312503835923
driven_lanedir_consec_min3.642535597861385
driven_lanedir_max11.151810458263258
driven_lanedir_mean9.331249925617591
driven_lanedir_median9.573707015436147
driven_lanedir_min7.025775213334811
get_duckie_state_max2.2035355770419183e-06
get_duckie_state_mean2.0067062504980382e-06
get_duckie_state_median1.9800057518392876e-06
get_duckie_state_min1.8632779212716615e-06
get_robot_state_max0.003864644469071387
get_robot_state_mean0.0036475016711455
get_robot_state_median0.003619597416734021
get_robot_state_min0.003486167382042573
get_state_dump_max0.004743354505146671
get_state_dump_mean0.004609667589821287
get_state_dump_median0.004629859717859019
get_state_dump_min0.004435596418420441
get_ui_image_max0.03432568840738339
get_ui_image_mean0.030174765608689865
get_ui_image_median0.030144552505582106
get_ui_image_min0.026084269016211872
in-drivable-lane_max13.1999999999995
in-drivable-lane_mean6.1999999999997994
in-drivable-lane_min2.3499999999998984
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.70773560957308, "get_ui_image": 0.02715444425857633, "step_physics": 0.09727749240884773, "survival_time": 59.99999999999873, "driven_lanedir": 11.151810458263258, "get_state_dump": 0.004547727197334232, "get_robot_state": 0.003536217615665941, "sim_render-ego0": 0.003626990774886793, "get_duckie_state": 1.916877435307816e-06, "in-drivable-lane": 2.3499999999998984, "deviation-heading": 11.296220357311128, "agent_compute-ego0": 0.04227301997010853, "complete-iteration": 0.19216135379972307, "set_robot_commands": 0.002143150563045505, "deviation-center-line": 3.1273259992963354, "driven_lanedir_consec": 7.336132288497249, "sim_compute_sim_state": 0.009604085593497524, "sim_compute_performance-ego0": 0.0019057521613610972}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.380244615002049, "get_ui_image": 0.03432568840738339, "step_physics": 0.13225884520938058, "survival_time": 59.99999999999873, "driven_lanedir": 7.025775213334811, "get_state_dump": 0.004435596418420441, "get_robot_state": 0.003486167382042573, "sim_render-ego0": 0.003595767866860421, "get_duckie_state": 1.8632779212716615e-06, "in-drivable-lane": 13.1999999999995, "deviation-heading": 19.283312540424134, "agent_compute-ego0": 0.04265938988335424, "complete-iteration": 0.23635767778687236, "set_robot_commands": 0.002115791385914265, "deviation-center-line": 3.159891835193267, "driven_lanedir_consec": 3.642535597861385, "sim_compute_sim_state": 0.011489468351391134, "sim_compute_performance-ego0": 0.001901129302533838}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.727862762775157, "get_ui_image": 0.03313466075258787, "step_physics": 0.12840398920267249, "survival_time": 59.99999999999873, "driven_lanedir": 8.603382234210972, "get_state_dump": 0.004743354505146671, "get_robot_state": 0.003864644469071387, "sim_render-ego0": 0.003915857415115903, "get_duckie_state": 2.2035355770419183e-06, "in-drivable-lane": 6.499999999999762, "deviation-heading": 15.439891929270482, "agent_compute-ego0": 0.013874052962494532, "complete-iteration": 0.20574810681593209, "set_robot_commands": 0.0023057381378224647, "deviation-center-line": 3.9936821142594496, "driven_lanedir_consec": 5.1091742398889215, "sim_compute_sim_state": 0.013235024865918314, "sim_compute_performance-ego0": 0.0021746307487392506}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.11581451814979, "get_ui_image": 0.026084269016211872, "step_physics": 0.09645477738805258, "survival_time": 59.99999999999873, "driven_lanedir": 10.544031796661324, "get_state_dump": 0.004711992238383806, "get_robot_state": 0.0037029772178021, "sim_render-ego0": 0.0038002589461606905, "get_duckie_state": 2.043134068370759e-06, "in-drivable-lane": 2.750000000000039, "deviation-heading": 11.9181454938816, "agent_compute-ego0": 0.04299204970875151, "complete-iteration": 0.18820372926106957, "set_robot_commands": 0.002277150936269641, "deviation-center-line": 3.7694880601052976, "driven_lanedir_consec": 5.173407889096136, "sim_compute_sim_state": 0.006094370952355276, "sim_compute_performance-ego0": 0.0019935785384102727}}
set_robot_commands_max0.0023057381378224647
set_robot_commands_mean0.002210457755762969
set_robot_commands_median0.002210150749657573
set_robot_commands_min0.002115791385914265
sim_compute_performance-ego0_max0.0021746307487392506
sim_compute_performance-ego0_mean0.0019937726877611145
sim_compute_performance-ego0_median0.0019496653498856848
sim_compute_performance-ego0_min0.001901129302533838
sim_compute_sim_state_max0.013235024865918314
sim_compute_sim_state_mean0.010105737440790564
sim_compute_sim_state_median0.01054677697244433
sim_compute_sim_state_min0.006094370952355276
sim_render-ego0_max0.003915857415115903
sim_render-ego0_mean0.003734718750755951
sim_render-ego0_median0.0037136248605237417
sim_render-ego0_min0.003595767866860421
simulation-passed1
step_physics_max0.13225884520938058
step_physics_mean0.11359877605223836
step_physics_median0.1128407408057601
step_physics_min0.09645477738805258
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5823611010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-020:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5823210933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-020:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5822811010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-020:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5822610933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-020:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5822011012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-020:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
581619354Himanshu AroraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:20:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4803787475750393
survival_time_median21.900000000000176
deviation-center-line_median0.6329685520423263
in-drivable-lane_median13.375000000000156


other stats
agent_compute-ego0_max0.013480470814836134
agent_compute-ego0_mean0.012819731923010674
agent_compute-ego0_median0.012680920460456244
agent_compute-ego0_min0.012436615956294072
complete-iteration_max0.3350163191465792
complete-iteration_mean0.29532191258131535
complete-iteration_median0.3026957896655035
complete-iteration_min0.24087975184767532
deviation-center-line_max0.6959443550502984
deviation-center-line_mean0.5719886646092519
deviation-center-line_min0.3260731993020567
deviation-heading_max5.878141564086586
deviation-heading_mean3.6695622428442936
deviation-heading_median3.586681669102713
deviation-heading_min1.626744069085163
driven_any_max3.0230607461928347
driven_any_mean1.750349376797719
driven_any_median1.4577218484880516
driven_any_min1.0628930640219365
driven_lanedir_consec_max0.6406760173617714
driven_lanedir_consec_mean0.46708330866502346
driven_lanedir_consec_min0.26689972214824387
driven_lanedir_max0.6406760173617714
driven_lanedir_mean0.46708330866502346
driven_lanedir_median0.4803787475750393
driven_lanedir_min0.26689972214824387
get_duckie_state_max1.5775282049275798e-06
get_duckie_state_mean1.4914259550962094e-06
get_duckie_state_median1.4800416348049526e-06
get_duckie_state_min1.4280923458473525e-06
get_robot_state_max0.0038804898568249625
get_robot_state_mean0.0038060697410236383
get_robot_state_median0.003815286658241919
get_robot_state_min0.003713215790785752
get_state_dump_max0.005124766770183301
get_state_dump_mean0.005055939168654657
get_state_dump_median0.005052477723459483
get_state_dump_min0.00499403445751636
get_ui_image_max0.0351069890059434
get_ui_image_mean0.031195591966487496
get_ui_image_median0.03134911938691533
get_ui_image_min0.026977140086175945
in-drivable-lane_max37.7999999999997
in-drivable-lane_mean17.700000000000024
in-drivable-lane_min6.250000000000089
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.0230607461928347, "get_ui_image": 0.028350352434590543, "step_physics": 0.20616023059358995, "survival_time": 44.29999999999962, "driven_lanedir": 0.26689972214824387, "get_state_dump": 0.005124766770183301, "get_robot_state": 0.0038226059351322214, "sim_render-ego0": 0.003920365078742233, "get_duckie_state": 1.4280923458473525e-06, "in-drivable-lane": 37.7999999999997, "deviation-heading": 5.227393545584871, "agent_compute-ego0": 0.01277347051841968, "complete-iteration": 0.27486400620375573, "set_robot_commands": 0.002322761423827024, "deviation-center-line": 0.6959443550502984, "driven_lanedir_consec": 0.26689972214824387, "sim_compute_sim_state": 0.010153836032046002, "sim_compute_performance-ego0": 0.0021368962667437257}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.269042606354128, "get_ui_image": 0.0351069890059434, "step_physics": 0.2554829993805328, "survival_time": 19.200000000000134, "driven_lanedir": 0.3522920386226194, "get_state_dump": 0.00499403445751636, "get_robot_state": 0.003713215790785752, "sim_render-ego0": 0.003913043381331803, "get_duckie_state": 1.4639520025872565e-06, "in-drivable-lane": 11.450000000000095, "deviation-heading": 5.878141564086586, "agent_compute-ego0": 0.012436615956294072, "complete-iteration": 0.3305275731272512, "set_robot_commands": 0.0022197698617910408, "deviation-center-line": 0.6742705330320855, "driven_lanedir_consec": 0.3522920386226194, "sim_compute_sim_state": 0.010469037216979189, "sim_compute_performance-ego0": 0.002092335440895774}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0628930640219365, "get_ui_image": 0.034347886339240116, "step_physics": 0.26008673326684795, "survival_time": 16.300000000000097, "driven_lanedir": 0.6406760173617714, "get_state_dump": 0.005088542944065293, "get_robot_state": 0.0038804898568249625, "sim_render-ego0": 0.004115116341033842, "get_duckie_state": 1.496131267022649e-06, "in-drivable-lane": 6.250000000000089, "deviation-heading": 1.9459697926205544, "agent_compute-ego0": 0.013480470814836134, "complete-iteration": 0.3350163191465792, "set_robot_commands": 0.002432061262451545, "deviation-center-line": 0.3260731993020567, "driven_lanedir_consec": 0.6406760173617714, "sim_compute_sim_state": 0.00929664180183994, "sim_compute_performance-ego0": 0.00218605411891179}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6464010906219757, "get_ui_image": 0.026977140086175945, "step_physics": 0.1787108209505526, "survival_time": 24.600000000000215, "driven_lanedir": 0.6084654565274592, "get_state_dump": 0.005016412502853672, "get_robot_state": 0.003807967381351618, "sim_render-ego0": 0.003919342710328634, "get_duckie_state": 1.5775282049275798e-06, "in-drivable-lane": 15.300000000000216, "deviation-heading": 1.626744069085163, "agent_compute-ego0": 0.01258837040249281, "complete-iteration": 0.24087975184767532, "set_robot_commands": 0.0023208902525369826, "deviation-center-line": 0.5916665710525671, "driven_lanedir_consec": 0.6084654565274592, "sim_compute_sim_state": 0.005341262411152374, "sim_compute_performance-ego0": 0.0020947543409243073}}
set_robot_commands_max0.002432061262451545
set_robot_commands_mean0.002323870700151648
set_robot_commands_median0.002321825838182003
set_robot_commands_min0.0022197698617910408
sim_compute_performance-ego0_max0.00218605411891179
sim_compute_performance-ego0_mean0.002127510041868899
sim_compute_performance-ego0_median0.0021158253038340165
sim_compute_performance-ego0_min0.002092335440895774
sim_compute_sim_state_max0.010469037216979189
sim_compute_sim_state_mean0.008815194365504375
sim_compute_sim_state_median0.00972523891694297
sim_compute_sim_state_min0.005341262411152374
sim_render-ego0_max0.004115116341033842
sim_render-ego0_mean0.003966966877859128
sim_render-ego0_median0.003919853894535433
sim_render-ego0_min0.003913043381331803
simulation-passed1
step_physics_max0.26008673326684795
step_physics_mean0.2251101960478808
step_physics_median0.2308216149870614
step_physics_min0.1787108209505526
survival_time_max44.29999999999962
survival_time_mean26.100000000000016
survival_time_min16.300000000000097
No reset possible