Evaluator 2325

LFv-sim

error

2020-11-30 16:07:17+00:00

2020-11-30 16:08:08+00:00

0:00:51

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 236, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 38, in init
             ||     self.model.load_weights("FrankNet.h5")
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
             ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1266, in load_weights
             ||     hdf5_format.load_weights_from_hdf5_group(f, self.layers)
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/saving/hdf5_format.py", line 682, in load_weights_from_hdf5_group
             ||     raise ValueError('You are trying to load a weight file '
             || ValueError: You are trying to load a weight file containing 20 layers into a model with 10 layers.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 38, in init
             || |     self.model.load_weights("FrankNet.h5")
             || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
             || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
             || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1266, in load_weights
             || |     hdf5_format.load_weights_from_hdf5_group(f, self.layers)
             || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/saving/hdf5_format.py", line 682, in load_weights_from_hdf5_group
             || |     raise ValueError('You are trying to load a weight file '
             || | ValueError: You are trying to load a weight file containing 20 layers into a model with 10 layers.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44093

11780

Kaiyi Chen 🇺🇸

KK Net

LFv-sim

aborted

2020-11-30 15:43:34+00:00

2020-11-30 15:48:14+00:00

0:04:40

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 236, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 305, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego" aborted with the following error:

error in ego |Unexpected error:
             |
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             ||     call_if_fun_exists(node, "init", context=context_data)
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             ||     f(**kwargs)
             ||   File "solution.py", line 38, in init
             ||     self.model.load_weights("FrankNet.h5")
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
             ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1266, in load_weights
             ||     hdf5_format.load_weights_from_hdf5_group(f, self.layers)
             ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/saving/hdf5_format.py", line 682, in load_weights_from_hdf5_group
             ||     raise ValueError('You are trying to load a weight file '
             || ValueError: You are trying to load a weight file containing 20 layers into a model with 10 layers.
             ||
             || The above exception was the direct cause of the following exception:
             ||
             || Traceback (most recent call last):
             ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
             ||     raise Exception(msg) from e
             || Exception: Exception while calling the node's init() function.
             ||
             || | Traceback (most recent call last):
             || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
             || |     call_if_fun_exists(node, "init", context=context_data)
             || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
             || |     f(**kwargs)
             || |   File "solution.py", line 38, in init
             || |     self.model.load_weights("FrankNet.h5")
             || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
             || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
             || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1266, in load_weights
             || |     hdf5_format.load_weights_from_hdf5_group(f, self.layers)
             || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/saving/hdf5_format.py", line 682, in load_weights_from_hdf5_group
             || |     raise ValueError('You are trying to load a weight file '
             || | ValueError: You are trying to load a weight file containing 20 layers into a model with 10 layers.
             || |
             ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44071

11779

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

host-error

2020-11-30 05:25:04+00:00

2020-11-30 05:25:09+00:00

0:00:05

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44069

11779

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

host-error

2020-11-30 05:23:39+00:00

2020-11-30 05:23:44+00:00

0:00:05

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44042

11778

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

host-error

2020-11-30 05:00:48+00:00

2020-11-30 05:00:53+00:00

0:00:05

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

44021

11777

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

host-error

2020-11-30 04:54:19+00:00

2020-11-30 04:54:24+00:00

0:00:05

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43978

11775

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

host-error

2020-11-30 04:22:01+00:00

2020-11-30 04:22:10+00:00

0:00:09

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43935

11772

Ehsan Ahmadi 🇨🇦

template-random

LFv-sim

aborted

2020-11-30 02:37:06+00:00

2020-11-30 02:37:14+00:00

0:00:08

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 937, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43914

11771

Dishank Bansal 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-30 02:24:19+00:00

2020-11-30 02:33:24+00:00

0:09:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.774514237065537
survival_time_median	14.950000000000076
deviation-center-line_median	0.7092767606936028
in-drivable-lane_median	3.700000000000018

other stats

agent_compute-ego_max	0.017801706790924073
agent_compute-ego_mean	0.017310474713643394
agent_compute-ego_median	0.01724838415781657
agent_compute-ego_min	0.016943423748016356
complete-iteration_max	0.2003150486946106
complete-iteration_mean	0.19885613600413005
complete-iteration_median	0.19945620735486347
complete-iteration_min	0.1961970806121826
deviation-center-line_max	0.7785889423906399
deviation-center-line_mean	0.5846166014101224
deviation-center-line_min	0.14132394186264408
deviation-heading_max	4.771759621385458
deviation-heading_mean	3.069472310991596
deviation-heading_median	3.0931723319049897
deviation-heading_min	1.3197849587709465
driven_any_max	4.890756012766928
driven_any_mean	4.449445356245637
driven_any_median	4.339250688881874
driven_any_min	4.228524034451873
driven_lanedir_consec_max	3.3636289038779967
driven_lanedir_consec_mean	2.3406102999171123
driven_lanedir_consec_min	0.4497838216593806
driven_lanedir_max	3.518222877343441
driven_lanedir_mean	2.638962655806848
driven_lanedir_median	3.293921962112285
driven_lanedir_min	0.4497838216593806
get_duckie_state_max	2.6790301005045572e-06
get_duckie_state_mean	2.6132663091023763e-06
get_duckie_state_median	2.6647249857584633e-06
get_duckie_state_min	2.444585164388021e-06
get_robot_state_max	0.015889941056569417
get_robot_state_mean	0.01540117621421814
get_robot_state_median	0.01550197164217631
get_robot_state_min	0.01471082051595052
get_state_dump_max	0.01354242165883382
get_state_dump_mean	0.013385581970214845
get_state_dump_median	0.0133625857035319
get_state_dump_min	0.01327473481496175
get_ui_image_max	0.03457345088322957
get_ui_image_mean	0.034275549054145815
get_ui_image_median	0.034400152762730916
get_ui_image_min	0.03372843980789184
in-drivable-lane_max	12.20000000000008
in-drivable-lane_mean	5.387500000000033
in-drivable-lane_min	1.9500000000000153
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.232309396411718, "get_ui_image": 0.03372843980789184, "step_physics": 0.07719255367914836, "survival_time": 14.950000000000076, "driven_lanedir": 3.3636289038779967, "get_state_dump": 0.013447961807250976, "sim_render-ego": 0.005919946034749349, "get_robot_state": 0.015573875109354656, "get_duckie_state": 2.6750564575195314e-06, "in-drivable-lane": 1.9500000000000153, "agent_compute-ego": 0.016943423748016356, "deviation-heading": 4.771759621385458, "complete-iteration": 0.1961970806121826, "set_robot_commands": 0.004719253381093343, "deviation-center-line": 0.7785889423906399, "driven_lanedir_consec": 3.3636289038779967, "sim_compute_sim_state": 0.02450944185256958, "sim_compute_performance-ego": 0.0040194129943847655}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.228524034451873, "get_ui_image": 0.03457345088322957, "step_physics": 0.07813664197921753, "survival_time": 14.950000000000076, "driven_lanedir": 3.224215020346574, "get_state_dump": 0.01354242165883382, "sim_render-ego": 0.006180700461069743, "get_robot_state": 0.015889941056569417, "get_duckie_state": 2.6543935139973957e-06, "in-drivable-lane": 2.8500000000000085, "agent_compute-ego": 0.017412762641906738, "deviation-heading": 3.8234929045741257, "complete-iteration": 0.19925432443618776, "set_robot_commands": 0.004886097908020019, "deviation-center-line": 0.757630826657201, "driven_lanedir_consec": 3.224215020346574, "sim_compute_sim_state": 0.024323067665100097, "sim_compute_performance-ego": 0.004158473014831543}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.4461919813520305, "get_ui_image": 0.034555555979410804, "step_physics": 0.08018690586090088, "survival_time": 14.950000000000076, "driven_lanedir": 0.4497838216593806, "get_state_dump": 0.01327473481496175, "sim_render-ego": 0.0058884700139363606, "get_robot_state": 0.015430068174997966, "get_duckie_state": 2.6790301005045572e-06, "in-drivable-lane": 12.20000000000008, "agent_compute-ego": 0.017801706790924073, "deviation-heading": 1.3197849587709465, "complete-iteration": 0.2003150486946106, "set_robot_commands": 0.004823378721872966, "deviation-center-line": 0.14132394186264408, "driven_lanedir_consec": 0.4497838216593806, "sim_compute_sim_state": 0.024164992173512777, "sim_compute_performance-ego": 0.00404282013575236}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.890756012766928, "get_ui_image": 0.03424474954605103, "step_physics": 0.07969330549240113, "survival_time": 14.950000000000076, "driven_lanedir": 3.518222877343441, "get_state_dump": 0.013277209599812826, "sim_render-ego": 0.005762714544932048, "get_robot_state": 0.01471082051595052, "get_duckie_state": 2.444585164388021e-06, "in-drivable-lane": 4.550000000000027, "agent_compute-ego": 0.0170840056737264, "deviation-heading": 2.362851759235854, "complete-iteration": 0.19965809027353923, "set_robot_commands": 0.004562482833862304, "deviation-center-line": 0.6609226947300045, "driven_lanedir_consec": 2.3248134537844996, "sim_compute_sim_state": 0.026278900305430095, "sim_compute_performance-ego": 0.0039008156458536784}}
set_robot_commands_max	0.004886097908020019
set_robot_commands_mean	0.004747803211212158
set_robot_commands_median	0.004771316051483154
set_robot_commands_min	0.004562482833862304
sim_compute_performance-ego_max	0.004158473014831543
sim_compute_performance-ego_mean	0.004030380447705587
sim_compute_performance-ego_median	0.004031116565068563
sim_compute_performance-ego_min	0.0039008156458536784
sim_compute_sim_state_max	0.026278900305430095
sim_compute_sim_state_mean	0.02481910049915314
sim_compute_sim_state_median	0.02441625475883484
sim_compute_sim_state_min	0.024164992173512777
sim_render-ego_max	0.006180700461069743
sim_render-ego_mean	0.005937957763671875
sim_render-ego_median	0.005904208024342855
sim_render-ego_min	0.005762714544932048
simulation-passed	1
step_physics_max	0.08018690586090088
step_physics_mean	0.07880235175291697
step_physics_median	0.07891497373580933
step_physics_min	0.07719255367914836
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43873

11767

Olga (Ge Ya) Xu 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-28 18:28:16+00:00

2020-11-28 18:35:52+00:00

0:07:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5459835494403491
survival_time_median	14.950000000000076
deviation-center-line_median	0.1479876367940351
in-drivable-lane_median	11.375000000000073

other stats

agent_compute-ego_max	0.017484110991160075
agent_compute-ego_mean	0.017299426053509565
agent_compute-ego_median	0.017318345814040213
agent_compute-ego_min	0.01707690159479777
complete-iteration_max	0.19551638921101888
complete-iteration_mean	0.18315083649251368
complete-iteration_median	0.18021653731664025
complete-iteration_min	0.17665388212575542
deviation-center-line_max	0.3779386923194432
deviation-center-line_mean	0.19906689813319456
deviation-center-line_min	0.12235362662526478
deviation-heading_max	1.1985755577361723
deviation-heading_mean	0.8490145449357296
deviation-heading_median	0.7738140963270246
deviation-heading_min	0.6498544293526972
driven_any_max	3.326945627878815
driven_any_mean	2.8586042305557617
driven_any_median	3.2544982507340805
driven_any_min	1.59847479287607
driven_lanedir_consec_max	0.8878942706853699
driven_lanedir_consec_mean	0.6056386244576466
driven_lanedir_consec_min	0.44269312826451834
driven_lanedir_max	0.8878942706853699
driven_lanedir_mean	0.6056386244576466
driven_lanedir_median	0.5459835494403491
driven_lanedir_min	0.44269312826451834
get_duckie_state_max	3.409385681152344e-06
get_duckie_state_mean	3.3095956364751375e-06
get_duckie_state_median	3.334975345826252e-06
get_duckie_state_min	3.159046173095703e-06
get_robot_state_max	0.013114317258199056
get_robot_state_mean	0.012872379961467926
get_robot_state_median	0.012960491180419925
get_robot_state_min	0.0124542202268328
get_state_dump_max	0.012892130215962729
get_state_dump_mean	0.012704985247545944
get_state_dump_median	0.012797499895095824
get_state_dump_min	0.012332810984029398
get_ui_image_max	0.033664662837982175
get_ui_image_mean	0.03252607083423829
get_ui_image_median	0.03223982048241091
get_ui_image_min	0.03195997953414917
in-drivable-lane_max	12.40000000000008
in-drivable-lane_mean	9.837500000000052
in-drivable-lane_min	4.199999999999985
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.2490448621050003, "get_ui_image": 0.032199160257975264, "step_physics": 0.06978298107783, "survival_time": 14.950000000000076, "driven_lanedir": 0.45429524499321206, "get_state_dump": 0.012832339604695635, "sim_render-ego": 0.00535872220993042, "get_robot_state": 0.01307175874710083, "get_duckie_state": 3.3243497212727865e-06, "in-drivable-lane": 12.30000000000008, "agent_compute-ego": 0.017484110991160075, "deviation-heading": 0.6498544293526972, "complete-iteration": 0.1815267252922058, "set_robot_commands": 0.00440831184387207, "deviation-center-line": 0.12235362662526478, "driven_lanedir_consec": 0.45429524499321206, "sim_compute_sim_state": 0.02264253775278727, "sim_compute_performance-ego": 0.00361531654993693}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.25995163936316, "get_ui_image": 0.03195997953414917, "step_physics": 0.06904559135437012, "survival_time": 14.950000000000076, "driven_lanedir": 0.8878942706853699, "get_state_dump": 0.012762660185496011, "sim_render-ego": 0.005241842269897461, "get_robot_state": 0.012849223613739014, "get_duckie_state": 3.159046173095703e-06, "in-drivable-lane": 10.450000000000063, "agent_compute-ego": 0.01707690159479777, "deviation-heading": 1.1985755577361723, "complete-iteration": 0.17890634934107463, "set_robot_commands": 0.004371801217397054, "deviation-center-line": 0.3779386923194432, "driven_lanedir_consec": 0.8878942706853699, "sim_compute_sim_state": 0.02193367878595988, "sim_compute_performance-ego": 0.0035352547963460284}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.59847479287607, "get_ui_image": 0.03228048070684656, "step_physics": 0.06846606886232054, "survival_time": 7.699999999999981, "driven_lanedir": 0.637671853887486, "get_state_dump": 0.012332810984029398, "sim_render-ego": 0.00523324136610155, "get_robot_state": 0.0124542202268328, "get_duckie_state": 3.345600970379718e-06, "in-drivable-lane": 4.199999999999985, "agent_compute-ego": 0.0171687819740989, "deviation-heading": 0.8767872944937845, "complete-iteration": 0.17665388212575542, "set_robot_commands": 0.004376533743623015, "deviation-center-line": 0.1425838501092484, "driven_lanedir_consec": 0.637671853887486, "sim_compute_sim_state": 0.020712332292036575, "sim_compute_performance-ego": 0.0035018936380163414}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.326945627878815, "get_ui_image": 0.033664662837982175, "step_physics": 0.07971599419911703, "survival_time": 14.950000000000076, "driven_lanedir": 0.44269312826451834, "get_state_dump": 0.012892130215962729, "sim_render-ego": 0.005255888303120931, "get_robot_state": 0.013114317258199056, "get_duckie_state": 3.409385681152344e-06, "in-drivable-lane": 12.40000000000008, "agent_compute-ego": 0.017467909653981525, "deviation-heading": 0.6708408981602647, "complete-iteration": 0.19551638921101888, "set_robot_commands": 0.004470651149749756, "deviation-center-line": 0.1533914234788218, "driven_lanedir_consec": 0.44269312826451834, "sim_compute_sim_state": 0.025243818759918213, "sim_compute_performance-ego": 0.003560235500335693}}
set_robot_commands_max	0.004470651149749756
set_robot_commands_mean	0.004406824488660474
set_robot_commands_median	0.0043924227937475425
set_robot_commands_min	0.004371801217397054
sim_compute_performance-ego_max	0.00361531654993693
sim_compute_performance-ego_mean	0.0035531751211587484
sim_compute_performance-ego_median	0.003547745148340861
sim_compute_performance-ego_min	0.0035018936380163414
sim_compute_sim_state_max	0.025243818759918213
sim_compute_sim_state_mean	0.022633091897675484
sim_compute_sim_state_median	0.022288108269373573
sim_compute_sim_state_min	0.020712332292036575
sim_render-ego_max	0.00535872220993042
sim_render-ego_mean	0.00527242353726259
sim_render-ego_median	0.005248865286509197
sim_render-ego_min	0.00523324136610155
simulation-passed	1
step_physics_max	0.07971599419911703
step_physics_mean	0.07175265887340943
step_physics_median	0.06941428621610006
step_physics_min	0.06846606886232054
survival_time_max	14.950000000000076
survival_time_mean	13.137500000000053
survival_time_min	7.699999999999981

No reset possible

43861

11764

Ayman Shams 🇨🇦

sim-exercise-1

LFv-sim

success

2020-11-28 07:34:38+00:00

2020-11-28 07:42:40+00:00

0:08:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	14.950000000000076
deviation-center-line_median	0.3071094952840746
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.017789509296417236
agent_compute-ego_mean	0.01749911685784658
agent_compute-ego_median	0.017575013637542724
agent_compute-ego_min	0.017056930859883628
complete-iteration_max	0.1956505258878072
complete-iteration_mean	0.17775405188401538
complete-iteration_median	0.17245645642280577
complete-iteration_min	0.17045276880264282
deviation-center-line_max	0.6863069918481528
deviation-center-line_mean	0.35998819605511767
deviation-center-line_min	0.13942680180416853
deviation-heading_max	3.7258518640401217
deviation-heading_mean	1.6586762301304627
deviation-heading_median	1.2113904039371066
deviation-heading_min	0.486072248607516
driven_any_max	1.3686924727581474e-13
driven_any_mean	6.950391439969185e-14
driven_any_median	7.057320516147632e-14
driven_any_min	0.0
driven_lanedir_consec_max	1.7821788787841797e-05
driven_lanedir_consec_mean	4.455447196960449e-06
driven_lanedir_consec_min	0.0
driven_lanedir_max	1.7821788787841797e-05
driven_lanedir_mean	4.455447196960449e-06
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	2.179145812988282e-06
get_duckie_state_mean	2.0772218704223634e-06
get_duckie_state_median	2.0714600880940753e-06
get_duckie_state_min	1.986821492513021e-06
get_robot_state_max	0.011667457421620687
get_robot_state_mean	0.01150044063727061
get_robot_state_median	0.011505221525828044
get_robot_state_min	0.011323862075805664
get_state_dump_max	0.012123107115427653
get_state_dump_mean	0.011932259798049929
get_state_dump_median	0.011898054281870523
get_state_dump_min	0.011809823513031004
get_ui_image_max	0.034430290857950845
get_ui_image_mean	0.03286819020907084
get_ui_image_median	0.03258963743845622
get_ui_image_min	0.031863195101420085
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.031863195101420085, "step_physics": 0.06652100563049317, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.012123107115427653, "sim_render-ego": 0.005017593701680501, "get_robot_state": 0.011667457421620687, "get_duckie_state": 2.179145812988282e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017703354358673096, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.172480837504069, "set_robot_commands": 0.004602020581563314, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.019480358759562173, "sim_compute_performance-ego": 0.0033707030614217124}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.032875497341156, "step_physics": 0.0656447450319926, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.011809823513031004, "sim_render-ego": 0.005038874944051107, "get_robot_state": 0.011424887975056966, "get_duckie_state": 1.986821492513021e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017056930859883628, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.17045276880264282, "set_robot_commands": 0.004327851931254069, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.018772947788238525, "sim_compute_performance-ego": 0.0033725293477376303}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.03230377753575643, "step_physics": 0.06660847981770833, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.011907007694244383, "sim_render-ego": 0.0050978581110636394, "get_robot_state": 0.011323862075805664, "get_duckie_state": 2.009868621826172e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017789509296417236, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.17243207534154256, "set_robot_commands": 0.004399608771006266, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.019423654079437257, "sim_compute_performance-ego": 0.0034447232882181805}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.034430290857950845, "step_physics": 0.08510395685831705, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.011889100869496664, "sim_render-ego": 0.004984107812245687, "get_robot_state": 0.01158555507659912, "get_duckie_state": 2.1330515543619793e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017446672916412352, "deviation-heading": 0.486072248607516, "complete-iteration": 0.1956505258878072, "set_robot_commands": 0.0045161104202270505, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.022195932070414225, "sim_compute_performance-ego": 0.0033638946215311686}}
set_robot_commands_max	0.004602020581563314
set_robot_commands_mean	0.004461397926012675
set_robot_commands_median	0.004457859595616658
set_robot_commands_min	0.004327851931254069
sim_compute_performance-ego_max	0.0034447232882181805
sim_compute_performance-ego_mean	0.003387962579727173
sim_compute_performance-ego_median	0.0033716162045796714
sim_compute_performance-ego_min	0.0033638946215311686
sim_compute_sim_state_max	0.022195932070414225
sim_compute_sim_state_mean	0.019968223174413047
sim_compute_sim_state_median	0.019452006419499714
sim_compute_sim_state_min	0.018772947788238525
sim_render-ego_max	0.0050978581110636394
sim_render-ego_mean	0.005034608642260234
sim_render-ego_median	0.005028234322865804
sim_render-ego_min	0.004984107812245687
simulation-passed	1
step_physics_max	0.08510395685831705
step_physics_mean	0.07096954683462779
step_physics_median	0.06656474272410075
step_physics_min	0.0656447450319926
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43841

11758

Ayman Shams 🇨🇦

exercise_state_estimation

LFv-sim

success

2020-11-27 20:55:11+00:00

2020-11-27 21:01:43+00:00

0:06:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7910198591033284
survival_time_median	13.100000000000051
deviation-center-line_median	0.3563495327788391
in-drivable-lane_median	2.700000000000019

other stats

agent_compute-ego_max	0.017429278447077826
agent_compute-ego_mean	0.01703987214809809
agent_compute-ego_median	0.017234031756718955
agent_compute-ego_min	0.01626214663187663
complete-iteration_max	0.18514183759689332
complete-iteration_mean	0.17339034771562642
complete-iteration_median	0.16994074786320712
complete-iteration_min	0.16853805753919812
deviation-center-line_max	0.7218813793379725
deviation-center-line_mean	0.4028548253134531
deviation-center-line_min	0.17683885635816174
deviation-heading_max	1.136456556669024
deviation-heading_mean	0.9713029858291846
deviation-heading_median	0.9680552615119368
deviation-heading_min	0.812644863623841
driven_any_max	1.9399996330380092
driven_any_mean	1.491966729081306
driven_any_median	1.6912084474456837
driven_any_min	0.6454503883958473
driven_lanedir_consec_max	1.9186847490066188
driven_lanedir_consec_mean	0.9784806586975732
driven_lanedir_consec_min	0.4131981675770175
driven_lanedir_max	1.9186847490066188
driven_lanedir_mean	0.9784806586975732
driven_lanedir_median	0.7910198591033284
driven_lanedir_min	0.4131981675770175
get_duckie_state_max	2.0652347140842015e-06
get_duckie_state_mean	1.989758422232082e-06
get_duckie_state_median	1.9987882711948495e-06
get_duckie_state_min	1.896222432454427e-06
get_robot_state_max	0.011838232095424946
get_robot_state_mean	0.011484795531146546
get_robot_state_median	0.01141700479719374
get_robot_state_min	0.011266940434773763
get_state_dump_max	0.0119685003390679
get_state_dump_mean	0.0118251797862542
get_state_dump_median	0.011860256592432658
get_state_dump_min	0.011611705621083575
get_ui_image_max	0.03288079818089803
get_ui_image_mean	0.03162454196530529
get_ui_image_median	0.03135721435913673
get_ui_image_min	0.030902940962049697
in-drivable-lane_max	9.500000000000089
in-drivable-lane_mean	3.725000000000032
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4424172618533695, "get_ui_image": 0.030902940962049697, "step_physics": 0.06468422677781847, "survival_time": 11.250000000000025, "driven_lanedir": 0.9389674539410052, "get_state_dump": 0.011841360727945964, "sim_render-ego": 0.004883871078491211, "get_robot_state": 0.011528855429755316, "get_duckie_state": 2.0652347140842015e-06, "in-drivable-lane": 3.750000000000043, "agent_compute-ego": 0.01626214663187663, "deviation-heading": 0.812644863623841, "complete-iteration": 0.16853805753919812, "set_robot_commands": 0.0045275327894422745, "deviation-center-line": 0.7218813793379725, "driven_lanedir_consec": 0.9389674539410052, "sim_compute_sim_state": 0.020415699217054575, "sim_compute_performance-ego": 0.003366381327311198}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.6454503883958473, "get_ui_image": 0.03097194891709548, "step_physics": 0.06546418254192059, "survival_time": 5.1999999999999895, "driven_lanedir": 0.4131981675770175, "get_state_dump": 0.0119685003390679, "sim_render-ego": 0.005058595767387977, "get_robot_state": 0.011838232095424946, "get_duckie_state": 1.9646607912503755e-06, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.017429278447077826, "deviation-heading": 0.8847340546717286, "complete-iteration": 0.16953116426101095, "set_robot_commands": 0.004534934575741108, "deviation-center-line": 0.3183349243700995, "driven_lanedir_consec": 0.4131981675770175, "sim_compute_sim_state": 0.018692316917272713, "sim_compute_performance-ego": 0.0034504257715665377}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.9399996330380092, "get_ui_image": 0.031742479801177975, "step_physics": 0.06581889073053995, "survival_time": 14.950000000000076, "driven_lanedir": 0.6430722642656514, "get_state_dump": 0.011611705621083575, "sim_render-ego": 0.005008368492126465, "get_robot_state": 0.011305154164632162, "get_duckie_state": 2.032915751139323e-06, "in-drivable-lane": 9.500000000000089, "agent_compute-ego": 0.01719841957092285, "deviation-heading": 1.0513764683521452, "complete-iteration": 0.17035033146540324, "set_robot_commands": 0.004470698833465576, "deviation-center-line": 0.17683885635816174, "driven_lanedir_consec": 0.6430722642656514, "sim_compute_sim_state": 0.019698569774627684, "sim_compute_performance-ego": 0.0033712315559387205}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.939999633037998, "get_ui_image": 0.03288079818089803, "step_physics": 0.07654181162516276, "survival_time": 14.950000000000076, "driven_lanedir": 1.9186847490066188, "get_state_dump": 0.011879152456919352, "sim_render-ego": 0.004823207855224609, "get_robot_state": 0.011266940434773763, "get_duckie_state": 1.896222432454427e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017269643942515057, "deviation-heading": 1.136456556669024, "complete-iteration": 0.18514183759689332, "set_robot_commands": 0.004444005489349365, "deviation-center-line": 0.3943641411875786, "driven_lanedir_consec": 1.9186847490066188, "sim_compute_sim_state": 0.02269898573557536, "sim_compute_performance-ego": 0.0032197880744934083}}
set_robot_commands_max	0.004534934575741108
set_robot_commands_mean	0.00449429292199958
set_robot_commands_median	0.0044991158114539255
set_robot_commands_min	0.004444005489349365
sim_compute_performance-ego_max	0.0034504257715665377
sim_compute_performance-ego_mean	0.003351956682327466
sim_compute_performance-ego_median	0.003368806441624959
sim_compute_performance-ego_min	0.0032197880744934083
sim_compute_sim_state_max	0.02269898573557536
sim_compute_sim_state_mean	0.020376392911132583
sim_compute_sim_state_median	0.02005713449584113
sim_compute_sim_state_min	0.018692316917272713
sim_render-ego_max	0.005058595767387977
sim_render-ego_mean	0.004943510798307565
sim_render-ego_median	0.004946119785308838
sim_render-ego_min	0.004823207855224609
simulation-passed	1
step_physics_max	0.07654181162516276
step_physics_mean	0.06812727791886045
step_physics_median	0.06564153663623026
step_physics_min	0.06468422677781847
survival_time_max	14.950000000000076
survival_time_mean	11.58750000000004
survival_time_min	5.1999999999999895

No reset possible

43770

11737

Jean-Sébastien Grondin 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 20:53:34+00:00

2020-11-26 21:02:36+00:00

0:09:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.1410883330094386
survival_time_median	14.950000000000076
deviation-center-line_median	0.5497770543486621
in-drivable-lane_median	6.650000000000045

other stats

agent_compute-ego_max	0.017905802726745607
agent_compute-ego_mean	0.01725728233655294
agent_compute-ego_median	0.01717681447664897
agent_compute-ego_min	0.016769697666168214
complete-iteration_max	0.20994922161102297
complete-iteration_mean	0.20220217605431876
complete-iteration_median	0.2016913366317749
complete-iteration_min	0.19547680934270223
deviation-center-line_max	0.7163789440481458
deviation-center-line_mean	0.5498563452326436
deviation-center-line_min	0.3834923281851043
deviation-heading_max	3.2477506425986187
deviation-heading_mean	2.74521591460185
deviation-heading_median	2.7028634410317967
deviation-heading_min	2.327386133745188
driven_any_max	4.223275525744043
driven_any_mean	3.730202279978048
driven_any_median	3.865365831929388
driven_any_min	2.9668019303093747
driven_lanedir_consec_max	3.342474575443865
driven_lanedir_consec_mean	2.175856032974026
driven_lanedir_consec_min	1.0787728904333624
driven_lanedir_max	3.342474575443865
driven_lanedir_mean	2.175856032974026
driven_lanedir_median	2.1410883330094386
driven_lanedir_min	1.0787728904333624
get_duckie_state_max	2.6075045267740887e-06
get_duckie_state_mean	2.4843215942382812e-06
get_duckie_state_median	2.4795532226562497e-06
get_duckie_state_min	2.3706754048665365e-06
get_robot_state_max	0.0158035413424174
get_robot_state_mean	0.015310653845469155
get_robot_state_median	0.015271743535995483
get_robot_state_min	0.014895586967468262
get_state_dump_max	0.01343056360880534
get_state_dump_mean	0.013272671699523926
get_state_dump_median	0.01328278422355652
get_state_dump_min	0.013094554742177328
get_ui_image_max	0.03692755619684855
get_ui_image_mean	0.035440097848574326
get_ui_image_median	0.03571936130523681
get_ui_image_min	0.0333941125869751
in-drivable-lane_max	9.450000000000038
in-drivable-lane_mean	6.6375000000000375
in-drivable-lane_min	3.800000000000022
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.664189736416194, "get_ui_image": 0.0333941125869751, "step_physics": 0.0779781953493754, "survival_time": 14.950000000000076, "driven_lanedir": 1.807128268487678, "get_state_dump": 0.013216018676757812, "sim_render-ego": 0.005799134572347005, "get_robot_state": 0.014895586967468262, "get_duckie_state": 2.4890899658203124e-06, "in-drivable-lane": 7.800000000000054, "agent_compute-ego": 0.017335100968678793, "deviation-heading": 2.327386133745188, "complete-iteration": 0.19547680934270223, "set_robot_commands": 0.004767212073008219, "deviation-center-line": 0.4496469906251841, "driven_lanedir_consec": 1.807128268487678, "sim_compute_sim_state": 0.02405663013458252, "sim_compute_performance-ego": 0.003885346253712972}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.066541927442581, "get_ui_image": 0.03504210313161214, "step_physics": 0.07796825329462687, "survival_time": 14.950000000000076, "driven_lanedir": 3.342474575443865, "get_state_dump": 0.01343056360880534, "sim_render-ego": 0.006027814547220866, "get_robot_state": 0.015513129234313965, "get_duckie_state": 2.4700164794921874e-06, "in-drivable-lane": 3.800000000000022, "agent_compute-ego": 0.017018527984619142, "deviation-heading": 2.4986455414724844, "complete-iteration": 0.19806981563568116, "set_robot_commands": 0.00478842814763387, "deviation-center-line": 0.6499071180721401, "driven_lanedir_consec": 3.342474575443865, "sim_compute_sim_state": 0.024108877976735433, "sim_compute_performance-ego": 0.004012338320414225}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.9668019303093747, "get_ui_image": 0.03639661947886149, "step_physics": 0.08658737500508626, "survival_time": 14.950000000000076, "driven_lanedir": 1.0787728904333624, "get_state_dump": 0.013349549770355225, "sim_render-ego": 0.006265199184417725, "get_robot_state": 0.0158035413424174, "get_duckie_state": 2.6075045267740887e-06, "in-drivable-lane": 9.450000000000038, "agent_compute-ego": 0.017905802726745607, "deviation-heading": 2.907081340591109, "complete-iteration": 0.20994922161102297, "set_robot_commands": 0.004815436204274495, "deviation-center-line": 0.3834923281851043, "driven_lanedir_consec": 1.0787728904333624, "sim_compute_sim_state": 0.02449947198232015, "sim_compute_performance-ego": 0.004160331885019938}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.223275525744043, "get_ui_image": 0.03692755619684855, "step_physics": 0.08182274103164673, "survival_time": 14.950000000000076, "driven_lanedir": 2.4750483975311997, "get_state_dump": 0.013094554742177328, "sim_render-ego": 0.0057383712132771806, "get_robot_state": 0.015030357837677002, "get_duckie_state": 2.3706754048665365e-06, "in-drivable-lane": 5.5000000000000355, "agent_compute-ego": 0.016769697666168214, "deviation-heading": 3.2477506425986187, "complete-iteration": 0.20531285762786863, "set_robot_commands": 0.004742248853047689, "deviation-center-line": 0.7163789440481458, "driven_lanedir_consec": 2.4750483975311997, "sim_compute_sim_state": 0.027110241254170737, "sim_compute_performance-ego": 0.00392326831817627}}
set_robot_commands_max	0.004815436204274495
set_robot_commands_mean	0.004778331319491068
set_robot_commands_median	0.004777820110321044
set_robot_commands_min	0.004742248853047689
sim_compute_performance-ego_max	0.004160331885019938
sim_compute_performance-ego_mean	0.003995321194330851
sim_compute_performance-ego_median	0.003967803319295247
sim_compute_performance-ego_min	0.003885346253712972
sim_compute_sim_state_max	0.027110241254170737
sim_compute_sim_state_mean	0.02494380533695221
sim_compute_sim_state_median	0.02430417497952779
sim_compute_sim_state_min	0.02405663013458252
sim_render-ego_max	0.006265199184417725
sim_render-ego_mean	0.005957629879315694
sim_render-ego_median	0.0059134745597839355
sim_render-ego_min	0.0057383712132771806
simulation-passed	1
step_physics_max	0.08658737500508626
step_physics_mean	0.08108914117018381
step_physics_median	0.07990046819051107
step_physics_min	0.07796825329462687
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43759

11732

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 20:42:35+00:00

2020-11-26 20:51:42+00:00

0:09:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.824555793864457
survival_time_median	14.950000000000076
deviation-center-line_median	0.6489566349685476
in-drivable-lane_median	3.100000000000036

other stats

agent_compute-ego_max	0.017778686682383218
agent_compute-ego_mean	0.017249869027881757
agent_compute-ego_median	0.017307708500124884
agent_compute-ego_min	0.016605372428894042
complete-iteration_max	0.21952980038122083
complete-iteration_mean	0.20218038915742373
complete-iteration_median	0.20086092551549276
complete-iteration_min	0.1874699052174886
deviation-center-line_max	0.7525698385263025
deviation-center-line_mean	0.6408941843375936
deviation-center-line_min	0.5130936288869767
deviation-heading_max	2.9608047593676803
deviation-heading_mean	2.08757863309469
deviation-heading_median	1.9932319152064952
deviation-heading_min	1.40304594259809
driven_any_max	3.817153624781104
driven_any_mean	3.2169763257934214
driven_any_median	3.3201774396521673
driven_any_min	2.4103967990882476
driven_lanedir_consec_max	3.775553982304798
driven_lanedir_consec_mean	2.7650191876372485
driven_lanedir_consec_min	1.6354111805152838
driven_lanedir_max	3.775553982304798
driven_lanedir_mean	2.7650191876372485
driven_lanedir_median	2.824555793864457
driven_lanedir_min	1.6354111805152838
get_duckie_state_max	3.818079089442043e-06
get_duckie_state_mean	3.6071251470146448e-06
get_duckie_state_median	3.6879380544026698e-06
get_duckie_state_min	3.234545389811198e-06
get_robot_state_max	0.0174997571512317
get_robot_state_mean	0.015685016597416383
get_robot_state_median	0.015513171354929606
get_robot_state_min	0.014213966528574625
get_state_dump_max	0.01347152551015218
get_state_dump_mean	0.013359367521942084
get_state_dump_median	0.01336413358120208
get_state_dump_min	0.013237677415211997
get_ui_image_max	0.03630553999691145
get_ui_image_mean	0.0346969162403269
get_ui_image_median	0.03477329572041829
get_ui_image_min	0.032935533523559574
in-drivable-lane_max	6.800000000000097
in-drivable-lane_mean	3.250000000000042
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.646092986058739, "get_ui_image": 0.032935533523559574, "step_physics": 0.07288167158762614, "survival_time": 14.950000000000076, "driven_lanedir": 3.4314019058792615, "get_state_dump": 0.013237677415211997, "sim_render-ego": 0.00555802583694458, "get_robot_state": 0.014213966528574625, "get_duckie_state": 3.234545389811198e-06, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.016605372428894042, "deviation-heading": 2.9608047593676803, "complete-iteration": 0.1874699052174886, "set_robot_commands": 0.004560659726460775, "deviation-center-line": 0.7414490413587066, "driven_lanedir_consec": 3.4314019058792615, "sim_compute_sim_state": 0.023606112798055013, "sim_compute_performance-ego": 0.003732592264811198}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.817153624781104, "get_ui_image": 0.03343394120534261, "step_physics": 0.07558360497156778, "survival_time": 14.950000000000076, "driven_lanedir": 3.775553982304798, "get_state_dump": 0.01328162670135498, "sim_render-ego": 0.005820837020874024, "get_robot_state": 0.015269211133321126, "get_duckie_state": 3.669261932373047e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016952473322550454, "deviation-heading": 1.9584943766355092, "complete-iteration": 0.1926033059755961, "set_robot_commands": 0.00472420612970988, "deviation-center-line": 0.7525698385263025, "driven_lanedir_consec": 3.775553982304798, "sim_compute_sim_state": 0.023383572101593017, "sim_compute_performance-ego": 0.004007064501444499}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.4103967990882476, "get_ui_image": 0.036112650235493975, "step_physics": 0.08609126806259156, "survival_time": 14.950000000000076, "driven_lanedir": 1.6354111805152838, "get_state_dump": 0.01347152551015218, "sim_render-ego": 0.006150094668070475, "get_robot_state": 0.015757131576538085, "get_duckie_state": 3.706614176432292e-06, "in-drivable-lane": 6.800000000000097, "agent_compute-ego": 0.017778686682383218, "deviation-heading": 1.40304594259809, "complete-iteration": 0.2091185450553894, "set_robot_commands": 0.004952855904897054, "deviation-center-line": 0.5564642285783886, "driven_lanedir_consec": 1.6354111805152838, "sim_compute_sim_state": 0.02453514337539673, "sim_compute_performance-ego": 0.004114996592203776}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.9942618932455956, "get_ui_image": 0.03630553999691145, "step_physics": 0.09061078822359124, "survival_time": 14.100000000000064, "driven_lanedir": 2.217709681849652, "get_state_dump": 0.01344664046104918, "sim_render-ego": 0.006218150152382276, "get_robot_state": 0.0174997571512317, "get_duckie_state": 3.818079089442043e-06, "in-drivable-lane": 5.4500000000000615, "agent_compute-ego": 0.017662943677699314, "deviation-heading": 2.0279694537774815, "complete-iteration": 0.21952980038122083, "set_robot_commands": 0.004897464251687341, "deviation-center-line": 0.5130936288869767, "driven_lanedir_consec": 2.217709681849652, "sim_compute_sim_state": 0.02846447288567293, "sim_compute_performance-ego": 0.004267555602053379}}
set_robot_commands_max	0.004952855904897054
set_robot_commands_mean	0.004783796503188762
set_robot_commands_median	0.004810835190698611
set_robot_commands_min	0.004560659726460775
sim_compute_performance-ego_max	0.004267555602053379
sim_compute_performance-ego_mean	0.004030552240128213
sim_compute_performance-ego_median	0.004061030546824137
sim_compute_performance-ego_min	0.003732592264811198
sim_compute_sim_state_max	0.02846447288567293
sim_compute_sim_state_mean	0.02499732529017942
sim_compute_sim_state_median	0.024070628086725873
sim_compute_sim_state_min	0.023383572101593017
sim_render-ego_max	0.006218150152382276
sim_render-ego_mean	0.005936776919567839
sim_render-ego_median	0.00598546584447225
sim_render-ego_min	0.00555802583694458
simulation-passed	1
step_physics_max	0.09061078822359124
step_physics_mean	0.08129183321134419
step_physics_median	0.08083743651707967
step_physics_min	0.07288167158762614
survival_time_max	14.950000000000076
survival_time_mean	14.737500000000075
survival_time_min	14.100000000000064

No reset possible

43748

11729

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 20:29:00+00:00

2020-11-26 20:36:29+00:00

0:07:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.549871287391891
survival_time_median	14.950000000000076
deviation-center-line_median	0.5949091511162514
in-drivable-lane_median	1.249999999999999

other stats

agent_compute-ego_max	0.01655782381693522
agent_compute-ego_mean	0.01626446933102754
agent_compute-ego_median	0.016191527048746743
agent_compute-ego_min	0.01611699940968145
complete-iteration_max	0.1873905467987061
complete-iteration_mean	0.17722443073439453
complete-iteration_median	0.17577078700065613
complete-iteration_min	0.16996560213755976
deviation-center-line_max	0.862063609102541
deviation-center-line_mean	0.5909879675722571
deviation-center-line_min	0.31206995895398487
deviation-heading_max	2.614848056452064
deviation-heading_mean	2.0810014302931217
deviation-heading_median	1.973211950453136
deviation-heading_min	1.7627337638141511
driven_any_max	3.843401837735047
driven_any_mean	2.915266823104456
driven_any_median	2.9947919760498793
driven_any_min	1.8280815025830188
driven_lanedir_consec_max	3.6076922316861766
driven_lanedir_consec_mean	2.5853470122707427
driven_lanedir_consec_min	1.633953242613012
driven_lanedir_max	3.6076922316861766
driven_lanedir_mean	2.5853470122707427
driven_lanedir_median	2.549871287391891
driven_lanedir_min	1.633953242613012
get_duckie_state_max	2.2943814595540364e-06
get_duckie_state_mean	2.233138601228991e-06
get_duckie_state_median	2.2542476654052735e-06
get_duckie_state_min	2.1296776145513804e-06
get_robot_state_max	0.01234211285909017
get_robot_state_mean	0.011742709825131549
get_robot_state_median	0.011561358669784172
get_robot_state_min	0.011506009101867677
get_state_dump_max	0.012143108050028485
get_state_dump_mean	0.011918331782023112
get_state_dump_median	0.011895363330841064
get_state_dump_min	0.011739492416381836
get_ui_image_max	0.03314349492390951
get_ui_image_mean	0.03203932162442821
get_ui_image_median	0.0319387944539388
get_ui_image_min	0.031136202665925757
in-drivable-lane_max	6.150000000000087
in-drivable-lane_mean	2.3500000000000236
in-drivable-lane_min	0.7500000000000107
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.6568935636799473, "get_ui_image": 0.031596184571584064, "step_physics": 0.06728535334269206, "survival_time": 14.950000000000076, "driven_lanedir": 3.3973839153053578, "get_state_dump": 0.01189603885014852, "sim_render-ego": 0.005017528533935547, "get_robot_state": 0.0115226149559021, "get_duckie_state": 2.2943814595540364e-06, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.01621607700983683, "deviation-heading": 2.614848056452064, "complete-iteration": 0.1734510318438212, "set_robot_commands": 0.004524188836415609, "deviation-center-line": 0.862063609102541, "driven_lanedir_consec": 3.3973839153053578, "sim_compute_sim_state": 0.02183765490849813, "sim_compute_performance-ego": 0.003424632549285889}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.8280815025830188, "get_ui_image": 0.031136202665925757, "step_physics": 0.06578490485442928, "survival_time": 8.14999999999998, "driven_lanedir": 1.7023586594784246, "get_state_dump": 0.011739492416381836, "sim_render-ego": 0.005083299121973705, "get_robot_state": 0.011600102383666244, "get_duckie_state": 2.1296776145513804e-06, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.01611699940968145, "deviation-heading": 1.7627337638141511, "complete-iteration": 0.16996560213755976, "set_robot_commands": 0.0045704724598515985, "deviation-center-line": 0.31206995895398487, "driven_lanedir_consec": 1.7023586594784246, "sim_compute_sim_state": 0.020388968883116552, "sim_compute_performance-ego": 0.0034166128357495267}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.3326903884198114, "get_ui_image": 0.03228140433629354, "step_physics": 0.07151419878005981, "survival_time": 14.950000000000076, "driven_lanedir": 1.633953242613012, "get_state_dump": 0.01189468781153361, "sim_render-ego": 0.005009759267171224, "get_robot_state": 0.011506009101867677, "get_duckie_state": 2.262592315673828e-06, "in-drivable-lane": 6.150000000000087, "agent_compute-ego": 0.01655782381693522, "deviation-heading": 2.0474287713152672, "complete-iteration": 0.17809054215749104, "set_robot_commands": 0.00449195384979248, "deviation-center-line": 0.5071215253525005, "driven_lanedir_consec": 1.633953242613012, "sim_compute_sim_state": 0.021322194735209143, "sim_compute_performance-ego": 0.00338267723719279}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.843401837735047, "get_ui_image": 0.03314349492390951, "step_physics": 0.07559284845987956, "survival_time": 14.950000000000076, "driven_lanedir": 3.6076922316861766, "get_state_dump": 0.012143108050028485, "sim_render-ego": 0.005142361323038737, "get_robot_state": 0.01234211285909017, "get_duckie_state": 2.2459030151367187e-06, "in-drivable-lane": 1.4999999999999991, "agent_compute-ego": 0.016166977087656655, "deviation-heading": 1.8989951295910048, "complete-iteration": 0.1873905467987061, "set_robot_commands": 0.004400604565938313, "deviation-center-line": 0.6826967768800022, "driven_lanedir_consec": 3.6076922316861766, "sim_compute_sim_state": 0.02486239910125733, "sim_compute_performance-ego": 0.003462061882019043}}
set_robot_commands_max	0.0045704724598515985
set_robot_commands_mean	0.0044968049279995
set_robot_commands_median	0.004508071343104044
set_robot_commands_min	0.004400604565938313
sim_compute_performance-ego_max	0.003462061882019043
sim_compute_performance-ego_mean	0.0034214961260618125
sim_compute_performance-ego_median	0.003420622692517708
sim_compute_performance-ego_min	0.00338267723719279
sim_compute_sim_state_max	0.02486239910125733
sim_compute_sim_state_mean	0.02210280440702029
sim_compute_sim_state_median	0.02157992482185364
sim_compute_sim_state_min	0.020388968883116552
sim_render-ego_max	0.005142361323038737
sim_render-ego_mean	0.005063237061529803
sim_render-ego_median	0.005050413827954626
sim_render-ego_min	0.005009759267171224
simulation-passed	1
step_physics_max	0.07559284845987956
step_physics_mean	0.07004432635926518
step_physics_median	0.06939977606137593
step_physics_min	0.06578490485442928
survival_time_max	14.950000000000076
survival_time_mean	13.250000000000052
survival_time_min	8.14999999999998

No reset possible

43743

11728

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 20:16:19+00:00

2020-11-26 20:25:03+00:00

0:08:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.0722139406137607
survival_time_median	14.950000000000076
deviation-center-line_median	0.667539452446097
in-drivable-lane_median	4.3250000000000615

other stats

agent_compute-ego_max	0.0174968155225118
agent_compute-ego_mean	0.017282151079725944
agent_compute-ego_median	0.017222336325152167
agent_compute-ego_min	0.017187116146087648
complete-iteration_max	0.2006201275463762
complete-iteration_mean	0.1943298912116851
complete-iteration_median	0.19467581947644552
complete-iteration_min	0.18734779834747312
deviation-center-line_max	0.8793605030798627
deviation-center-line_mean	0.6052129306604274
deviation-center-line_min	0.20641231466965287
deviation-heading_max	2.298338292763523
deviation-heading_mean	1.7604833109830451
deviation-heading_median	1.9752005966801545
deviation-heading_min	0.7931937578083489
driven_any_max	3.4286073370081183
driven_any_mean	2.7389751857005824
driven_any_median	2.6411510749372207
driven_any_min	2.2449912559197696
driven_lanedir_consec_max	3.3663263653040523
driven_lanedir_consec_mean	2.230036640096078
driven_lanedir_consec_min	1.409392313852738
driven_lanedir_max	3.3663263653040523
driven_lanedir_mean	2.230036640096078
driven_lanedir_median	2.0722139406137607
driven_lanedir_min	1.409392313852738
get_duckie_state_max	2.647240956624349e-06
get_duckie_state_mean	2.5731804727137774e-06
get_duckie_state_median	2.580086390177409e-06
get_duckie_state_min	2.485308153875943e-06
get_robot_state_max	0.015072279140867036
get_robot_state_mean	0.014506819686670412
get_robot_state_median	0.014605118036270142
get_robot_state_min	0.013744763533274333
get_state_dump_max	0.013206286430358889
get_state_dump_mean	0.013068086141827464
get_state_dump_median	0.013065470059712729
get_state_dump_min	0.012935118017525508
get_ui_image_max	0.03404694557189941
get_ui_image_mean	0.033754742207198304
get_ui_image_median	0.033875087622938484
get_ui_image_min	0.033221848011016845
in-drivable-lane_max	9.30000000000009
in-drivable-lane_mean	4.487500000000053
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.319676830254114, "get_ui_image": 0.033744096755981445, "step_physics": 0.07595174392064412, "survival_time": 14.950000000000076, "driven_lanedir": 1.409392313852738, "get_state_dump": 0.013159873485565186, "sim_render-ego": 0.005719983577728271, "get_robot_state": 0.014568103154500326, "get_duckie_state": 2.5510787963867186e-06, "in-drivable-lane": 9.30000000000009, "agent_compute-ego": 0.0174968155225118, "deviation-heading": 0.7931937578083489, "complete-iteration": 0.19306587060292563, "set_robot_commands": 0.00478186845779419, "deviation-center-line": 0.20641231466965287, "driven_lanedir_consec": 1.409392313852738, "sim_compute_sim_state": 0.023622398376464845, "sim_compute_performance-ego": 0.003885335127512614}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.4286073370081183, "get_ui_image": 0.033221848011016845, "step_physics": 0.07317566633224487, "survival_time": 14.950000000000076, "driven_lanedir": 3.3663263653040523, "get_state_dump": 0.01297106663386027, "sim_render-ego": 0.0056623339653015135, "get_robot_state": 0.013744763533274333, "get_duckie_state": 2.647240956624349e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017187116146087648, "deviation-heading": 2.298338292763523, "complete-iteration": 0.18734779834747312, "set_robot_commands": 0.004538562297821045, "deviation-center-line": 0.7866113012806697, "driven_lanedir_consec": 3.3663263653040523, "sim_compute_sim_state": 0.022913918495178223, "sim_compute_performance-ego": 0.0037935932477315263}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.2449912559197696, "get_ui_image": 0.03404694557189941, "step_physics": 0.07942168633143107, "survival_time": 14.950000000000076, "driven_lanedir": 1.6428936794906086, "get_state_dump": 0.013206286430358889, "sim_render-ego": 0.005821982224782308, "get_robot_state": 0.014642132918039955, "get_duckie_state": 2.609093983968099e-06, "in-drivable-lane": 5.65000000000008, "agent_compute-ego": 0.017230219841003418, "deviation-heading": 1.7740746174969304, "complete-iteration": 0.19628576834996544, "set_robot_commands": 0.004680663744608561, "deviation-center-line": 0.5484676036115244, "driven_lanedir_consec": 1.6428936794906086, "sim_compute_sim_state": 0.02321205059687297, "sim_compute_performance-ego": 0.003886760075887045}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.962625319620327, "get_ui_image": 0.03400607848989552, "step_physics": 0.08100264483484729, "survival_time": 14.500000000000073, "driven_lanedir": 2.501534201736913, "get_state_dump": 0.012935118017525508, "sim_render-ego": 0.005608374496986126, "get_robot_state": 0.015072279140867036, "get_duckie_state": 2.485308153875943e-06, "in-drivable-lane": 3.000000000000042, "agent_compute-ego": 0.017214452809300916, "deviation-heading": 2.1763265758633783, "complete-iteration": 0.2006201275463762, "set_robot_commands": 0.004791451322621313, "deviation-center-line": 0.8793605030798627, "driven_lanedir_consec": 2.501534201736913, "sim_compute_sim_state": 0.026040868101448848, "sim_compute_performance-ego": 0.0038136679550697062}}
set_robot_commands_max	0.004791451322621313
set_robot_commands_mean	0.004698136455711277
set_robot_commands_median	0.004731266101201375
set_robot_commands_min	0.004538562297821045
sim_compute_performance-ego_max	0.003886760075887045
sim_compute_performance-ego_mean	0.003844839101550223
sim_compute_performance-ego_median	0.00384950154129116
sim_compute_performance-ego_min	0.0037935932477315263
sim_compute_sim_state_max	0.026040868101448848
sim_compute_sim_state_mean	0.02394730889249122
sim_compute_sim_state_median	0.023417224486668907
sim_compute_sim_state_min	0.022913918495178223
sim_render-ego_max	0.005821982224782308
sim_render-ego_mean	0.005703168566199554
sim_render-ego_median	0.005691158771514892
sim_render-ego_min	0.005608374496986126
simulation-passed	1
step_physics_max	0.08100264483484729
step_physics_mean	0.07738793535479184
step_physics_median	0.07768671512603759
step_physics_min	0.07317566633224487
survival_time_max	14.950000000000076
survival_time_mean	14.837500000000077
survival_time_min	14.500000000000073

No reset possible

43707

11715

Jean-Sébastien Grondin 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 19:29:42+00:00

2020-11-26 19:37:49+00:00

0:08:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.779211465110207
survival_time_median	14.950000000000076
deviation-center-line_median	0.956914463182592
in-drivable-lane_median	0.400000000000003

other stats

agent_compute-ego_max	0.017539265155792235
agent_compute-ego_mean	0.017296986958777256
agent_compute-ego_median	0.017329982916514077
agent_compute-ego_min	0.016988716846288637
complete-iteration_max	0.21136319478352864
complete-iteration_mean	0.19119856676390004
complete-iteration_median	0.18725212891896564
complete-iteration_min	0.17892681443414024
deviation-center-line_max	1.1986510535044623
deviation-center-line_mean	0.9029395298643504
deviation-center-line_min	0.4992781395877552
deviation-heading_max	5.630919060184226
deviation-heading_mean	4.3463447296941755
deviation-heading_median	4.36826232038603
deviation-heading_min	3.017935217820416
driven_any_max	3.5683601988066584
driven_any_mean	3.0434432633495527
driven_any_median	3.2913643709834455
driven_any_min	2.0226841126246624
driven_lanedir_consec_max	3.1559683492515385
driven_lanedir_consec_mean	2.6141051617182915
driven_lanedir_consec_min	1.742029367401215
driven_lanedir_max	3.1559683492515385
driven_lanedir_mean	2.6322084099017076
driven_lanedir_median	2.8154179614770385
driven_lanedir_min	1.742029367401215
get_duckie_state_max	2.3468335469563803e-06
get_duckie_state_mean	2.2087864173475165e-06
get_duckie_state_median	2.22325325012207e-06
get_duckie_state_min	2.041805622189544e-06
get_robot_state_max	0.015059737364451093
get_robot_state_mean	0.014440575574719628
get_robot_state_median	0.014389840632446051
get_robot_state_min	0.013922883669535318
get_state_dump_max	0.01435863176981608
get_state_dump_mean	0.013265266302944154
get_state_dump_median	0.013226770162582398
get_state_dump_min	0.01224889311679574
get_ui_image_max	0.035482293764750164
get_ui_image_mean	0.03337838182153628
get_ui_image_median	0.03318426826203516
get_ui_image_min	0.03166269699732462
in-drivable-lane_max	2.1500000000000306
in-drivable-lane_mean	0.80000000000001
in-drivable-lane_min	0.25000000000000355
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.411781672043363, "get_ui_image": 0.03166269699732462, "step_physics": 0.06947686592737834, "survival_time": 14.950000000000076, "driven_lanedir": 3.1559683492515385, "get_state_dump": 0.01435863176981608, "sim_render-ego": 0.005140395164489746, "get_robot_state": 0.013922883669535318, "get_duckie_state": 2.2681554158528647e-06, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.01750523805618286, "deviation-heading": 4.020826339730316, "complete-iteration": 0.1819306921958923, "set_robot_commands": 0.00455569585164388, "deviation-center-line": 0.8599933379784623, "driven_lanedir_consec": 3.1559683492515385, "sim_compute_sim_state": 0.021687642733256025, "sim_compute_performance-ego": 0.0034782886505126953}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.0226841126246624, "get_ui_image": 0.03234363433926604, "step_physics": 0.06815238747485848, "survival_time": 8.599999999999987, "driven_lanedir": 1.742029367401215, "get_state_dump": 0.01224889311679574, "sim_render-ego": 0.0054574913756791936, "get_robot_state": 0.014108556647633398, "get_duckie_state": 2.041805622189544e-06, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.016988716846288637, "deviation-heading": 3.017935217820416, "complete-iteration": 0.17892681443414024, "set_robot_commands": 0.004838867242946182, "deviation-center-line": 0.4992781395877552, "driven_lanedir_consec": 1.742029367401215, "sim_compute_sim_state": 0.020993817684262298, "sim_compute_performance-ego": 0.0036523522332657216}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.5683601988066584, "get_ui_image": 0.03402490218480428, "step_physics": 0.0760556435585022, "survival_time": 14.950000000000076, "driven_lanedir": 3.1097937192313454, "get_state_dump": 0.01304899295171102, "sim_render-ego": 0.00563897450764974, "get_robot_state": 0.014671124617258708, "get_duckie_state": 2.178351084391276e-06, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.017154727776845295, "deviation-heading": 4.715698301041744, "complete-iteration": 0.19257356564203895, "set_robot_commands": 0.004706684748331706, "deviation-center-line": 1.1986510535044623, "driven_lanedir_consec": 3.1097937192313454, "sim_compute_sim_state": 0.02334945758183797, "sim_compute_performance-ego": 0.0037706192334493}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.1709470699235274, "get_ui_image": 0.035482293764750164, "step_physics": 0.0878229848543803, "survival_time": 14.950000000000076, "driven_lanedir": 2.5210422037227316, "get_state_dump": 0.013404547373453776, "sim_render-ego": 0.0058521906534830725, "get_robot_state": 0.015059737364451093, "get_duckie_state": 2.3468335469563803e-06, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.017539265155792235, "deviation-heading": 5.630919060184226, "complete-iteration": 0.21136319478352864, "set_robot_commands": 0.004665122826894124, "deviation-center-line": 1.0538355883867214, "driven_lanedir_consec": 2.4486292109890684, "sim_compute_sim_state": 0.027397032578786215, "sim_compute_performance-ego": 0.003979151248931885}}
set_robot_commands_max	0.004838867242946182
set_robot_commands_mean	0.004691592667453973
set_robot_commands_median	0.004685903787612915
set_robot_commands_min	0.00455569585164388
sim_compute_performance-ego_max	0.003979151248931885
sim_compute_performance-ego_mean	0.003720102841539901
sim_compute_performance-ego_median	0.0037114857333575106
sim_compute_performance-ego_min	0.0034782886505126953
sim_compute_sim_state_max	0.027397032578786215
sim_compute_sim_state_mean	0.023356987644535625
sim_compute_sim_state_median	0.022518550157546995
sim_compute_sim_state_min	0.020993817684262298
sim_render-ego_max	0.0058521906534830725
sim_render-ego_mean	0.005522262925325438
sim_render-ego_median	0.005548232941664467
sim_render-ego_min	0.005140395164489746
simulation-passed	1
step_physics_max	0.0878229848543803
step_physics_mean	0.07537697045377982
step_physics_median	0.07276625474294027
step_physics_min	0.06815238747485848
survival_time_max	14.950000000000076
survival_time_mean	13.362500000000054
survival_time_min	8.599999999999987

No reset possible

43691

11718

Jean-Sébastien Grondin 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 19:19:48+00:00

2020-11-26 19:28:28+00:00

0:08:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.0231252036329397
survival_time_median	14.950000000000076
deviation-center-line_median	1.0236456763935482
in-drivable-lane_median	0.7500000000000053

other stats

agent_compute-ego_max	0.01816355069478353
agent_compute-ego_mean	0.01764915038174936
agent_compute-ego_median	0.017598430097630593
agent_compute-ego_min	0.017236190636952718
complete-iteration_max	0.21318782325339528
complete-iteration_mean	0.20169254778760728
complete-iteration_median	0.2012466192245483
complete-iteration_min	0.19108912944793705
deviation-center-line_max	1.1438246258388505
deviation-center-line_mean	0.9119277132589798
deviation-center-line_min	0.4565948744099722
deviation-heading_max	6.35425074340172
deviation-heading_mean	5.081127710211757
deviation-heading_median	5.671691584951963
deviation-heading_min	2.6268769275413804
driven_any_max	3.943445213331013
driven_any_mean	3.542682737941399
driven_any_median	3.6469466365813297
driven_any_min	2.9333924652719254
driven_lanedir_consec_max	3.4155854350157844
driven_lanedir_consec_mean	2.8959611722917096
driven_lanedir_consec_min	2.1220088468851745
driven_lanedir_max	3.4155854350157844
driven_lanedir_mean	2.8959611722917096
driven_lanedir_median	3.0231252036329397
driven_lanedir_min	2.1220088468851745
get_duckie_state_max	2.624988555908203e-06
get_duckie_state_mean	2.5336316904838813e-06
get_duckie_state_median	2.5507552785507696e-06
get_duckie_state_min	2.408027648925781e-06
get_robot_state_max	0.01585327943166097
get_robot_state_mean	0.015318696527002832
get_robot_state_median	0.015495021399495174
get_robot_state_min	0.014431463877360023
get_state_dump_max	0.013798386649747866
get_state_dump_mean	0.01348203986795251
get_state_dump_median	0.013505342404047648
get_state_dump_min	0.01311908801396688
get_ui_image_max	0.036147766908009846
get_ui_image_mean	0.03493328170087134
get_ui_image_median	0.03487283142618725
get_ui_image_min	0.03383969704310099
in-drivable-lane_max	2.950000000000042
in-drivable-lane_mean	1.2375000000000127
in-drivable-lane_min	0.4999999999999982
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.596388667613493, "get_ui_image": 0.03383969704310099, "step_physics": 0.0755670706431071, "survival_time": 14.950000000000076, "driven_lanedir": 2.8685544924525037, "get_state_dump": 0.013400917053222655, "sim_render-ego": 0.005756795406341553, "get_robot_state": 0.01547545591990153, "get_duckie_state": 2.624988555908203e-06, "in-drivable-lane": 1.0000000000000036, "agent_compute-ego": 0.017236190636952718, "deviation-heading": 6.35425074340172, "complete-iteration": 0.19343675374984745, "set_robot_commands": 0.004717679818471273, "deviation-center-line": 1.0062888567860693, "driven_lanedir_consec": 2.8685544924525037, "sim_compute_sim_state": 0.023440909385681153, "sim_compute_performance-ego": 0.00386018435160319}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.6975046055491654, "get_ui_image": 0.033904401461283366, "step_physics": 0.07488395849863688, "survival_time": 14.950000000000076, "driven_lanedir": 3.1776959148133757, "get_state_dump": 0.01311908801396688, "sim_render-ego": 0.005712060928344726, "get_robot_state": 0.014431463877360023, "get_duckie_state": 2.408027648925781e-06, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.017317872047424316, "deviation-heading": 5.960280968149227, "complete-iteration": 0.19108912944793705, "set_robot_commands": 0.004559309482574463, "deviation-center-line": 1.0410024960010271, "driven_lanedir_consec": 3.1776959148133757, "sim_compute_sim_state": 0.023203733762105307, "sim_compute_performance-ego": 0.0038152774175008136}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.943445213331013, "get_ui_image": 0.036147766908009846, "step_physics": 0.08483066082000733, "survival_time": 14.950000000000076, "driven_lanedir": 3.4155854350157844, "get_state_dump": 0.01360976775487264, "sim_render-ego": 0.006259910265604655, "get_robot_state": 0.01585327943166097, "get_duckie_state": 2.5717417399088543e-06, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.01816355069478353, "deviation-heading": 5.383102201754701, "complete-iteration": 0.20905648469924928, "set_robot_commands": 0.004797461827596028, "deviation-center-line": 1.1438246258388505, "driven_lanedir_consec": 3.4155854350157844, "sim_compute_sim_state": 0.02503262201944987, "sim_compute_performance-ego": 0.004208648999532064}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.9333924652719254, "get_ui_image": 0.03584126139109114, "step_physics": 0.08721995775678516, "survival_time": 11.300000000000026, "driven_lanedir": 2.1220088468851745, "get_state_dump": 0.013798386649747866, "sim_render-ego": 0.006054582849013067, "get_robot_state": 0.015514586879088816, "get_duckie_state": 2.5297688171926858e-06, "in-drivable-lane": 2.950000000000042, "agent_compute-ego": 0.01787898814783687, "deviation-heading": 2.6268769275413804, "complete-iteration": 0.21318782325339528, "set_robot_commands": 0.004782546937993143, "deviation-center-line": 0.4565948744099722, "driven_lanedir_consec": 2.1220088468851745, "sim_compute_sim_state": 0.027960160137277788, "sim_compute_performance-ego": 0.003983265530746595}}
set_robot_commands_max	0.004797461827596028
set_robot_commands_mean	0.004714249516658727
set_robot_commands_median	0.004750113378232208
set_robot_commands_min	0.004559309482574463
sim_compute_performance-ego_max	0.004208648999532064
sim_compute_performance-ego_mean	0.003966844074845666
sim_compute_performance-ego_median	0.003921724941174893
sim_compute_performance-ego_min	0.0038152774175008136
sim_compute_sim_state_max	0.027960160137277788
sim_compute_sim_state_mean	0.024909356326128528
sim_compute_sim_state_median	0.024236765702565513
sim_compute_sim_state_min	0.023203733762105307
sim_render-ego_max	0.006259910265604655
sim_render-ego_mean	0.005945837362326001
sim_render-ego_median	0.00590568912767731
sim_render-ego_min	0.005712060928344726
simulation-passed	1
step_physics_max	0.08721995775678516
step_physics_mean	0.08062541192963411
step_physics_median	0.08019886573155721
step_physics_min	0.07488395849863688
survival_time_max	14.950000000000076
survival_time_mean	14.037500000000064
survival_time_min	11.300000000000026

No reset possible

43672

11712

real-exercise-2

LFv-sim

success

2020-11-26 19:06:37+00:00

2020-11-26 19:14:40+00:00

0:08:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.272863744389277
survival_time_median	14.950000000000076
deviation-center-line_median	0.8201730046001499
in-drivable-lane_median	1.40000000000002

other stats

agent_compute-ego_max	0.0172957444190979
agent_compute-ego_mean	0.017006441950798035
agent_compute-ego_median	0.017018907467524214
agent_compute-ego_min	0.016692208449045818
complete-iteration_max	0.18341060876846313
complete-iteration_mean	0.1755302264293035
complete-iteration_median	0.1742880094051361
complete-iteration_min	0.1701342781384786
deviation-center-line_max	1.007358142261482
deviation-center-line_mean	0.8266596062551341
deviation-center-line_min	0.6589342735587547
deviation-heading_max	4.991920491286618
deviation-heading_mean	3.41405133829879
deviation-heading_median	2.9266190859952763
deviation-heading_min	2.8110466899179904
driven_any_max	3.1504594173025335
driven_any_mean	3.025248904460256
driven_any_median	3.023472265991209
driven_any_min	2.9035916685560723
driven_lanedir_consec_max	2.7152507335666662
driven_lanedir_consec_mean	2.333042616154752
driven_lanedir_consec_min	2.0711922422737885
driven_lanedir_max	2.7455408034939692
driven_lanedir_mean	2.5016297564597973
driven_lanedir_median	2.5038094411299405
driven_lanedir_min	2.253359340085339
get_duckie_state_max	2.241929372151693e-06
get_duckie_state_mean	2.165039380391439e-06
get_duckie_state_median	2.167224884033203e-06
get_duckie_state_min	2.0837783813476563e-06
get_robot_state_max	0.011475587685902911
get_robot_state_mean	0.011411570310592652
get_robot_state_median	0.011405925353368124
get_robot_state_min	0.011358842849731446
get_state_dump_max	0.011832935015360514
get_state_dump_mean	0.011782074769337972
get_state_dump_median	0.01177544395128886
get_state_dump_min	0.011744476159413656
get_ui_image_max	0.03287858645121256
get_ui_image_mean	0.03187109967072804
get_ui_image_median	0.031658387184143065
get_ui_image_min	0.03128903786341349
in-drivable-lane_max	2.8500000000000174
in-drivable-lane_mean	1.7250000000000187
in-drivable-lane_min	1.2500000000000178
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.9747741287963687, "get_ui_image": 0.031383150418599445, "step_physics": 0.0662701924641927, "survival_time": 14.950000000000076, "driven_lanedir": 2.253359340085339, "get_state_dump": 0.011832935015360514, "sim_render-ego": 0.004998413721720377, "get_robot_state": 0.011475587685902911, "get_duckie_state": 2.2077560424804687e-06, "in-drivable-lane": 2.8500000000000174, "agent_compute-ego": 0.01714592218399048, "deviation-heading": 2.919096298788418, "complete-iteration": 0.1727214034398397, "set_robot_commands": 0.004502489566802979, "deviation-center-line": 0.6589342735587547, "driven_lanedir_consec": 2.253359340085339, "sim_compute_sim_state": 0.021574362913767495, "sim_compute_performance-ego": 0.003397816022237142}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.0721704031860493, "get_ui_image": 0.03128903786341349, "step_physics": 0.06525532166163127, "survival_time": 14.950000000000076, "driven_lanedir": 2.7152507335666662, "get_state_dump": 0.011781140963236491, "sim_render-ego": 0.004894031683603923, "get_robot_state": 0.011363253593444825, "get_duckie_state": 2.241929372151693e-06, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.016891892751057944, "deviation-heading": 2.8110466899179904, "complete-iteration": 0.1701342781384786, "set_robot_commands": 0.004487694104512533, "deviation-center-line": 0.7184351490006863, "driven_lanedir_consec": 2.7152507335666662, "sim_compute_sim_state": 0.020699965953826904, "sim_compute_performance-ego": 0.003333148956298828}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.9035916685560723, "get_ui_image": 0.031933623949686685, "step_physics": 0.06929936250050862, "survival_time": 14.950000000000076, "driven_lanedir": 2.292368148693215, "get_state_dump": 0.011769746939341227, "sim_render-ego": 0.004925809701283773, "get_robot_state": 0.011448597113291424, "get_duckie_state": 2.1266937255859375e-06, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.0172957444190979, "deviation-heading": 4.991920491286618, "complete-iteration": 0.17585461537043254, "set_robot_commands": 0.004540595213572184, "deviation-center-line": 1.007358142261482, "driven_lanedir_consec": 2.292368148693215, "sim_compute_sim_state": 0.02116614023844401, "sim_compute_performance-ego": 0.003334448337554932}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.1504594173025335, "get_ui_image": 0.03287858645121256, "step_physics": 0.07370150804519654, "survival_time": 14.950000000000076, "driven_lanedir": 2.7455408034939692, "get_state_dump": 0.011744476159413656, "sim_render-ego": 0.0049726152420043945, "get_robot_state": 0.011358842849731446, "get_duckie_state": 2.0837783813476563e-06, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.016692208449045818, "deviation-heading": 2.934141873202135, "complete-iteration": 0.18341060876846313, "set_robot_commands": 0.004557630221048991, "deviation-center-line": 0.9219108601996134, "driven_lanedir_consec": 2.0711922422737885, "sim_compute_sim_state": 0.02398333708445231, "sim_compute_performance-ego": 0.0033814231554667156}}
set_robot_commands_max	0.004557630221048991
set_robot_commands_mean	0.0045221022764841716
set_robot_commands_median	0.004521542390187582
set_robot_commands_min	0.004487694104512533
sim_compute_performance-ego_max	0.003397816022237142
sim_compute_performance-ego_mean	0.0033617091178894045
sim_compute_performance-ego_median	0.003357935746510824
sim_compute_performance-ego_min	0.003333148956298828
sim_compute_sim_state_max	0.02398333708445231
sim_compute_sim_state_mean	0.02185595154762268
sim_compute_sim_state_median	0.021370251576105753
sim_compute_sim_state_min	0.020699965953826904
sim_render-ego_max	0.004998413721720377
sim_render-ego_mean	0.004947717587153117
sim_render-ego_median	0.004949212471644084
sim_render-ego_min	0.004894031683603923
simulation-passed	1
step_physics_max	0.07370150804519654
step_physics_mean	0.06863159616788228
step_physics_median	0.06778477748235066
step_physics_min	0.06525532166163127
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43650

11705

brian wong

baseline-RL-sim-pytorch

LFv-sim

success

2020-11-26 15:27:13+00:00

2020-11-26 15:38:29+00:00

0:11:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-0.8159157717372034
survival_time_median	14.950000000000076
deviation-center-line_median	0.4828096692402059
in-drivable-lane_median	5.300000000000037

other stats

agent_compute-ego_max	0.0158974814414978
agent_compute-ego_mean	0.015539165337880452
agent_compute-ego_median	0.015442434946695964
agent_compute-ego_min	0.01537431001663208
complete-iteration_max	0.18255725224812824
complete-iteration_mean	0.1798664347330729
complete-iteration_median	0.1798805510997772
complete-iteration_min	0.17714738448460896
deviation-center-line_max	0.651703293691752
deviation-center-line_mean	0.47199746002743725
deviation-center-line_min	0.27066720793758486
deviation-heading_max	7.7549195820288
deviation-heading_mean	6.903394108640635
deviation-heading_median	7.192002046815022
deviation-heading_min	5.474652758903699
driven_any_max	3.116406497821584
driven_any_mean	2.9570704108539387
driven_any_median	2.9394065547681505
driven_any_min	2.8330620360578695
driven_lanedir_consec_max	-0.7323970808401508
driven_lanedir_consec_mean	-0.833932408427248
driven_lanedir_consec_min	-0.9715010093944344
driven_lanedir_max	-0.7323970808401508
driven_lanedir_mean	-0.9580070909626486
driven_lanedir_median	-0.8711363309339539
driven_lanedir_min	-1.3573586211425357
get_duckie_state_max	2.2721290588378905e-06
get_duckie_state_mean	2.13166077931722e-06
get_duckie_state_median	2.1219253540039063e-06
get_duckie_state_min	2.010663350423177e-06
get_robot_state_max	0.01258217175801595
get_robot_state_mean	0.012468589146931969
get_robot_state_median	0.01245272994041443
get_robot_state_min	0.012386724948883055
get_state_dump_max	0.01248854080835978
get_state_dump_mean	0.012285471161206565
get_state_dump_median	0.012258500258127848
get_state_dump_min	0.012136343320210775
get_ui_image_max	0.03370280742645264
get_ui_image_mean	0.033446302016576133
get_ui_image_median	0.03346035401026408
get_ui_image_min	0.03316169261932373
in-drivable-lane_max	8.55000000000004
in-drivable-lane_mean	6.025000000000037
in-drivable-lane_min	4.950000000000035
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.962602241129332, "get_ui_image": 0.03316169261932373, "step_physics": 0.0704029647509257, "survival_time": 14.950000000000076, "driven_lanedir": -0.8475350879674952, "get_state_dump": 0.012285917599995932, "sim_render-ego": 0.005106533368428548, "get_robot_state": 0.012386724948883055, "get_duckie_state": 2.2721290588378905e-06, "in-drivable-lane": 5.350000000000042, "agent_compute-ego": 0.015449683666229248, "deviation-heading": 7.463481739873552, "complete-iteration": 0.17714738448460896, "set_robot_commands": 0.004405678908030192, "deviation-center-line": 0.4871549920482706, "driven_lanedir_consec": -0.7370939695739942, "sim_compute_sim_state": 0.020396745204925536, "sim_compute_performance-ego": 0.0034259780248006187}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.116406497821584, "get_ui_image": 0.03367823203404745, "step_physics": 0.07091155767440796, "survival_time": 14.950000000000076, "driven_lanedir": -1.3573586211425357, "get_state_dump": 0.012136343320210775, "sim_render-ego": 0.005214509963989258, "get_robot_state": 0.012490350405375165, "get_duckie_state": 2.010663350423177e-06, "in-drivable-lane": 5.250000000000032, "agent_compute-ego": 0.01543518622716268, "deviation-heading": 6.920522353756493, "complete-iteration": 0.1778214947382609, "set_robot_commands": 0.0044321044286092124, "deviation-center-line": 0.651703293691752, "driven_lanedir_consec": -0.9715010093944344, "sim_compute_sim_state": 0.01988337278366089, "sim_compute_performance-ego": 0.003509395917256673}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.916210868406969, "get_ui_image": 0.03324247598648071, "step_physics": 0.07499923547108968, "survival_time": 14.950000000000076, "driven_lanedir": -0.8947375739004126, "get_state_dump": 0.012231082916259763, "sim_render-ego": 0.005223128000895182, "get_robot_state": 0.012415109475453694, "get_duckie_state": 2.0996729532877604e-06, "in-drivable-lane": 8.55000000000004, "agent_compute-ego": 0.0158974814414978, "deviation-heading": 5.474652758903699, "complete-iteration": 0.18255725224812824, "set_robot_commands": 0.004292729695638021, "deviation-center-line": 0.27066720793758486, "driven_lanedir_consec": -0.8947375739004126, "sim_compute_sim_state": 0.020665373007456463, "sim_compute_performance-ego": 0.0034624107678731283}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8330620360578695, "get_ui_image": 0.03370280742645264, "step_physics": 0.07149323145548503, "survival_time": 14.950000000000076, "driven_lanedir": -0.7323970808401508, "get_state_dump": 0.01248854080835978, "sim_render-ego": 0.005151404539744059, "get_robot_state": 0.01258217175801595, "get_duckie_state": 2.1441777547200523e-06, "in-drivable-lane": 4.950000000000035, "agent_compute-ego": 0.01537431001663208, "deviation-heading": 7.7549195820288, "complete-iteration": 0.1819396074612935, "set_robot_commands": 0.004300068219502767, "deviation-center-line": 0.47846434643214136, "driven_lanedir_consec": -0.7323970808401508, "sim_compute_sim_state": 0.023237645626068115, "sim_compute_performance-ego": 0.003481630484263102}}
set_robot_commands_max	0.0044321044286092124
set_robot_commands_mean	0.004357645312945049
set_robot_commands_median	0.00435287356376648
set_robot_commands_min	0.004292729695638021
sim_compute_performance-ego_max	0.003509395917256673
sim_compute_performance-ego_mean	0.0034698537985483804
sim_compute_performance-ego_median	0.003472020626068115
sim_compute_performance-ego_min	0.0034259780248006187
sim_compute_sim_state_max	0.023237645626068115
sim_compute_sim_state_mean	0.021045784155527752
sim_compute_sim_state_median	0.020531059106191
sim_compute_sim_state_min	0.01988337278366089
sim_render-ego_max	0.005223128000895182
sim_render-ego_mean	0.005173893968264262
sim_render-ego_median	0.005182957251866659
sim_render-ego_min	0.005106533368428548
simulation-passed	1
step_physics_max	0.07499923547108968
step_physics_mean	0.07195174733797709
step_physics_median	0.0712023945649465
step_physics_min	0.0704029647509257
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43637

11701

Yishu Malhotra 🇨🇦

real-exercise-2

LFv-sim

success

2020-11-26 10:01:56+00:00

2020-11-26 10:10:05+00:00

0:08:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.221343198450093
survival_time_median	14.950000000000076
deviation-center-line_median	0.6720776859321036
in-drivable-lane_median	1.10000000000001

other stats

agent_compute-ego_max	0.01707224448521932
agent_compute-ego_mean	0.017039791079564284
agent_compute-ego_median	0.017050720055898028
agent_compute-ego_min	0.01698547972124175
complete-iteration_max	0.18371074482546015
complete-iteration_mean	0.17817676535433968
complete-iteration_median	0.17866820335388184
complete-iteration_min	0.17165990988413493
deviation-center-line_max	0.8008696612010427
deviation-center-line_mean	0.6349593860088983
deviation-center-line_min	0.3948125109703433
deviation-heading_max	4.507226474566028
deviation-heading_mean	3.385201482645469
deviation-heading_median	3.477670386339713
deviation-heading_min	2.07823868333642
driven_any_max	3.1388011184946185
driven_any_mean	2.5992548468298753
driven_any_median	2.628267943319178
driven_any_min	2.001682382186527
driven_lanedir_consec_max	2.6159356231323714
driven_lanedir_consec_mean	2.204666602700314
driven_lanedir_consec_min	1.7600443907686998
driven_lanedir_max	2.6159356231323714
driven_lanedir_mean	2.204666602700314
driven_lanedir_median	2.221343198450093
driven_lanedir_min	1.7600443907686998
get_duckie_state_max	2.430280049641927e-06
get_duckie_state_mean	2.249779000794147e-06
get_duckie_state_median	2.246105064780025e-06
get_duckie_state_min	2.0766258239746096e-06
get_robot_state_max	0.011655315558115642
get_robot_state_mean	0.0115826029696707
get_robot_state_median	0.011572091801691862
get_robot_state_min	0.011530912717183431
get_state_dump_max	0.012005012035369873
get_state_dump_mean	0.011896588576715545
get_state_dump_median	0.011872656291487527
get_state_dump_min	0.011836029688517252
get_ui_image_max	0.03420134623845418
get_ui_image_mean	0.03273572174842748
get_ui_image_median	0.03256624913485037
get_ui_image_min	0.03160904248555501
in-drivable-lane_max	3.600000000000051
in-drivable-lane_mean	1.4500000000000175
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.1388011184946185, "get_ui_image": 0.03420134623845418, "step_physics": 0.06756653706232707, "survival_time": 14.950000000000076, "driven_lanedir": 2.6159356231323714, "get_state_dump": 0.011907264391581218, "sim_render-ego": 0.005080312887827555, "get_robot_state": 0.011655315558115642, "get_duckie_state": 2.1632512410481773e-06, "in-drivable-lane": 1.800000000000014, "agent_compute-ego": 0.017041753927866617, "deviation-heading": 3.4876323266149707, "complete-iteration": 0.17698568979899088, "set_robot_commands": 0.004525633653004965, "deviation-center-line": 0.6834119468519214, "driven_lanedir_consec": 2.6159356231323714, "sim_compute_sim_state": 0.021434786319732665, "sim_compute_performance-ego": 0.0034414068857828778}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.756809677705819, "get_ui_image": 0.03160904248555501, "step_physics": 0.06570993582407633, "survival_time": 14.950000000000076, "driven_lanedir": 2.5750985759936427, "get_state_dump": 0.011836029688517252, "sim_render-ego": 0.005046870708465576, "get_robot_state": 0.011530912717183431, "get_duckie_state": 2.430280049641927e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01707224448521932, "deviation-heading": 4.507226474566028, "complete-iteration": 0.17165990988413493, "set_robot_commands": 0.004510047435760498, "deviation-center-line": 0.8008696612010427, "driven_lanedir_consec": 2.5750985759936427, "sim_compute_sim_state": 0.02082062005996704, "sim_compute_performance-ego": 0.003394896189371745}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.499726208932537, "get_ui_image": 0.03245654503504435, "step_physics": 0.0733939782778422, "survival_time": 14.950000000000076, "driven_lanedir": 1.8675878209065424, "get_state_dump": 0.012005012035369873, "sim_render-ego": 0.0051222872734069825, "get_robot_state": 0.01160995880762736, "get_duckie_state": 2.0766258239746096e-06, "in-drivable-lane": 3.600000000000051, "agent_compute-ego": 0.017059686183929442, "deviation-heading": 3.4677084460644556, "complete-iteration": 0.18035071690877277, "set_robot_commands": 0.004350942770640055, "deviation-center-line": 0.6607434250122859, "driven_lanedir_consec": 1.8675878209065424, "sim_compute_sim_state": 0.020821165243784585, "sim_compute_performance-ego": 0.003403202692667643}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.001682382186527, "get_ui_image": 0.032675953234656385, "step_physics": 0.0751067298953816, "survival_time": 8.84999999999999, "driven_lanedir": 1.7600443907686998, "get_state_dump": 0.011838048191393837, "sim_render-ego": 0.004899010146405064, "get_robot_state": 0.011534224795756366, "get_duckie_state": 2.328958888511873e-06, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.01698547972124175, "deviation-heading": 2.07823868333642, "complete-iteration": 0.18371074482546015, "set_robot_commands": 0.004357993939502091, "deviation-center-line": 0.3948125109703433, "driven_lanedir_consec": 1.7600443907686998, "sim_compute_sim_state": 0.02281888730108401, "sim_compute_performance-ego": 0.0033642599138162905}}
set_robot_commands_max	0.004525633653004965
set_robot_commands_mean	0.004436154449726902
set_robot_commands_median	0.004434020687631294
set_robot_commands_min	0.004350942770640055
sim_compute_performance-ego_max	0.0034414068857828778
sim_compute_performance-ego_mean	0.0034009414204096387
sim_compute_performance-ego_median	0.003399049441019694
sim_compute_performance-ego_min	0.0033642599138162905
sim_compute_sim_state_max	0.02281888730108401
sim_compute_sim_state_mean	0.021473864731142076
sim_compute_sim_state_median	0.021127975781758623
sim_compute_sim_state_min	0.02082062005996704
sim_render-ego_max	0.0051222872734069825
sim_render-ego_mean	0.005037120254026294
sim_render-ego_median	0.005063591798146565
sim_render-ego_min	0.004899010146405064
simulation-passed	1
step_physics_max	0.0751067298953816
step_physics_mean	0.0704442952649068
step_physics_median	0.07048025767008465
step_physics_min	0.06570993582407633
survival_time_max	14.950000000000076
survival_time_mean	13.425000000000058
survival_time_min	8.84999999999999

No reset possible

43601

11695

Dishank Bansal 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 08:07:59+00:00

2020-11-26 08:16:43+00:00

0:08:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.7648887146465935
survival_time_median	14.950000000000076
deviation-center-line_median	0.8126291802849805
in-drivable-lane_median	0.6750000000000043

other stats

agent_compute-ego_max	0.0181392342054925
agent_compute-ego_mean	0.018001392637791276
agent_compute-ego_median	0.017988354365030924
agent_compute-ego_min	0.01788962761561076
complete-iteration_max	0.21922948895668495
complete-iteration_mean	0.2065844829350102
complete-iteration_median	0.2029197025299072
complete-iteration_min	0.20126903772354127
deviation-center-line_max	1.1608784296847812
deviation-center-line_mean	0.784186257990115
deviation-center-line_min	0.3506082417057174
deviation-heading_max	3.66265498179976
deviation-heading_mean	2.699349018693837
deviation-heading_median	2.968857583696368
deviation-heading_min	1.197025925582852
driven_any_max	4.774190680349507
driven_any_mean	3.907535262813083
driven_any_median	4.067697050582238
driven_any_min	2.720556269738347
driven_lanedir_consec_max	4.6230544659094175
driven_lanedir_consec_mean	3.649650540393972
driven_lanedir_consec_min	2.4457702663732857
driven_lanedir_max	4.6230544659094175
driven_lanedir_mean	3.649650540393972
driven_lanedir_median	3.7648887146465935
driven_lanedir_min	2.4457702663732857
get_duckie_state_max	2.93731689453125e-06
get_duckie_state_mean	2.889191212297297e-06
get_duckie_state_median	2.880007231316599e-06
get_duckie_state_min	2.85943349202474e-06
get_robot_state_max	0.01617552121480306
get_robot_state_mean	0.015870593319944785
get_robot_state_median	0.015799388488133746
get_robot_state_min	0.01570807508870858
get_state_dump_max	0.013915256578095106
get_state_dump_mean	0.013702672302317457
get_state_dump_median	0.0137247633934021
get_state_dump_min	0.013445905844370524
get_ui_image_max	0.03629883292580948
get_ui_image_mean	0.03525640190458622
get_ui_image_median	0.03501352667808533
get_ui_image_min	0.034699721336364744
in-drivable-lane_max	1.2500000000000029
in-drivable-lane_mean	0.6500000000000028
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.774190680349507, "get_ui_image": 0.03506656010945638, "step_physics": 0.08024738788604736, "survival_time": 14.950000000000076, "driven_lanedir": 4.6230544659094175, "get_state_dump": 0.013915255864461264, "sim_render-ego": 0.006688462098439534, "get_robot_state": 0.01617552121480306, "get_duckie_state": 2.85943349202474e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.018049862384796143, "deviation-heading": 3.1320117536529075, "complete-iteration": 0.2044393173853556, "set_robot_commands": 0.004828818639119466, "deviation-center-line": 1.1608784296847812, "driven_lanedir_consec": 4.6230544659094175, "sim_compute_sim_state": 0.025173162619272868, "sim_compute_performance-ego": 0.004140599568684896}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.414489996255203, "get_ui_image": 0.034699721336364744, "step_physics": 0.07967483520507812, "survival_time": 14.950000000000076, "driven_lanedir": 4.040085125439794, "get_state_dump": 0.013445905844370524, "sim_render-ego": 0.00610266923904419, "get_robot_state": 0.015855677127838134, "get_duckie_state": 2.8681755065917967e-06, "in-drivable-lane": 1.2500000000000029, "agent_compute-ego": 0.017926846345265705, "deviation-heading": 3.66265498179976, "complete-iteration": 0.20140008767445883, "set_robot_commands": 0.004845871925354004, "deviation-center-line": 0.8970203585290025, "driven_lanedir_consec": 4.040085125439794, "sim_compute_sim_state": 0.02453341325124105, "sim_compute_performance-ego": 0.004161947568257649}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.720904104909273, "get_ui_image": 0.034960493246714276, "step_physics": 0.07937174638112386, "survival_time": 14.950000000000076, "driven_lanedir": 3.4896923038533925, "get_state_dump": 0.013534270922342936, "sim_render-ego": 0.006035192012786865, "get_robot_state": 0.01574309984842936, "get_duckie_state": 2.93731689453125e-06, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.01788962761561076, "deviation-heading": 2.8057034137398285, "complete-iteration": 0.20126903772354127, "set_robot_commands": 0.004818081061045329, "deviation-center-line": 0.7282380020409585, "driven_lanedir_consec": 3.4896923038533925, "sim_compute_sim_state": 0.0246743114789327, "sim_compute_performance-ego": 0.004087565739949544}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.720556269738347, "get_ui_image": 0.03629883292580948, "step_physics": 0.09211493187210187, "survival_time": 7.349999999999982, "driven_lanedir": 2.4457702663732857, "get_state_dump": 0.013915256578095106, "sim_render-ego": 0.006283667622780313, "get_robot_state": 0.01570807508870858, "get_duckie_state": 2.891838956041401e-06, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.0181392342054925, "deviation-heading": 1.197025925582852, "complete-iteration": 0.21922948895668495, "set_robot_commands": 0.004840579973597105, "deviation-center-line": 0.3506082417057174, "driven_lanedir_consec": 2.4457702663732857, "sim_compute_sim_state": 0.02759138905272192, "sim_compute_performance-ego": 0.004180747635510503}}
set_robot_commands_max	0.004845871925354004
set_robot_commands_mean	0.004833337899778976
set_robot_commands_median	0.0048346993063582856
set_robot_commands_min	0.004818081061045329
sim_compute_performance-ego_max	0.004180747635510503
sim_compute_performance-ego_mean	0.004142715128100648
sim_compute_performance-ego_median	0.004151273568471272
sim_compute_performance-ego_min	0.004087565739949544
sim_compute_sim_state_max	0.02759138905272192
sim_compute_sim_state_mean	0.025493069100542137
sim_compute_sim_state_median	0.024923737049102786
sim_compute_sim_state_min	0.02453341325124105
sim_render-ego_max	0.006688462098439534
sim_render-ego_mean	0.006277497743262726
sim_render-ego_median	0.006193168430912251
sim_render-ego_min	0.006035192012786865
simulation-passed	1
step_physics_max	0.09211493187210187
step_physics_mean	0.0828522253360878
step_physics_median	0.07996111154556274
step_physics_min	0.07937174638112386
survival_time_max	14.950000000000076
survival_time_mean	13.050000000000054
survival_time_min	7.349999999999982

No reset possible

43586

11695

Dishank Bansal 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 07:59:14+00:00

2020-11-26 08:07:17+00:00

0:08:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.5533308071178067
survival_time_median	14.950000000000076
deviation-center-line_median	0.6914330565324438
in-drivable-lane_median	1.5000000000000075

other stats

agent_compute-ego_max	0.017660569521336773
agent_compute-ego_mean	0.01753403389765546
agent_compute-ego_median	0.017528542280197144
agent_compute-ego_min	0.017418481508890787
complete-iteration_max	0.2124018108143526
complete-iteration_mean	0.20070229598120148
complete-iteration_median	0.1982320396105449
complete-iteration_min	0.1939432938893636
deviation-center-line_max	1.0621132368848425
deviation-center-line_mean	0.7104136959237711
deviation-center-line_min	0.396675433745355
deviation-heading_max	3.1113062092676333
deviation-heading_mean	2.4526689785880396
deviation-heading_median	2.833700840236018
deviation-heading_min	1.0319680246124914
driven_any_max	4.733953749409199
driven_any_mean	4.2294965923355825
driven_any_median	4.682331837463376
driven_any_min	2.8193689450063784
driven_lanedir_consec_max	4.428441514155317
driven_lanedir_consec_mean	3.4883330549602514
driven_lanedir_consec_min	2.4182290914500757
driven_lanedir_max	4.428441514155317
driven_lanedir_mean	3.694510779222174
driven_lanedir_median	3.965686255641653
driven_lanedir_min	2.4182290914500757
get_duckie_state_max	2.7592976888020835e-06
get_duckie_state_mean	2.6400338590534684e-06
get_duckie_state_median	2.623399098714193e-06
get_duckie_state_min	2.5540395499834046e-06
get_robot_state_max	0.016143160661061605
get_robot_state_mean	0.015432100888171228
get_robot_state_median	0.0156291500649421
get_robot_state_min	0.014326942761739096
get_state_dump_max	0.01382132609685262
get_state_dump_mean	0.013684431622230929
get_state_dump_median	0.013687110165365382
get_state_dump_min	0.013542180061340331
get_ui_image_max	0.03516643343408123
get_ui_image_mean	0.03448826128750845
get_ui_image_median	0.034481437603632606
get_ui_image_min	0.033823736508687335
in-drivable-lane_max	4.400000000000003
in-drivable-lane_mean	2.0125000000000037
in-drivable-lane_min	0.6499999999999977
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.692328099615578, "get_ui_image": 0.033823736508687335, "step_physics": 0.07560936212539673, "survival_time": 14.950000000000076, "driven_lanedir": 4.428441514155317, "get_state_dump": 0.013542180061340331, "sim_render-ego": 0.005838946501413981, "get_robot_state": 0.014326942761739096, "get_duckie_state": 2.7592976888020835e-06, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.01754679997762044, "deviation-heading": 3.1113062092676333, "complete-iteration": 0.1939432938893636, "set_robot_commands": 0.0045939954121907555, "deviation-center-line": 1.0621132368848425, "driven_lanedir_consec": 4.428441514155317, "sim_compute_sim_state": 0.024546468257904058, "sim_compute_performance-ego": 0.00396242618560791}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.672335575311173, "get_ui_image": 0.033943167527516686, "step_physics": 0.07520711739857991, "survival_time": 14.950000000000076, "driven_lanedir": 4.233220985168814, "get_state_dump": 0.013723904291788738, "sim_render-ego": 0.006094167232513428, "get_robot_state": 0.016143160661061605, "get_duckie_state": 2.6377042134602863e-06, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.017510284582773844, "deviation-heading": 2.833619961002887, "complete-iteration": 0.1960072143872579, "set_robot_commands": 0.004867053031921387, "deviation-center-line": 0.7298157526320469, "driven_lanedir_consec": 4.233220985168814, "sim_compute_sim_state": 0.02426369508107503, "sim_compute_performance-ego": 0.004099593162536621}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.733953749409199, "get_ui_image": 0.03501970767974853, "step_physics": 0.08082093954086304, "survival_time": 14.950000000000076, "driven_lanedir": 3.698151526114491, "get_state_dump": 0.01382132609685262, "sim_render-ego": 0.005990750789642334, "get_robot_state": 0.015711699326833087, "get_duckie_state": 2.609093983968099e-06, "in-drivable-lane": 4.400000000000003, "agent_compute-ego": 0.017418481508890787, "deviation-heading": 2.8337817194691484, "complete-iteration": 0.2004568648338318, "set_robot_commands": 0.004778231779734294, "deviation-center-line": 0.6530503604328406, "driven_lanedir_consec": 2.873440629066799, "sim_compute_sim_state": 0.02265170097351074, "sim_compute_performance-ego": 0.004086739222208659}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8193689450063784, "get_ui_image": 0.03516643343408123, "step_physics": 0.0885011074589748, "survival_time": 7.649999999999981, "driven_lanedir": 2.4182290914500757, "get_state_dump": 0.013650316038942026, "sim_render-ego": 0.005937959633621515, "get_robot_state": 0.01554660080305112, "get_duckie_state": 2.5540395499834046e-06, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.017660569521336773, "deviation-heading": 1.0319680246124914, "complete-iteration": 0.2124018108143526, "set_robot_commands": 0.004911100163179285, "deviation-center-line": 0.396675433745355, "driven_lanedir_consec": 2.4182290914500757, "sim_compute_sim_state": 0.026903423608518114, "sim_compute_performance-ego": 0.003963375403211008}}
set_robot_commands_max	0.004911100163179285
set_robot_commands_mean	0.0047875950967564305
set_robot_commands_median	0.00482264240582784
set_robot_commands_min	0.0045939954121907555
sim_compute_performance-ego_max	0.004099593162536621
sim_compute_performance-ego_mean	0.00402803349339105
sim_compute_performance-ego_median	0.004025057312709834
sim_compute_performance-ego_min	0.00396242618560791
sim_compute_sim_state_max	0.026903423608518114
sim_compute_sim_state_mean	0.024591321980251983
sim_compute_sim_state_median	0.024405081669489542
sim_compute_sim_state_min	0.02265170097351074
sim_render-ego_max	0.006094167232513428
sim_render-ego_mean	0.005965456039297814
sim_render-ego_median	0.005964355211631925
sim_render-ego_min	0.005838946501413981
simulation-passed	1
step_physics_max	0.0885011074589748
step_physics_mean	0.08003463163095362
step_physics_median	0.07821515083312988
step_physics_min	0.07520711739857991
survival_time_max	14.950000000000076
survival_time_mean	13.125000000000052
survival_time_min	7.649999999999981

No reset possible

43576

11692

Bhavya Patwa 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 07:42:15+00:00

2020-11-26 07:51:06+00:00

0:08:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.3563688636265807
survival_time_median	14.950000000000076
deviation-center-line_median	0.5749169899167043
in-drivable-lane_median	2.10000000000003

other stats

agent_compute-ego_max	0.01822209358215332
agent_compute-ego_mean	0.017900001369705494
agent_compute-ego_median	0.017878016233444212
agent_compute-ego_min	0.017621879429780236
complete-iteration_max	0.20632752522017608
complete-iteration_mean	0.20118961062080176
complete-iteration_median	0.2031971005598704
complete-iteration_min	0.1920367161432902
deviation-center-line_max	0.6545981431627608
deviation-center-line_mean	0.5393471092455678
deviation-center-line_min	0.3529563139861022
deviation-heading_max	3.3456522054063065
deviation-heading_mean	2.525840724138166
deviation-heading_median	2.577893057174295
deviation-heading_min	1.6019245767977666
driven_any_max	3.063071129166272
driven_any_mean	2.9530485596015574
driven_any_median	3.05791685525255
driven_any_min	2.633289398734856
driven_lanedir_consec_max	2.9275563373445266
driven_lanedir_consec_mean	2.2675368350353597
driven_lanedir_consec_min	1.4298532755437514
driven_lanedir_max	2.9275563373445266
driven_lanedir_mean	2.2675368350353597
driven_lanedir_median	2.3563688636265807
driven_lanedir_min	1.4298532755437514
get_duckie_state_max	2.7569135030110675e-06
get_duckie_state_mean	2.619975297025932e-06
get_duckie_state_median	2.621809641520182e-06
get_duckie_state_min	2.4793684020522953e-06
get_robot_state_max	0.01635014057159424
get_robot_state_mean	0.015253788736439492
get_robot_state_median	0.015233161052068074
get_robot_state_min	0.014198692270027574
get_state_dump_max	0.014072477022806803
get_state_dump_mean	0.013633226581322133
get_state_dump_median	0.0135340635536253
get_state_dump_min	0.01339230219523112
get_ui_image_max	0.035519662698109945
get_ui_image_mean	0.034915167361266854
get_ui_image_median	0.03503438963446506
get_ui_image_min	0.034072227478027343
in-drivable-lane_max	6.65000000000002
in-drivable-lane_mean	2.71250000000002
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.052963112642984, "get_ui_image": 0.03519668817520141, "step_physics": 0.07926918586095175, "survival_time": 14.950000000000076, "driven_lanedir": 2.9275563373445266, "get_state_dump": 0.014072477022806803, "sim_render-ego": 0.0061502178510030115, "get_robot_state": 0.01635014057159424, "get_duckie_state": 2.7569135030110675e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01822209358215332, "deviation-heading": 3.1799891369601654, "complete-iteration": 0.20269428809483847, "set_robot_commands": 0.004870150883992513, "deviation-center-line": 0.5562005567911331, "driven_lanedir_consec": 2.9275563373445266, "sim_compute_sim_state": 0.024225386778513592, "sim_compute_performance-ego": 0.0041691056887308755}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.063071129166272, "get_ui_image": 0.034072227478027343, "step_physics": 0.07460619529088339, "survival_time": 14.950000000000076, "driven_lanedir": 2.639786299507063, "get_state_dump": 0.01349693775177002, "sim_render-ego": 0.005845410029093424, "get_robot_state": 0.014748155275980631, "get_duckie_state": 2.6559829711914064e-06, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.017694901625315347, "deviation-heading": 1.9757969773884247, "complete-iteration": 0.1920367161432902, "set_robot_commands": 0.0047797958056132, "deviation-center-line": 0.5936334230422754, "driven_lanedir_consec": 2.639786299507063, "sim_compute_sim_state": 0.02272681792577108, "sim_compute_performance-ego": 0.003904425303141276}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.062870597862117, "get_ui_image": 0.035519662698109945, "step_physics": 0.08177626927693685, "survival_time": 14.950000000000076, "driven_lanedir": 1.4298532755437514, "get_state_dump": 0.01339230219523112, "sim_render-ego": 0.006107752323150635, "get_robot_state": 0.01571816682815552, "get_duckie_state": 2.5876363118489584e-06, "in-drivable-lane": 6.65000000000002, "agent_compute-ego": 0.01806113084157308, "deviation-heading": 3.3456522054063065, "complete-iteration": 0.2036999130249023, "set_robot_commands": 0.004935113588968912, "deviation-center-line": 0.6545981431627608, "driven_lanedir_consec": 1.4298532755437514, "sim_compute_sim_state": 0.02391971826553345, "sim_compute_performance-ego": 0.004105535348256429}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.633289398734856, "get_ui_image": 0.034872091093728706, "step_physics": 0.08521255411842997, "survival_time": 12.900000000000048, "driven_lanedir": 2.072951427746098, "get_state_dump": 0.013571189355480578, "sim_render-ego": 0.00572037234786869, "get_robot_state": 0.014198692270027574, "get_duckie_state": 2.4793684020522953e-06, "in-drivable-lane": 2.450000000000035, "agent_compute-ego": 0.017621879429780236, "deviation-heading": 1.6019245767977666, "complete-iteration": 0.20632752522017608, "set_robot_commands": 0.004513750704683999, "deviation-center-line": 0.3529563139861022, "driven_lanedir_consec": 2.072951427746098, "sim_compute_sim_state": 0.026601369066755903, "sim_compute_performance-ego": 0.003850709560305573}}
set_robot_commands_max	0.004935113588968912
set_robot_commands_mean	0.004774702745814656
set_robot_commands_median	0.004824973344802856
set_robot_commands_min	0.004513750704683999
sim_compute_performance-ego_max	0.0041691056887308755
sim_compute_performance-ego_mean	0.0040074439751085385
sim_compute_performance-ego_median	0.0040049803256988524
sim_compute_performance-ego_min	0.003850709560305573
sim_compute_sim_state_max	0.026601369066755903
sim_compute_sim_state_mean	0.024368323009143503
sim_compute_sim_state_median	0.02407255252202352
sim_compute_sim_state_min	0.02272681792577108
sim_render-ego_max	0.0061502178510030115
sim_render-ego_mean	0.00595593813777894
sim_render-ego_median	0.00597658117612203
sim_render-ego_min	0.00572037234786869
simulation-passed	1
step_physics_max	0.08521255411842997
step_physics_mean	0.08021605113680048
step_physics_median	0.0805227275689443
step_physics_min	0.07460619529088339
survival_time_max	14.950000000000076
survival_time_mean	14.437500000000073
survival_time_min	12.900000000000048

No reset possible

43531

11687

Dishank Bansal 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 07:14:42+00:00

2020-11-26 07:24:02+00:00

0:09:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.4498544410220253
survival_time_median	14.950000000000076
deviation-center-line_median	0.664125783538552
in-drivable-lane_median	1.7000000000000242

other stats

agent_compute-ego_max	0.018310646216074627
agent_compute-ego_mean	0.01790842572848002
agent_compute-ego_median	0.01796856721242269
agent_compute-ego_min	0.017385922273000082
complete-iteration_max	0.21479195197423295
complete-iteration_mean	0.206013090411822
complete-iteration_median	0.20511645873387657
complete-iteration_min	0.19902749220530191
deviation-center-line_max	0.904828399882046
deviation-center-line_mean	0.6470152336726791
deviation-center-line_min	0.3549809677315663
deviation-heading_max	3.961004722333802
deviation-heading_mean	2.7504277843229077
deviation-heading_median	2.824493773793383
deviation-heading_min	1.391718867371063
driven_any_max	4.189897434923297
driven_any_mean	3.803130586997729
driven_any_median	3.743477085988419
driven_any_min	3.535670741090782
driven_lanedir_consec_max	3.7031392570598975
driven_lanedir_consec_mean	3.230351632024438
driven_lanedir_consec_min	2.318558388993804
driven_lanedir_max	3.7031392570598975
driven_lanedir_mean	3.230351632024438
driven_lanedir_median	3.4498544410220253
driven_lanedir_min	2.318558388993804
get_duckie_state_max	2.7108192443847654e-06
get_duckie_state_mean	2.655386924743652e-06
get_duckie_state_median	2.6587645212809246e-06
get_duckie_state_min	2.593199412027995e-06
get_robot_state_max	0.016479337215423585
get_robot_state_mean	0.01607194781303406
get_robot_state_median	0.01610613147417704
get_robot_state_min	0.01559619108835856
get_state_dump_max	0.013940703868865967
get_state_dump_mean	0.01380062460899353
get_state_dump_median	0.013782282670338947
get_state_dump_min	0.013697229226430256
get_ui_image_max	0.03651104927062988
get_ui_image_mean	0.03543181896209717
get_ui_image_median	0.03558026790618896
get_ui_image_min	0.03405569076538086
in-drivable-lane_max	7.000000000000098
in-drivable-lane_mean	2.662500000000036
in-drivable-lane_min	0.2499999999999991
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.9475771718417936, "get_ui_image": 0.03405569076538086, "step_physics": 0.07831947326660156, "survival_time": 14.950000000000076, "driven_lanedir": 3.6537921768607737, "get_state_dump": 0.013940703868865967, "sim_render-ego": 0.006190371513366699, "get_robot_state": 0.01559619108835856, "get_duckie_state": 2.628167470296224e-06, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.01779102087020874, "deviation-heading": 3.961004722333802, "complete-iteration": 0.2004409543673197, "set_robot_commands": 0.004834139347076416, "deviation-center-line": 0.904828399882046, "driven_lanedir_consec": 3.6537921768607737, "sim_compute_sim_state": 0.02542103926340739, "sim_compute_performance-ego": 0.004135367075602214}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.189897434923297, "get_ui_image": 0.03496292432149251, "step_physics": 0.07728443225224813, "survival_time": 14.950000000000076, "driven_lanedir": 3.7031392570598975, "get_state_dump": 0.013719189167022704, "sim_render-ego": 0.006121341387430827, "get_robot_state": 0.015920002460479737, "get_duckie_state": 2.7108192443847654e-06, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.017385922273000082, "deviation-heading": 2.7496341834632663, "complete-iteration": 0.19902749220530191, "set_robot_commands": 0.005009926954905192, "deviation-center-line": 0.7331182120770033, "driven_lanedir_consec": 3.7031392570598975, "sim_compute_sim_state": 0.024411275386810306, "sim_compute_performance-ego": 0.0040561644236246745}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.535670741090782, "get_ui_image": 0.03651104927062988, "step_physics": 0.08367759625116984, "survival_time": 14.950000000000076, "driven_lanedir": 3.245916705183277, "get_state_dump": 0.013697229226430256, "sim_render-ego": 0.0063695112864176435, "get_robot_state": 0.016292260487874348, "get_duckie_state": 2.689361572265625e-06, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.018146113554636637, "deviation-heading": 2.8993533641235, "complete-iteration": 0.20979196310043335, "set_robot_commands": 0.004956249396006266, "deviation-center-line": 0.5951333550001007, "driven_lanedir_consec": 3.245916705183277, "sim_compute_sim_state": 0.025659246444702147, "sim_compute_performance-ego": 0.004323530991872152}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.5393770001350444, "get_ui_image": 0.03619761149088541, "step_physics": 0.08574165264765421, "survival_time": 14.950000000000076, "driven_lanedir": 2.318558388993804, "get_state_dump": 0.013845376173655192, "sim_render-ego": 0.006410497029622396, "get_robot_state": 0.016479337215423585, "get_duckie_state": 2.593199412027995e-06, "in-drivable-lane": 7.000000000000098, "agent_compute-ego": 0.018310646216074627, "deviation-heading": 1.391718867371063, "complete-iteration": 0.21479195197423295, "set_robot_commands": 0.004958442846934001, "deviation-center-line": 0.3549809677315663, "driven_lanedir_consec": 2.318558388993804, "sim_compute_sim_state": 0.028427122433980306, "sim_compute_performance-ego": 0.004259993235270182}}
set_robot_commands_max	0.005009926954905192
set_robot_commands_mean	0.004939689636230468
set_robot_commands_median	0.004957346121470134
set_robot_commands_min	0.004834139347076416
sim_compute_performance-ego_max	0.004323530991872152
sim_compute_performance-ego_mean	0.0041937639315923056
sim_compute_performance-ego_median	0.004197680155436197
sim_compute_performance-ego_min	0.0040561644236246745
sim_compute_sim_state_max	0.028427122433980306
sim_compute_sim_state_mean	0.025979670882225036
sim_compute_sim_state_median	0.02554014285405477
sim_compute_sim_state_min	0.024411275386810306
sim_render-ego_max	0.006410497029622396
sim_render-ego_mean	0.0062729303042093915
sim_render-ego_median	0.006279941399892171
sim_render-ego_min	0.006121341387430827
simulation-passed	1
step_physics_max	0.08574165264765421
step_physics_mean	0.08125578860441843
step_physics_median	0.0809985347588857
step_physics_min	0.07728443225224813
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43499

11684

Mo Kleit 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 06:51:19+00:00

2020-11-26 06:59:39+00:00

0:08:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.192919398041875
survival_time_median	14.950000000000076
deviation-center-line_median	0.5336163661504894
in-drivable-lane_median	4.800000000000057

other stats

agent_compute-ego_max	0.01695537249247233
agent_compute-ego_mean	0.016816198906930938
agent_compute-ego_median	0.016804752349853513
agent_compute-ego_min	0.016699918435544383
complete-iteration_max	0.19534547726313273
complete-iteration_mean	0.18820770684148175
complete-iteration_median	0.18644894838333131
complete-iteration_min	0.18458745333613183
deviation-center-line_max	0.8530403771869748
deviation-center-line_mean	0.6009250653199792
deviation-center-line_min	0.48342715179196377
deviation-heading_max	3.329157238963293
deviation-heading_mean	2.867621745546248
deviation-heading_median	2.8736875995449243
deviation-heading_min	2.3939545441318493
driven_any_max	5.795789874286726
driven_any_mean	5.526505457453938
driven_any_median	5.78909901998007
driven_any_min	4.732033915568886
driven_lanedir_consec_max	4.4836963443118645
driven_lanedir_consec_mean	3.3018609263111305
driven_lanedir_consec_min	2.3379085648489077
driven_lanedir_max	4.4836963443118645
driven_lanedir_mean	3.3064620417428374
driven_lanedir_median	3.2021216289052883
driven_lanedir_min	2.3379085648489077
get_duckie_state_max	3.772576649983724e-06
get_duckie_state_mean	3.3253917888719207e-06
get_duckie_state_median	3.2751738619642195e-06
get_duckie_state_min	2.978642781575521e-06
get_robot_state_max	0.01526543935139974
get_robot_state_mean	0.01351776736528695
get_robot_state_median	0.013161998143812428
get_robot_state_min	0.01248163382212321
get_state_dump_max	0.01381085475285848
get_state_dump_mean	0.013285741104560643
get_state_dump_median	0.013276571221903068
get_state_dump_min	0.012778967221577965
get_ui_image_max	0.033971643447875975
get_ui_image_mean	0.03308184839835783
get_ui_image_median	0.032923087230345024
get_ui_image_min	0.032509575684865316
in-drivable-lane_max	7.700000000000024
in-drivable-lane_mean	4.837500000000036
in-drivable-lane_min	2.050000000000007
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 5.789666592238392, "get_ui_image": 0.033971643447875975, "step_physics": 0.075949068069458, "survival_time": 14.950000000000076, "driven_lanedir": 4.4836963443118645, "get_state_dump": 0.01381085475285848, "sim_render-ego": 0.005992080370585124, "get_robot_state": 0.01526543935139974, "get_duckie_state": 3.772576649983724e-06, "in-drivable-lane": 2.5500000000000265, "agent_compute-ego": 0.016905592282613117, "deviation-heading": 3.329157238963293, "complete-iteration": 0.19534547726313273, "set_robot_commands": 0.004727721214294434, "deviation-center-line": 0.8530403771869748, "driven_lanedir_consec": 4.4836963443118645, "sim_compute_sim_state": 0.024587461948394777, "sim_compute_performance-ego": 0.003987939357757569}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.732033915568886, "get_ui_image": 0.032740921876868424, "step_physics": 0.07127265054352429, "survival_time": 12.25000000000004, "driven_lanedir": 3.695824058274089, "get_state_dump": 0.013485871529092594, "sim_render-ego": 0.0055779437629544, "get_robot_state": 0.01349448671146315, "get_duckie_state": 3.442958909638074e-06, "in-drivable-lane": 2.050000000000007, "agent_compute-ego": 0.016699918435544383, "deviation-heading": 2.638310693108929, "complete-iteration": 0.18458745333613183, "set_robot_commands": 0.004564265815579161, "deviation-center-line": 0.48342715179196377, "driven_lanedir_consec": 3.695824058274089, "sim_compute_sim_state": 0.02282196940207968, "sim_compute_performance-ego": 0.003782840650908801}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 5.788531447721748, "get_ui_image": 0.03310525258382162, "step_physics": 0.07378121693929036, "survival_time": 14.950000000000076, "driven_lanedir": 2.3379085648489077, "get_state_dump": 0.013067270914713542, "sim_render-ego": 0.00536961555480957, "get_robot_state": 0.012829509576161705, "get_duckie_state": 3.107388814290365e-06, "in-drivable-lane": 7.700000000000024, "agent_compute-ego": 0.016703912417093913, "deviation-heading": 3.109064505980919, "complete-iteration": 0.18461329460144044, "set_robot_commands": 0.004502622286478678, "deviation-center-line": 0.5641643784233232, "driven_lanedir_consec": 2.3379085648489077, "sim_compute_sim_state": 0.021408255100250243, "sim_compute_performance-ego": 0.0037069988250732423}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 5.795789874286726, "get_ui_image": 0.032509575684865316, "step_physics": 0.07487307469050089, "survival_time": 14.950000000000076, "driven_lanedir": 2.7084191995364875, "get_state_dump": 0.012778967221577965, "sim_render-ego": 0.005291414260864258, "get_robot_state": 0.01248163382212321, "get_duckie_state": 2.978642781575521e-06, "in-drivable-lane": 7.050000000000087, "agent_compute-ego": 0.01695537249247233, "deviation-heading": 2.3939545441318493, "complete-iteration": 0.18828460216522216, "set_robot_commands": 0.0045470468203226725, "deviation-center-line": 0.5030683538776554, "driven_lanedir_consec": 2.6900147378096606, "sim_compute_sim_state": 0.02511617739995321, "sim_compute_performance-ego": 0.0035941036542256675}}
set_robot_commands_max	0.004727721214294434
set_robot_commands_mean	0.004585414034168737
set_robot_commands_median	0.004555656317950917
set_robot_commands_min	0.004502622286478678
sim_compute_performance-ego_max	0.003987939357757569
sim_compute_performance-ego_mean	0.00376797062199132
sim_compute_performance-ego_median	0.003744919737991022
sim_compute_performance-ego_min	0.0035941036542256675
sim_compute_sim_state_max	0.02511617739995321
sim_compute_sim_state_mean	0.02348346596266947
sim_compute_sim_state_median	0.02370471567523723
sim_compute_sim_state_min	0.021408255100250243
sim_render-ego_max	0.005992080370585124
sim_render-ego_mean	0.005557763487303339
sim_render-ego_median	0.005473779658881985
sim_render-ego_min	0.005291414260864258
simulation-passed	1
step_physics_max	0.075949068069458
step_physics_mean	0.07396900256069339
step_physics_median	0.07432714581489563
step_physics_min	0.07127265054352429
survival_time_max	14.950000000000076
survival_time_mean	14.275000000000066
survival_time_min	12.25000000000004

No reset possible

43452

11676

real-exercise-2

LFv-sim

success

2020-11-26 05:18:42+00:00

2020-11-26 05:25:27+00:00

0:06:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.5746606045674203
survival_time_median	10.425000000000011
deviation-center-line_median	0.2918067970169337
in-drivable-lane_median	5.650000000000016

other stats

agent_compute-ego_max	0.017866921424865723
agent_compute-ego_mean	0.017802614966849338
agent_compute-ego_median	0.01781778130339179
agent_compute-ego_min	0.01770797583574806
complete-iteration_max	0.20329058679760012
complete-iteration_mean	0.19894780721726024
complete-iteration_median	0.19786838611412227
complete-iteration_min	0.19676386984319635
deviation-center-line_max	0.4605169763329853
deviation-center-line_mean	0.3002049587330845
deviation-center-line_min	0.15668926456548524
deviation-heading_max	2.0049563547332174
deviation-heading_mean	1.059084875681658
deviation-heading_median	0.8927958243696565
deviation-heading_min	0.4457914992541014
driven_any_max	4.2427205728640365
driven_any_mean	3.4689064306927326
driven_any_median	3.4376222892295414
driven_any_min	2.7576605714478126
driven_lanedir_consec_max	1.8142418631543455
driven_lanedir_consec_mean	1.545104792046462
driven_lanedir_consec_min	1.2168560958966617
driven_lanedir_max	1.8142418631543455
driven_lanedir_mean	1.545104792046462
driven_lanedir_median	1.5746606045674203
driven_lanedir_min	1.2168560958966617
get_duckie_state_max	2.6885200949276197e-06
get_duckie_state_mean	2.4677755745358957e-06
get_duckie_state_median	2.455871474903e-06
get_duckie_state_min	2.2708392534099643e-06
get_robot_state_max	0.015708799036140114
get_robot_state_mean	0.014709404885710008
get_robot_state_median	0.014646521252410418
get_robot_state_min	0.013835778001879082
get_state_dump_max	0.01372676614731077
get_state_dump_mean	0.01364935512177802
get_state_dump_median	0.013634023551308012
get_state_dump_min	0.013602607237185286
get_ui_image_max	0.0351611447130513
get_ui_image_mean	0.03440550670183165
get_ui_image_median	0.03447294432798576
get_ui_image_min	0.033514993438303796
in-drivable-lane_max	7.250000000000037
in-drivable-lane_mean	5.700000000000018
in-drivable-lane_min	4.250000000000004
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.7576605714478126, "get_ui_image": 0.03486310033237233, "step_physics": 0.07695015458499684, "survival_time": 8.499999999999986, "driven_lanedir": 1.2168560958966617, "get_state_dump": 0.013650387876174027, "sim_render-ego": 0.005858302116394043, "get_robot_state": 0.015135591170367071, "get_duckie_state": 2.6885200949276197e-06, "in-drivable-lane": 4.849999999999991, "agent_compute-ego": 0.017866921424865723, "deviation-heading": 0.4457914992541014, "complete-iteration": 0.19739156330333035, "set_robot_commands": 0.0048190565670237825, "deviation-center-line": 0.15668926456548524, "driven_lanedir_consec": 1.2168560958966617, "sim_compute_sim_state": 0.02414984983556411, "sim_compute_performance-ego": 0.003950605672948501}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.87267180655012, "get_ui_image": 0.0351611447130513, "step_physics": 0.08062898908924852, "survival_time": 11.700000000000031, "driven_lanedir": 1.8142418631543455, "get_state_dump": 0.013617659226441994, "sim_render-ego": 0.0064082155879746135, "get_robot_state": 0.015708799036140114, "get_duckie_state": 2.576754643366887e-06, "in-drivable-lane": 6.450000000000042, "agent_compute-ego": 0.017797727870126057, "deviation-heading": 0.7571897714949919, "complete-iteration": 0.20329058679760012, "set_robot_commands": 0.004842682781382504, "deviation-center-line": 0.24850372148007716, "driven_lanedir_consec": 1.8142418631543455, "sim_compute_sim_state": 0.024702714039729193, "sim_compute_performance-ego": 0.0042702275463658524}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.2427205728640365, "get_ui_image": 0.03408278832359919, "step_physics": 0.07944255972665454, "survival_time": 12.600000000000044, "driven_lanedir": 1.5448390780180417, "get_state_dump": 0.01372676614731077, "sim_render-ego": 0.005848306512075757, "get_robot_state": 0.014157451334453765, "get_duckie_state": 2.3349883064391123e-06, "in-drivable-lane": 7.250000000000037, "agent_compute-ego": 0.01783783473665752, "deviation-heading": 2.0049563547332174, "complete-iteration": 0.19834520892491417, "set_robot_commands": 0.004522694481743706, "deviation-center-line": 0.4605169763329853, "driven_lanedir_consec": 1.5448390780180417, "sim_compute_sim_state": 0.024713764114985392, "sim_compute_performance-ego": 0.003864015851702009}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.0025727719089628, "get_ui_image": 0.033514993438303796, "step_physics": 0.07768967503406962, "survival_time": 9.149999999999997, "driven_lanedir": 1.6044821311167994, "get_state_dump": 0.013602607237185286, "sim_render-ego": 0.005671613203371809, "get_robot_state": 0.013835778001879082, "get_duckie_state": 2.2708392534099643e-06, "in-drivable-lane": 4.250000000000004, "agent_compute-ego": 0.01770797583574806, "deviation-heading": 1.0284018772443213, "complete-iteration": 0.19676386984319635, "set_robot_commands": 0.004679808851148262, "deviation-center-line": 0.3351098725537902, "driven_lanedir_consec": 1.6044821311167994, "sim_compute_sim_state": 0.026047933297079117, "sim_compute_performance-ego": 0.003865954654464305}}
set_robot_commands_max	0.004842682781382504
set_robot_commands_mean	0.0047160606703245634
set_robot_commands_median	0.004749432709086022
set_robot_commands_min	0.004522694481743706
sim_compute_performance-ego_max	0.0042702275463658524
sim_compute_performance-ego_mean	0.003987700931370167
sim_compute_performance-ego_median	0.003908280163706403
sim_compute_performance-ego_min	0.003864015851702009
sim_compute_sim_state_max	0.026047933297079117
sim_compute_sim_state_mean	0.024903565321839453
sim_compute_sim_state_median	0.024708239077357298
sim_compute_sim_state_min	0.02414984983556411
sim_render-ego_max	0.0064082155879746135
sim_render-ego_mean	0.005946609354954055
sim_render-ego_median	0.0058533043142349
sim_render-ego_min	0.005671613203371809
simulation-passed	1
step_physics_max	0.08062898908924852
step_physics_mean	0.07867784460874239
step_physics_median	0.07856611738036208
step_physics_min	0.07695015458499684
survival_time_max	12.600000000000044
survival_time_mean	10.487500000000017
survival_time_min	8.499999999999986

No reset possible

43428

11673

Mo Kleit 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 05:02:25+00:00

2020-11-26 05:11:27+00:00

0:09:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.445552201661416
survival_time_median	14.950000000000076
deviation-center-line_median	0.5744960673953174
in-drivable-lane_median	4.350000000000037

other stats

agent_compute-ego_max	0.018238649368286133
agent_compute-ego_mean	0.017864250571040782
agent_compute-ego_median	0.01781330943107605
agent_compute-ego_min	0.017591734053724904
complete-iteration_max	0.20919914801915487
complete-iteration_mean	0.2018356832171564
complete-iteration_median	0.2009927265455494
complete-iteration_min	0.196158131758372
deviation-center-line_max	0.6972437733362954
deviation-center-line_mean	0.5564340430267467
deviation-center-line_min	0.3795002639800564
deviation-heading_max	3.0066941021489013
deviation-heading_mean	2.0114565421960204
deviation-heading_median	1.894295453748322
deviation-heading_min	1.2505411591385358
driven_any_max	5.805760629612185
driven_any_mean	5.486160943752403
driven_any_median	5.794097736607418
driven_any_min	4.550687672182595
driven_lanedir_consec_max	4.1472243947370755
driven_lanedir_consec_mean	3.179556998262359
driven_lanedir_consec_min	1.6798991949895292
driven_lanedir_max	4.1472243947370755
driven_lanedir_mean	3.179556998262359
driven_lanedir_median	3.445552201661416
driven_lanedir_min	1.6798991949895292
get_duckie_state_max	2.5804837544759117e-06
get_duckie_state_mean	2.4400255774374064e-06
get_duckie_state_median	2.4012926608155676e-06
get_duckie_state_min	2.3770332336425783e-06
get_robot_state_max	0.016415863037109374
get_robot_state_mean	0.01526668921028827
get_robot_state_median	0.015316085714404869
get_robot_state_min	0.014018722375233968
get_state_dump_max	0.013939066727956136
get_state_dump_mean	0.013749277901514777
get_state_dump_median	0.013735265556701834
get_state_dump_min	0.0135875137646993
get_ui_image_max	0.03575160106023153
get_ui_image_mean	0.034803184055339144
get_ui_image_median	0.03475114342183043
get_ui_image_min	0.033958848317464194
in-drivable-lane_max	10.100000000000058
in-drivable-lane_mean	5.400000000000034
in-drivable-lane_min	2.8000000000000034
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 5.791298683657253, "get_ui_image": 0.03575160106023153, "step_physics": 0.0833975370724996, "survival_time": 14.950000000000076, "driven_lanedir": 4.1472243947370755, "get_state_dump": 0.013939066727956136, "sim_render-ego": 0.00641606330871582, "get_robot_state": 0.016415863037109374, "get_duckie_state": 2.5804837544759117e-06, "in-drivable-lane": 3.450000000000025, "agent_compute-ego": 0.018238649368286133, "deviation-heading": 3.0066941021489013, "complete-iteration": 0.20919914801915487, "set_robot_commands": 0.005015764236450195, "deviation-center-line": 0.6438048370914388, "driven_lanedir_consec": 4.1472243947370755, "sim_compute_sim_state": 0.02560253858566284, "sim_compute_performance-ego": 0.004261114597320557}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 5.805760629612185, "get_ui_image": 0.03492492119471232, "step_physics": 0.07806080977121989, "survival_time": 14.950000000000076, "driven_lanedir": 3.604364117440067, "get_state_dump": 0.0135875137646993, "sim_render-ego": 0.0059817830721537275, "get_robot_state": 0.014982447624206544, "get_duckie_state": 2.3770332336425783e-06, "in-drivable-lane": 5.250000000000049, "agent_compute-ego": 0.017704245249430338, "deviation-heading": 1.7070771028476572, "complete-iteration": 0.19847747405370075, "set_robot_commands": 0.004705363114674886, "deviation-center-line": 0.505187297699196, "driven_lanedir_consec": 3.604364117440067, "sim_compute_sim_state": 0.024342512289683024, "sim_compute_performance-ego": 0.004030554294586181}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 5.796896789557583, "get_ui_image": 0.033958848317464194, "step_physics": 0.0784764830271403, "survival_time": 14.950000000000076, "driven_lanedir": 1.6798991949895292, "get_state_dump": 0.01369125763575236, "sim_render-ego": 0.005814904371897379, "get_robot_state": 0.014018722375233968, "get_duckie_state": 2.392133076985677e-06, "in-drivable-lane": 10.100000000000058, "agent_compute-ego": 0.01792237361272176, "deviation-heading": 1.2505411591385358, "complete-iteration": 0.196158131758372, "set_robot_commands": 0.004571333726247151, "deviation-center-line": 0.3795002639800564, "driven_lanedir_consec": 1.6798991949895292, "sim_compute_sim_state": 0.02360390822092692, "sim_compute_performance-ego": 0.003944819768269857}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.550687672182595, "get_ui_image": 0.03457736564894854, "step_physics": 0.0791495270648245, "survival_time": 11.800000000000033, "driven_lanedir": 3.2867402858827655, "get_state_dump": 0.013779273477651306, "sim_render-ego": 0.005980108754109528, "get_robot_state": 0.01564972380460319, "get_duckie_state": 2.410452244645458e-06, "in-drivable-lane": 2.8000000000000034, "agent_compute-ego": 0.017591734053724904, "deviation-heading": 2.081513804648987, "complete-iteration": 0.203507979037398, "set_robot_commands": 0.004846723402960826, "deviation-center-line": 0.6972437733362954, "driven_lanedir_consec": 3.2867402858827655, "sim_compute_sim_state": 0.0277843788518744, "sim_compute_performance-ego": 0.0039928454463764775}}
set_robot_commands_max	0.005015764236450195
set_robot_commands_mean	0.0047847961200832645
set_robot_commands_median	0.004776043258817856
set_robot_commands_min	0.004571333726247151
sim_compute_performance-ego_max	0.004261114597320557
sim_compute_performance-ego_mean	0.0040573335266382675
sim_compute_performance-ego_median	0.00401169987048133
sim_compute_performance-ego_min	0.003944819768269857
sim_compute_sim_state_max	0.0277843788518744
sim_compute_sim_state_mean	0.0253333344870368
sim_compute_sim_state_median	0.024972525437672935
sim_compute_sim_state_min	0.02360390822092692
sim_render-ego_max	0.00641606330871582
sim_render-ego_mean	0.006048214876719114
sim_render-ego_median	0.005980945913131627
sim_render-ego_min	0.005814904371897379
simulation-passed	1
step_physics_max	0.0833975370724996
step_physics_mean	0.07977108923392107
step_physics_median	0.0788130050459824
step_physics_min	0.07806080977121989
survival_time_max	14.950000000000076
survival_time_mean	14.162500000000067
survival_time_min	11.800000000000033

No reset possible

43374

11663

sim-exercise-2

LFv-sim

success

2020-11-26 04:32:27+00:00

2020-11-26 04:42:25+00:00

0:09:58

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.7410026408469887
survival_time_median	14.950000000000076
deviation-center-line_median	1.086345015861732
in-drivable-lane_median	2.3749999999999916

other stats

agent_compute-ego_max	0.01763836622238159
agent_compute-ego_mean	0.01759688973426819
agent_compute-ego_median	0.0176018484433492
agent_compute-ego_min	0.017545495827992755
complete-iteration_max	0.20646157503128051
complete-iteration_mean	0.20045876801013948
complete-iteration_median	0.19901570757230125
complete-iteration_min	0.1973420818646749
deviation-center-line_max	1.1970746970724837
deviation-center-line_mean	1.0549715285946526
deviation-center-line_min	0.8501213855826628
deviation-heading_max	3.573389481902339
deviation-heading_mean	3.0138617920377806
deviation-heading_median	3.106665198991694
deviation-heading_min	2.268727288265395
driven_any_max	4.965555789113539
driven_any_mean	4.404399946088007
driven_any_median	4.759972590128454
driven_any_min	3.13209881498158
driven_lanedir_consec_max	4.028111429411434
driven_lanedir_consec_mean	3.499391466476082
driven_lanedir_consec_min	2.4874491547989166
driven_lanedir_max	4.028111429411434
driven_lanedir_mean	3.499391466476082
driven_lanedir_median	3.7410026408469887
driven_lanedir_min	2.4874491547989166
get_duckie_state_max	2.582073211669922e-06
get_duckie_state_mean	2.5073687235514325e-06
get_duckie_state_median	2.530018488566081e-06
get_duckie_state_min	2.387364705403646e-06
get_robot_state_max	0.015697882175445557
get_robot_state_mean	0.015023065010706584
get_robot_state_median	0.01500244657198588
get_robot_state_min	0.014389484723409018
get_state_dump_max	0.01381148099899292
get_state_dump_mean	0.01366132616996765
get_state_dump_median	0.01368099053700765
get_state_dump_min	0.013471842606862386
get_ui_image_max	0.035170624256134035
get_ui_image_mean	0.034708041548728946
get_ui_image_median	0.03465681354204814
get_ui_image_min	0.03434791485468547
in-drivable-lane_max	3.4000000000000403
in-drivable-lane_mean	2.4375000000000044
in-drivable-lane_min	1.5999999999999948
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.793599418978889, "get_ui_image": 0.03434791485468547, "step_physics": 0.07760380903879802, "survival_time": 14.950000000000076, "driven_lanedir": 3.569335747061135, "get_state_dump": 0.013779935042063396, "sim_render-ego": 0.0061084794998168945, "get_robot_state": 0.015697882175445557, "get_duckie_state": 2.582073211669922e-06, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.01759614944458008, "deviation-heading": 3.573389481902339, "complete-iteration": 0.19919448057810463, "set_robot_commands": 0.004738794167836507, "deviation-center-line": 0.8501213855826628, "driven_lanedir_consec": 3.569335747061135, "sim_compute_sim_state": 0.02501977841059367, "sim_compute_performance-ego": 0.004142230351765951}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.726345761278019, "get_ui_image": 0.03436079502105713, "step_physics": 0.07704299926757813, "survival_time": 14.950000000000076, "driven_lanedir": 3.912669534632842, "get_state_dump": 0.01381148099899292, "sim_render-ego": 0.0061133464177449545, "get_robot_state": 0.014983828862508135, "get_duckie_state": 2.5121370951334636e-06, "in-drivable-lane": 1.5999999999999948, "agent_compute-ego": 0.01763836622238159, "deviation-heading": 3.049470042191438, "complete-iteration": 0.1973420818646749, "set_robot_commands": 0.004606021245320638, "deviation-center-line": 1.0262969053514623, "driven_lanedir_consec": 3.912669534632842, "sim_compute_sim_state": 0.024457611242930093, "sim_compute_performance-ego": 0.004163371721903483}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.13209881498158, "get_ui_image": 0.035170624256134035, "step_physics": 0.07973337729771932, "survival_time": 14.950000000000076, "driven_lanedir": 2.4874491547989166, "get_state_dump": 0.013582046031951903, "sim_render-ego": 0.005812820593516032, "get_robot_state": 0.014389484723409018, "get_duckie_state": 2.547899881998698e-06, "in-drivable-lane": 3.4000000000000403, "agent_compute-ego": 0.017607547442118326, "deviation-heading": 3.1638603557919502, "complete-iteration": 0.1988369345664978, "set_robot_commands": 0.004587686061859131, "deviation-center-line": 1.1463931263720015, "driven_lanedir_consec": 2.4874491547989166, "sim_compute_sim_state": 0.02387605905532837, "sim_compute_performance-ego": 0.003918031056722005}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.965555789113539, "get_ui_image": 0.034952832063039146, "step_physics": 0.08231949249903361, "survival_time": 14.950000000000076, "driven_lanedir": 4.028111429411434, "get_state_dump": 0.013471842606862386, "sim_render-ego": 0.005962575276692708, "get_robot_state": 0.015021064281463624, "get_duckie_state": 2.387364705403646e-06, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.017545495827992755, "deviation-heading": 2.268727288265395, "complete-iteration": 0.20646157503128051, "set_robot_commands": 0.00475167989730835, "deviation-center-line": 1.1970746970724837, "driven_lanedir_consec": 4.028111429411434, "sim_compute_sim_state": 0.028137639363606772, "sim_compute_performance-ego": 0.004138607184092204}}
set_robot_commands_max	0.00475167989730835
set_robot_commands_mean	0.004671045343081157
set_robot_commands_median	0.0046724077065785725
set_robot_commands_min	0.004587686061859131
sim_compute_performance-ego_max	0.004163371721903483
sim_compute_performance-ego_mean	0.00409056007862091
sim_compute_performance-ego_median	0.004140418767929078
sim_compute_performance-ego_min	0.003918031056722005
sim_compute_sim_state_max	0.028137639363606772
sim_compute_sim_state_mean	0.025372772018114727
sim_compute_sim_state_median	0.02473869482676188
sim_compute_sim_state_min	0.02387605905532837
sim_render-ego_max	0.0061133464177449545
sim_render-ego_mean	0.005999305446942647
sim_render-ego_median	0.006035527388254801
sim_render-ego_min	0.005812820593516032
simulation-passed	1
step_physics_max	0.08231949249903361
step_physics_mean	0.07917491952578226
step_physics_median	0.07866859316825867
step_physics_min	0.07704299926757813
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43350

11663

sim-exercise-2

LFv-sim

timeout

2020-11-26 04:24:15+00:00

2020-11-26 04:24:23+00:00

0:00:08

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43349

11663

sim-exercise-2

LFv-sim

timeout

2020-11-26 04:23:36+00:00

2020-11-26 04:24:05+00:00

0:00:29

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43338

11661

Dishank Bansal 🇨🇦

exercise_state_estimation

LFv-sim

success

2020-11-26 04:03:08+00:00

2020-11-26 04:12:15+00:00

0:09:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.9351960438823266
survival_time_median	14.950000000000076
deviation-center-line_median	0.6258231438909649
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.017344706058502198
agent_compute-ego_mean	0.017262578805287677
agent_compute-ego_median	0.017317951122919718
agent_compute-ego_min	0.01706970691680908
complete-iteration_max	0.20395006974538168
complete-iteration_mean	0.19002224206924437
complete-iteration_median	0.1890351923306783
complete-iteration_min	0.17806851387023925
deviation-center-line_max	0.7701204184543032
deviation-center-line_mean	0.643551805400004
deviation-center-line_min	0.552440515363783
deviation-heading_max	3.975975933251944
deviation-heading_mean	2.616885890308913
deviation-heading_median	2.2012597179121616
deviation-heading_min	2.0890481921593853
driven_any_max	3.0463291478347574
driven_any_mean	2.8528692745402235
driven_any_median	2.9792818810480615
driven_any_min	2.4065841882300134
driven_lanedir_consec_max	3.004534985899274
driven_lanedir_consec_mean	2.7944210389912567
driven_lanedir_consec_min	2.3027570823011008
driven_lanedir_max	3.004534985899274
driven_lanedir_mean	2.7944210389912567
driven_lanedir_median	2.9351960438823266
driven_lanedir_min	2.3027570823011008
get_duckie_state_max	3.239313761393229e-06
get_duckie_state_mean	3.180106480916341e-06
get_duckie_state_median	3.191232681274414e-06
get_duckie_state_min	3.098646799723307e-06
get_robot_state_max	0.015146590868632
get_robot_state_mean	0.013954372803370158
get_robot_state_median	0.01408792495727539
get_robot_state_min	0.012495050430297852
get_state_dump_max	0.013642760117848714
get_state_dump_mean	0.013302807410558065
get_state_dump_median	0.013335907856623332
get_state_dump_min	0.01289665381113688
get_ui_image_max	0.03471790949503581
get_ui_image_mean	0.03338552971680959
get_ui_image_median	0.03339584509531657
get_ui_image_min	0.032032519181569415
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.0458427227168663, "get_ui_image": 0.032032519181569415, "step_physics": 0.06840530633926392, "survival_time": 14.950000000000076, "driven_lanedir": 2.9967805091404416, "get_state_dump": 0.01289665381113688, "sim_render-ego": 0.005324412981669108, "get_robot_state": 0.012495050430297852, "get_duckie_state": 3.098646799723307e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017303276062011718, "deviation-heading": 2.181682908050549, "complete-iteration": 0.17806851387023925, "set_robot_commands": 0.0043716867764790855, "deviation-center-line": 0.6294219632419523, "driven_lanedir_consec": 2.9967805091404416, "sim_compute_sim_state": 0.021560537815093993, "sim_compute_performance-ego": 0.003539234797159831}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.0463291478347574, "get_ui_image": 0.032520322799682616, "step_physics": 0.06982782999674479, "survival_time": 14.950000000000076, "driven_lanedir": 3.004534985899274, "get_state_dump": 0.0130881134668986, "sim_render-ego": 0.005623819828033447, "get_robot_state": 0.014431842962900798, "get_duckie_state": 3.166993459065755e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01706970691680908, "deviation-heading": 2.2208365277737743, "complete-iteration": 0.18284340461095175, "set_robot_commands": 0.0047047869364420574, "deviation-center-line": 0.552440515363783, "driven_lanedir_consec": 3.004534985899274, "sim_compute_sim_state": 0.021703004042307537, "sim_compute_performance-ego": 0.003723093668619792}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.4065841882300134, "get_ui_image": 0.03427136739095052, "step_physics": 0.07691235780715942, "survival_time": 14.950000000000076, "driven_lanedir": 2.3027570823011008, "get_state_dump": 0.013642760117848714, "sim_render-ego": 0.005841407775878906, "get_robot_state": 0.015146590868632, "get_duckie_state": 3.239313761393229e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017332626183827717, "deviation-heading": 3.975975933251944, "complete-iteration": 0.19522698005040487, "set_robot_commands": 0.00475400447845459, "deviation-center-line": 0.6222243245399776, "driven_lanedir_consec": 2.3027570823011008, "sim_compute_sim_state": 0.0231618865331014, "sim_compute_performance-ego": 0.004008211294809977}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.912721039379256, "get_ui_image": 0.03471790949503581, "step_physics": 0.08421172221501669, "survival_time": 14.950000000000076, "driven_lanedir": 2.873611578624212, "get_state_dump": 0.013583702246348065, "sim_render-ego": 0.005630082289377849, "get_robot_state": 0.013744006951649984, "get_duckie_state": 3.215471903483073e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017344706058502198, "deviation-heading": 2.0890481921593853, "complete-iteration": 0.20395006974538168, "set_robot_commands": 0.00456084410349528, "deviation-center-line": 0.7701204184543032, "driven_lanedir_consec": 2.873611578624212, "sim_compute_sim_state": 0.02622894525527954, "sim_compute_performance-ego": 0.003770420551300049}}
set_robot_commands_max	0.00475400447845459
set_robot_commands_mean	0.004597830573717754
set_robot_commands_median	0.004632815519968669
set_robot_commands_min	0.0043716867764790855
sim_compute_performance-ego_max	0.004008211294809977
sim_compute_performance-ego_mean	0.003760240077972412
sim_compute_performance-ego_median	0.00374675710995992
sim_compute_performance-ego_min	0.003539234797159831
sim_compute_sim_state_max	0.02622894525527954
sim_compute_sim_state_mean	0.023163593411445617
sim_compute_sim_state_median	0.022432445287704467
sim_compute_sim_state_min	0.021560537815093993
sim_render-ego_max	0.005841407775878906
sim_render-ego_mean	0.005604930718739827
sim_render-ego_median	0.005626951058705648
sim_render-ego_min	0.005324412981669108
simulation-passed	1
step_physics_max	0.08421172221501669
step_physics_mean	0.0748393040895462
step_physics_median	0.07337009390195211
step_physics_min	0.06840530633926392
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43311

11658

Philippe Reddy 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 03:14:12+00:00

2020-11-26 03:22:56+00:00

0:08:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.968787950607
survival_time_median	14.150000000000066
deviation-center-line_median	0.6855749786640856
in-drivable-lane_median	3.950000000000036

other stats

agent_compute-ego_max	0.017917507150199977
agent_compute-ego_mean	0.017630181651335793
agent_compute-ego_median	0.017672876172095724
agent_compute-ego_min	0.017257467110951743
complete-iteration_max	0.20986225020210697
complete-iteration_mean	0.2023951883666398
complete-iteration_median	0.20439698860439912
complete-iteration_min	0.19092452605565388
deviation-center-line_max	0.7975397590635097
deviation-center-line_mean	0.5654101459803424
deviation-center-line_min	0.09295086752968884
deviation-heading_max	3.5268044943110812
deviation-heading_mean	2.2969962014182035
deviation-heading_median	2.621015600173892
deviation-heading_min	0.41914911101395
driven_any_max	4.849333798277733
driven_any_mean	3.692110797336776
driven_any_median	4.58386990925345
driven_any_min	0.7513695725624707
driven_lanedir_consec_max	3.113378549620076
driven_lanedir_consec_mean	2.4108840219890015
driven_lanedir_consec_min	0.5925816371219299
driven_lanedir_max	3.113378549620076
driven_lanedir_mean	2.418921549714523
driven_lanedir_median	2.984863006058043
driven_lanedir_min	0.5925816371219299
get_duckie_state_max	3.0664022495684108e-06
get_duckie_state_mean	2.9069583716388138e-06
get_duckie_state_median	2.9491478542111954e-06
get_duckie_state_min	2.663135528564453e-06
get_robot_state_max	0.016501015045223166
get_robot_state_mean	0.015362143813405438
get_robot_state_median	0.015596519101340816
get_robot_state_min	0.01375452200571696
get_state_dump_max	0.01370522661029168
get_state_dump_mean	0.013559925579306988
get_state_dump_median	0.01356734636571077
get_state_dump_min	0.01339978297551473
get_ui_image_max	0.03766310889765902
get_ui_image_mean	0.03527091423594634
get_ui_image_median	0.03501915554428815
get_ui_image_min	0.03338223695755005
in-drivable-lane_max	4.850000000000025
in-drivable-lane_mean	3.287500000000024
in-drivable-lane_min	0.3999999999999986
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.7513695725624707, "get_ui_image": 0.03766310889765902, "step_physics": 0.08480465187216704, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5925816371219299, "get_state_dump": 0.01370522661029168, "sim_render-ego": 0.006462893396053674, "get_robot_state": 0.015899559236922354, "get_duckie_state": 3.0229676444575473e-06, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.01780190557803748, "deviation-heading": 0.41914911101395, "complete-iteration": 0.20986225020210697, "set_robot_commands": 0.004812155129774561, "deviation-center-line": 0.09295086752968884, "driven_lanedir_consec": 0.5925816371219299, "sim_compute_sim_state": 0.024210749932055204, "sim_compute_performance-ego": 0.0043505002867500735}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.318513087037129, "get_ui_image": 0.035611069604252164, "step_physics": 0.08153061027383983, "survival_time": 13.350000000000056, "driven_lanedir": 3.113378549620076, "get_state_dump": 0.013690819008073556, "sim_render-ego": 0.006253005860003639, "get_robot_state": 0.016501015045223166, "get_duckie_state": 3.0664022495684108e-06, "in-drivable-lane": 3.200000000000027, "agent_compute-ego": 0.017917507150199977, "deviation-heading": 2.346321483520021, "complete-iteration": 0.2059405582227957, "set_robot_commands": 0.004995822906494141, "deviation-center-line": 0.618736123251449, "driven_lanedir_consec": 3.113378549620076, "sim_compute_sim_state": 0.02502017164051756, "sim_compute_performance-ego": 0.004269150758950451}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.849226731469772, "get_ui_image": 0.03338223695755005, "step_physics": 0.07424528121948243, "survival_time": 14.950000000000076, "driven_lanedir": 3.0290241318871347, "get_state_dump": 0.013443873723347982, "sim_render-ego": 0.005772635142008464, "get_robot_state": 0.01375452200571696, "get_duckie_state": 2.875328063964844e-06, "in-drivable-lane": 4.850000000000025, "agent_compute-ego": 0.017543846766153972, "deviation-heading": 2.8957097168277626, "complete-iteration": 0.19092452605565388, "set_robot_commands": 0.004592929681142171, "deviation-center-line": 0.7524138340767221, "driven_lanedir_consec": 3.0290241318871347, "sim_compute_sim_state": 0.024191044171651205, "sim_compute_performance-ego": 0.003858819007873535}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.849333798277733, "get_ui_image": 0.03442724148432414, "step_physics": 0.0811245322227478, "survival_time": 14.950000000000076, "driven_lanedir": 2.940701880228951, "get_state_dump": 0.01339978297551473, "sim_render-ego": 0.005790698528289795, "get_robot_state": 0.015293478965759276, "get_duckie_state": 2.663135528564453e-06, "in-drivable-lane": 4.7000000000000455, "agent_compute-ego": 0.017257467110951743, "deviation-heading": 3.5268044943110812, "complete-iteration": 0.2028534189860026, "set_robot_commands": 0.004736403624216716, "deviation-center-line": 0.7975397590635097, "driven_lanedir_consec": 2.9085517693268654, "sim_compute_sim_state": 0.026793455282847087, "sim_compute_performance-ego": 0.003892461458841959}}
set_robot_commands_max	0.004995822906494141
set_robot_commands_mean	0.004784327835406897
set_robot_commands_median	0.004774279376995639
set_robot_commands_min	0.004592929681142171
sim_compute_performance-ego_max	0.0043505002867500735
sim_compute_performance-ego_mean	0.004092732878104005
sim_compute_performance-ego_median	0.004080806108896206
sim_compute_performance-ego_min	0.003858819007873535
sim_compute_sim_state_max	0.026793455282847087
sim_compute_sim_state_mean	0.025053855256767763
sim_compute_sim_state_median	0.024615460786286385
sim_compute_sim_state_min	0.024191044171651205
sim_render-ego_max	0.006462893396053674
sim_render-ego_mean	0.0060698082315888925
sim_render-ego_median	0.006021852194146717
sim_render-ego_min	0.005772635142008464
simulation-passed	1
step_physics_max	0.08480465187216704
step_physics_mean	0.08042626889705927
step_physics_median	0.08132757124829382
step_physics_min	0.07424528121948243
survival_time_max	14.950000000000076
survival_time_mean	11.475000000000051
survival_time_min	2.6499999999999986

No reset possible

43278

11653

exercise_state_estimation

LFv-sim

success

2020-11-26 02:41:42+00:00

2020-11-26 02:50:51+00:00

0:09:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.4716448302479477
survival_time_median	14.950000000000076
deviation-center-line_median	0.8431967380713924
in-drivable-lane_median	1.600000000000014

other stats

agent_compute-ego_max	0.017813174724578856
agent_compute-ego_mean	0.01756332000096639
agent_compute-ego_median	0.017528334856033327
agent_compute-ego_min	0.01738343556722005
complete-iteration_max	0.20410404761632284
complete-iteration_mean	0.19670292715231577
complete-iteration_median	0.19626954277356468
complete-iteration_min	0.19016857544581095
deviation-center-line_max	1.0402149428844016
deviation-center-line_mean	0.8185231516410097
deviation-center-line_min	0.5474841875368527
deviation-heading_max	4.806889003159855
deviation-heading_mean	3.665858605934292
deviation-heading_median	3.571026547173422
deviation-heading_min	2.71449232623047
driven_any_max	3.0954727652069676
driven_any_mean	2.9867579552643733
driven_any_median	2.990786970824006
driven_any_min	2.869985114202512
driven_lanedir_consec_max	2.735663409376325
driven_lanedir_consec_mean	2.4294215344905488
driven_lanedir_consec_min	2.038733068089975
driven_lanedir_max	2.735663409376325
driven_lanedir_mean	2.4550937355051
driven_lanedir_median	2.522989232277051
driven_lanedir_min	2.038733068089975
get_duckie_state_max	2.628167470296224e-06
get_duckie_state_mean	2.469817797342936e-06
get_duckie_state_median	2.4441878000895183e-06
get_duckie_state_min	2.3627281188964844e-06
get_robot_state_max	0.014784719944000244
get_robot_state_mean	0.014279274543126424
get_robot_state_median	0.014158705075581868
get_robot_state_min	0.014014968077341716
get_state_dump_max	0.013692714373270671
get_state_dump_mean	0.01355854094028473
get_state_dump_median	0.01356617291768392
get_state_dump_min	0.013409103552500409
get_ui_image_max	0.03523099978764852
get_ui_image_mean	0.03416609366734823
get_ui_image_median	0.03401103893915812
get_ui_image_min	0.03341129700342814
in-drivable-lane_max	2.850000000000014
in-drivable-lane_mean	1.7125000000000132
in-drivable-lane_min	0.8000000000000114
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.0954727652069676, "get_ui_image": 0.03341129700342814, "step_physics": 0.07433829228083293, "survival_time": 14.950000000000076, "driven_lanedir": 2.5441622643889037, "get_state_dump": 0.013596991697947184, "sim_render-ego": 0.005698912143707276, "get_robot_state": 0.014279005527496336, "get_duckie_state": 2.628167470296224e-06, "in-drivable-lane": 1.6500000000000057, "agent_compute-ego": 0.01738343556722005, "deviation-heading": 3.281224707538576, "complete-iteration": 0.19100282192230225, "set_robot_commands": 0.004581464131673177, "deviation-center-line": 0.8978778794143801, "driven_lanedir_consec": 2.5441622643889037, "sim_compute_sim_state": 0.023729082743326822, "sim_compute_performance-ego": 0.0038307420412699382}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.9583709580026967, "get_ui_image": 0.03373460054397583, "step_physics": 0.07445128758748372, "survival_time": 14.950000000000076, "driven_lanedir": 2.735663409376325, "get_state_dump": 0.013409103552500409, "sim_render-ego": 0.005700829823811849, "get_robot_state": 0.0140384046236674, "get_duckie_state": 2.419153849283854e-06, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.017474924723307292, "deviation-heading": 2.71449232623047, "complete-iteration": 0.19016857544581095, "set_robot_commands": 0.004504789511362711, "deviation-center-line": 0.7885155967284047, "driven_lanedir_consec": 2.735663409376325, "sim_compute_sim_state": 0.022856777509053548, "sim_compute_performance-ego": 0.0038458808263142903}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.869985114202512, "get_ui_image": 0.03523099978764852, "step_physics": 0.08116045792897543, "survival_time": 14.950000000000076, "driven_lanedir": 2.038733068089975, "get_state_dump": 0.013692714373270671, "sim_render-ego": 0.005952314535776774, "get_robot_state": 0.014784719944000244, "get_duckie_state": 2.4692217508951825e-06, "in-drivable-lane": 2.850000000000014, "agent_compute-ego": 0.017813174724578856, "deviation-heading": 4.806889003159855, "complete-iteration": 0.20153626362482707, "set_robot_commands": 0.004757872422536214, "deviation-center-line": 1.0402149428844016, "driven_lanedir_consec": 2.038733068089975, "sim_compute_sim_state": 0.02397774298985799, "sim_compute_performance-ego": 0.00400924285252889}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.023202983645316, "get_ui_image": 0.03428747733434041, "step_physics": 0.08306384881337484, "survival_time": 14.950000000000076, "driven_lanedir": 2.5018162001651976, "get_state_dump": 0.013535354137420654, "sim_render-ego": 0.006015528837839762, "get_robot_state": 0.014014968077341716, "get_duckie_state": 2.3627281188964844e-06, "in-drivable-lane": 1.550000000000022, "agent_compute-ego": 0.01758174498875936, "deviation-heading": 3.8608283868082673, "complete-iteration": 0.20410404761632284, "set_robot_commands": 0.004626113573710124, "deviation-center-line": 0.5474841875368527, "driven_lanedir_consec": 2.3991273961069917, "sim_compute_sim_state": 0.026928171316782632, "sim_compute_performance-ego": 0.003898865381876627}}
set_robot_commands_max	0.004757872422536214
set_robot_commands_mean	0.004617559909820556
set_robot_commands_median	0.004603788852691651
set_robot_commands_min	0.004504789511362711
sim_compute_performance-ego_max	0.00400924285252889
sim_compute_performance-ego_mean	0.003896182775497437
sim_compute_performance-ego_median	0.003872373104095459
sim_compute_performance-ego_min	0.0038307420412699382
sim_compute_sim_state_max	0.026928171316782632
sim_compute_sim_state_mean	0.02437294363975525
sim_compute_sim_state_median	0.023853412866592406
sim_compute_sim_state_min	0.022856777509053548
sim_render-ego_max	0.006015528837839762
sim_render-ego_mean	0.005841896335283915
sim_render-ego_median	0.005826572179794312
sim_render-ego_min	0.005698912143707276
simulation-passed	1
step_physics_max	0.08306384881337484
step_physics_mean	0.07825347165266672
step_physics_median	0.07780587275822957
step_physics_min	0.07433829228083293
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43230

11642

Mo Kleit 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-26 01:01:09+00:00

2020-11-26 01:09:29+00:00

0:08:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.387697176226111
survival_time_median	14.950000000000076
deviation-center-line_median	0.5082068266727116
in-drivable-lane_median	3.2250000000000267

other stats

agent_compute-ego_max	0.017750468254089356
agent_compute-ego_mean	0.017344043834568702
agent_compute-ego_median	0.017344558603687374
agent_compute-ego_min	0.01693658987681071
complete-iteration_max	0.20593605847119195
complete-iteration_mean	0.19412510656058513
complete-iteration_median	0.19536321123441056
complete-iteration_min	0.17983794530232747
deviation-center-line_max	0.7576562319419835
deviation-center-line_mean	0.4989334232582886
deviation-center-line_min	0.2216638077457478
deviation-heading_max	3.239854066262189
deviation-heading_mean	1.8874555750299415
deviation-heading_median	1.9293617891431691
deviation-heading_min	0.4512446555712396
driven_any_max	3.879642573126657
driven_any_mean	3.610860629733703
driven_any_median	3.8731197940450826
driven_any_min	2.81756035771799
driven_lanedir_consec_max	3.386938855214217
driven_lanedir_consec_mean	2.205664182189209
driven_lanedir_consec_min	0.6603235210903976
driven_lanedir_max	3.386938855214217
driven_lanedir_mean	2.205664182189209
driven_lanedir_median	2.387697176226111
driven_lanedir_min	0.6603235210903976
get_duckie_state_max	2.437432607014974e-06
get_duckie_state_mean	2.3331108702916533e-06
get_duckie_state_median	2.308659357567356e-06
get_duckie_state_min	2.277692159016927e-06
get_robot_state_max	0.015019258658091228
get_robot_state_mean	0.014014478146213372
get_robot_state_median	0.014054620701428416
get_robot_state_min	0.012929412523905436
get_state_dump_max	0.013646375098729242
get_state_dump_mean	0.013377219974722491
get_state_dump_median	0.01343810518582662
get_state_dump_min	0.012986294428507489
get_ui_image_max	0.03502862612406413
get_ui_image_mean	0.03378516824822447
get_ui_image_median	0.03399169786335671
get_ui_image_min	0.03212865114212036
in-drivable-lane_max	12.05000000000008
in-drivable-lane_mean	4.937500000000037
in-drivable-lane_min	1.2500000000000178
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.8670220034067193, "get_ui_image": 0.03212865114212036, "step_physics": 0.06878455718358358, "survival_time": 14.950000000000076, "driven_lanedir": 2.4844581155426666, "get_state_dump": 0.012986294428507489, "sim_render-ego": 0.005311325391133626, "get_robot_state": 0.012929412523905436, "get_duckie_state": 2.3245811462402344e-06, "in-drivable-lane": 4.600000000000027, "agent_compute-ego": 0.01693658987681071, "deviation-heading": 2.6542746501531167, "complete-iteration": 0.17983794530232747, "set_robot_commands": 0.004622616767883301, "deviation-center-line": 0.5868422928714943, "driven_lanedir_consec": 2.4844581155426666, "sim_compute_sim_state": 0.0223598051071167, "sim_compute_performance-ego": 0.0036438425381978353}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.879642573126657, "get_ui_image": 0.033015488783518475, "step_physics": 0.07239051500956217, "survival_time": 14.950000000000076, "driven_lanedir": 3.386938855214217, "get_state_dump": 0.013534142971038818, "sim_render-ego": 0.005829379558563232, "get_robot_state": 0.015019258658091228, "get_duckie_state": 2.277692159016927e-06, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.017323326269785562, "deviation-heading": 3.239854066262189, "complete-iteration": 0.18874135335286457, "set_robot_commands": 0.004801375071207682, "deviation-center-line": 0.7576562319419835, "driven_lanedir_consec": 3.386938855214217, "sim_compute_sim_state": 0.022792795499165852, "sim_compute_performance-ego": 0.0038927515347798665}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.879217584683446, "get_ui_image": 0.03502862612406413, "step_physics": 0.08319746494293213, "survival_time": 14.950000000000076, "driven_lanedir": 0.6603235210903976, "get_state_dump": 0.01334206740061442, "sim_render-ego": 0.005728075504302979, "get_robot_state": 0.014186755816141764, "get_duckie_state": 2.437432607014974e-06, "in-drivable-lane": 12.05000000000008, "agent_compute-ego": 0.017750468254089356, "deviation-heading": 0.4512446555712396, "complete-iteration": 0.20198506911595665, "set_robot_commands": 0.004513671398162842, "deviation-center-line": 0.2216638077457478, "driven_lanedir_consec": 0.6603235210903976, "sim_compute_sim_state": 0.024251660505930583, "sim_compute_performance-ego": 0.0038440044720967617}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.81756035771799, "get_ui_image": 0.034967906943194946, "step_physics": 0.08542866793941689, "survival_time": 10.95000000000002, "driven_lanedir": 2.2909362369095554, "get_state_dump": 0.013646375098729242, "sim_render-ego": 0.005694048589767386, "get_robot_state": 0.01392248558671507, "get_duckie_state": 2.292737568894478e-06, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.017365790937589182, "deviation-heading": 1.2044489281332214, "complete-iteration": 0.20593605847119195, "set_robot_commands": 0.0045321401395754185, "deviation-center-line": 0.4295713604739288, "driven_lanedir_consec": 2.2909362369095554, "sim_compute_sim_state": 0.026411863222514112, "sim_compute_performance-ego": 0.003822522620632224}}
set_robot_commands_max	0.004801375071207682
set_robot_commands_mean	0.004617450844207311
set_robot_commands_median	0.00457737845372936
set_robot_commands_min	0.004513671398162842
sim_compute_performance-ego_max	0.0038927515347798665
sim_compute_performance-ego_mean	0.003800780291426672
sim_compute_performance-ego_median	0.0038332635463644927
sim_compute_performance-ego_min	0.0036438425381978353
sim_compute_sim_state_max	0.026411863222514112
sim_compute_sim_state_mean	0.023954031083681812
sim_compute_sim_state_median	0.023522228002548214
sim_compute_sim_state_min	0.0223598051071167
sim_render-ego_max	0.005829379558563232
sim_render-ego_mean	0.005640707260941806
sim_render-ego_median	0.005711062047035182
sim_render-ego_min	0.005311325391133626
simulation-passed	1
step_physics_max	0.08542866793941689
step_physics_mean	0.07745030126887369
step_physics_median	0.07779398997624715
step_physics_min	0.06878455718358358
survival_time_max	14.950000000000076
survival_time_mean	13.950000000000063
survival_time_min	10.95000000000002

No reset possible

43219

11638

Dishank Bansal 🇨🇦

exercise_state_estimation

LFv-sim

failed

2020-11-26 00:25:22+00:00

2020-11-26 00:32:28+00:00

0:07:06

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 710 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43180

11627

Philippe Reddy 🇨🇦

sim-exercise-2

LFv-sim

host-error

2020-11-25 22:59:32+00:00

2020-11-25 23:07:53+00:00

0:08:21

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 888, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1388, in write_logs
    services2id: Dict[str, str] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 943, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [a450f63b3db284633773e90ad288d9998498e10b45eec3509586b884bb813bd3,
│                 e22e7c57c3ef774448723ec79c14319d31780eb9645c0850109f90a0027248d3,
│                 90bf6894beaf56c212a259dcca52febe3c0826849317bdb5f411b8454df65ab0]
│      services: dict[4]
│                │ solution:
│                │ dict[5]
│                │ │ image: docker.io/phred123/aido-submissions@sha256:c93f6c6082afcb480f816a770a6d8d9ce88b8f79bbf6e4c58f4feaac3081c9f3
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/phred123/aido-submissions:2020_11_25_22_56_55@sha256:c93f6c6082afcb480f816a770a6d8d9ce88b8f79bbf6e4c58f4feaac3081c9f3
│                │ │ │ username: aido
│                │ │ │ uid: 0
│                │ │ │ USER: aido
│                │ │ │ HOME: /fake-home/aido
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11627/LFv-sim-mont02-abacdf59f1e2-1-job43180-a-wd:/challenges:rw,
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11627/LFv-sim-mont02-abacdf59f1e2-1-job43180-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-aido-home:/fake-home/aido:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ evaluator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-experiment_manager@sha256:48f0b2f34825d15848c3060740ab95a99254d233959586b75aeedf03f1ed5832
│                │ │ environment:
│                │ │ dict[8]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 15.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |
│                │ │ │ |port: 10123 # visualization port
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/phred123/aido-submissions:2020_11_25_22_56_55@sha256:c93f6c6082afcb480f816a770a6d8d9ce88b8f79bbf6e4c58f4feaac3081c9f3
│                │ │ │ username: aido
│                │ │ │ uid: 0
│                │ │ │ USER: aido
│                │ │ │ HOME: /fake-home/aido
│                │ │ ports: [10123]
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11627/LFv-sim-mont02-abacdf59f1e2-1-job43180-a-wd:/challenges:rw,
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11627/LFv-sim-mont02-abacdf59f1e2-1-job43180-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-aido-home:/fake-home/aido:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[5]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:953ba9f1437e3f267db1f4ff2e58340de33f6c207283f26def16fc8612b9506e
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/phred123/aido-submissions:2020_11_25_22_56_55@sha256:c93f6c6082afcb480f816a770a6d8d9ce88b8f79bbf6e4c58f4feaac3081c9f3
│                │ │ │ username: aido
│                │ │ │ uid: 0
│                │ │ │ USER: aido
│                │ │ │ HOME: /fake-home/aido
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11627/LFv-sim-mont02-abacdf59f1e2-1-job43180-a-wd:/challenges:rw,
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11627/LFv-sim-mont02-abacdf59f1e2-1-job43180-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-aido-home:/fake-home/aido:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ scenario_maker:
│                │ dict[5]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-scenario_maker@sha256:1562e17ba46090cdedbe68b8584827f1b3730f2786f6abd52e8790b4f0f1e63c
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |maps:
│                │ │ │ |- ETHZ_autolab_technical_track
│                │ │ │ |scenarios_per_map: 4
│                │ │ │ |robots_npcs: []
│                │ │ │ |robots_pcs: [ego]
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/scenario_maker-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/scenario_maker-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ SUBMISSION_CONTAINER: docker.io/phred123/aido-submissions:2020_11_25_22_56_55@sha256:c93f6c6082afcb480f816a770a6d8d9ce88b8f79bbf6e4c58f4feaac3081c9f3
│                │ │ │ username: aido
│                │ │ │ uid: 0
│                │ │ │ USER: aido
│                │ │ │ HOME: /fake-home/aido
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11627/LFv-sim-mont02-abacdf59f1e2-1-job43180-a-wd:/challenges:rw,
│                │ │  /mnt/Data/duckietown-tmp-evals/production/aido5-LF-sim-validation/submission11627/LFv-sim-mont02-abacdf59f1e2-1-job43180-a-fifos:/fifos:rw,
│                │ │  /tmp/fake-aido-home:/fake-home/aido:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[3]
│                │ evaluator: a450f63b3db284633773e90ad288d9998498e10b45eec3509586b884bb813bd3
│                │ simulator: e22e7c57c3ef774448723ec79c14319d31780eb9645c0850109f90a0027248d3
│                │ solution: 90bf6894beaf56c212a259dcca52febe3c0826849317bdb5f411b8454df65ab0
│         names: dict[3]
│                │ a450f63b3db284633773e90ad288d9998498e10b45eec3509586b884bb813bd3: mont02-abacdf59f1e2-1-job43180-285900_evaluator_1
│                │ e22e7c57c3ef774448723ec79c14319d31780eb9645c0850109f90a0027248d3: mont02-abacdf59f1e2-1-job43180-285900_simulator_1
│                │ 90bf6894beaf56c212a259dcca52febe3c0826849317bdb5f411b8454df65ab0: mont02-abacdf59f1e2-1-job43180-285900_solution_1

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43164

11624

Anthony Courchesne 🇨🇦

TNetR1

LFv-sim

success

2020-11-25 22:51:51+00:00

2020-11-25 22:58:44+00:00

0:06:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.1723375251202572
survival_time_median	11.825000000000031
deviation-center-line_median	1.0407763728271129
in-drivable-lane_median	0.2499999999999991

other stats

agent_compute-ego_max	0.0468419082959493
agent_compute-ego_mean	0.04217432340751878
agent_compute-ego_median	0.04084115551967247
agent_compute-ego_min	0.04017307429478086
complete-iteration_max	0.21667907284755333
complete-iteration_mean	0.21245156490980088
complete-iteration_median	0.21488372842470804
complete-iteration_min	0.20335972994223409
deviation-center-line_max	1.3365768877475523
deviation-center-line_mean	0.9041709926648138
deviation-center-line_min	0.19855433725747657
deviation-heading_max	3.07260386450351
deviation-heading_mean	1.8950338156487336
deviation-heading_median	2.022369286025278
deviation-heading_min	0.4627928260408683
driven_any_max	2.983935930896548
driven_any_mean	2.0003771999181894
driven_any_median	2.292954054595174
driven_any_min	0.43166475958586104
driven_lanedir_consec_max	2.9256530033254275
driven_lanedir_consec_mean	1.8969389778665664
driven_lanedir_consec_min	0.317427857900324
driven_lanedir_max	2.9256530033254275
driven_lanedir_mean	1.8969389778665664
driven_lanedir_median	2.1723375251202572
driven_lanedir_min	0.317427857900324
get_duckie_state_max	2.501805623372396e-06
get_duckie_state_mean	2.390090640611629e-06
get_duckie_state_median	2.3741815604415592e-06
get_duckie_state_min	2.3101938181910023e-06
get_robot_state_max	0.014848679701487224
get_robot_state_mean	0.013771851580637866
get_robot_state_median	0.01361423090392468
get_robot_state_min	0.013010264813214883
get_state_dump_max	0.013269513261084463
get_state_dump_mean	0.013070456880101326
get_state_dump_median	0.013110776742299398
get_state_dump_min	0.012790760774722043
get_ui_image_max	0.033985556761423744
get_ui_image_mean	0.03325458277835485
get_ui_image_median	0.03303807913410736
get_ui_image_min	0.03295661608378093
in-drivable-lane_max	0.5500000000000078
in-drivable-lane_mean	0.2625000000000015
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.983935930896548, "get_ui_image": 0.03295661608378093, "step_physics": 0.07085248708724975, "survival_time": 14.950000000000076, "driven_lanedir": 2.9256530033254275, "get_state_dump": 0.01309651533762614, "sim_render-ego": 0.005425136884053548, "get_robot_state": 0.01343435287475586, "get_duckie_state": 2.501805623372396e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0468419082959493, "deviation-heading": 2.5280524710910797, "complete-iteration": 0.2140881037712097, "set_robot_commands": 0.004593075116475423, "deviation-center-line": 1.3365768877475523, "driven_lanedir_consec": 2.9256530033254275, "sim_compute_sim_state": 0.02305560827255249, "sim_compute_performance-ego": 0.0036838118235270182}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.6366864609124874, "get_ui_image": 0.03310337833974553, "step_physics": 0.06902032336969485, "survival_time": 8.699999999999989, "driven_lanedir": 1.4952808386213925, "get_state_dump": 0.012790760774722043, "sim_render-ego": 0.005319541898267022, "get_robot_state": 0.013010264813214883, "get_duckie_state": 2.3101938181910023e-06, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.04017307429478086, "deviation-heading": 1.516686100959476, "complete-iteration": 0.20335972994223409, "set_robot_commands": 0.004837907593825768, "deviation-center-line": 0.9457006565756422, "driven_lanedir_consec": 1.4952808386213925, "sim_compute_sim_state": 0.021320518405958153, "sim_compute_performance-ego": 0.0036364478626470455}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.949221648277861, "get_ui_image": 0.033985556761423744, "step_physics": 0.07499442259470622, "survival_time": 14.950000000000076, "driven_lanedir": 2.849394211619122, "get_state_dump": 0.013125038146972657, "sim_render-ego": 0.005688998699188232, "get_robot_state": 0.014848679701487224, "get_duckie_state": 2.396901448567708e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.04068938255310059, "deviation-heading": 3.07260386450351, "complete-iteration": 0.2156793530782064, "set_robot_commands": 0.00472810427347819, "deviation-center-line": 1.1358520890785837, "driven_lanedir_consec": 2.849394211619122, "sim_compute_sim_state": 0.02366004228591919, "sim_compute_performance-ego": 0.003812723954518636}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.43166475958586104, "get_ui_image": 0.03297277992846919, "step_physics": 0.0778797748042088, "survival_time": 2.549999999999999, "driven_lanedir": 0.317427857900324, "get_state_dump": 0.013269513261084463, "sim_render-ego": 0.005566484787884881, "get_robot_state": 0.0137941089330935, "get_duckie_state": 2.3514616723154107e-06, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.04099292848624435, "deviation-heading": 0.4627928260408683, "complete-iteration": 0.21667907284755333, "set_robot_commands": 0.004442476758769914, "deviation-center-line": 0.19855433725747657, "driven_lanedir_consec": 0.317427857900324, "sim_compute_sim_state": 0.0238955488391951, "sim_compute_performance-ego": 0.003723261403102501}}
set_robot_commands_max	0.004837907593825768
set_robot_commands_mean	0.004650390935637324
set_robot_commands_median	0.004660589694976807
set_robot_commands_min	0.004442476758769914
sim_compute_performance-ego_max	0.003812723954518636
sim_compute_performance-ego_mean	0.0037140612609488
sim_compute_performance-ego_median	0.003703536613314759
sim_compute_performance-ego_min	0.0036364478626470455
sim_compute_sim_state_max	0.0238955488391951
sim_compute_sim_state_mean	0.02298292945090623
sim_compute_sim_state_median	0.02335782527923584
sim_compute_sim_state_min	0.021320518405958153
sim_render-ego_max	0.005688998699188232
sim_render-ego_mean	0.005500040567348421
sim_render-ego_median	0.005495810835969214
sim_render-ego_min	0.005319541898267022
simulation-passed	1
step_physics_max	0.0778797748042088
step_physics_mean	0.0731867519639649
step_physics_median	0.07292345484097798
step_physics_min	0.06902032336969485
survival_time_max	14.950000000000076
survival_time_mean	10.287500000000035
survival_time_min	2.549999999999999

No reset possible

43133

11615

sim-exercise-2

LFv-sim

error

2020-11-25 21:18:12+00:00

2020-11-25 21:24:55+00:00

0:06:43

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43126

11612

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-25 21:02:42+00:00

2020-11-25 21:10:12+00:00

0:07:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.006457268050607
survival_time_median	14.950000000000076
deviation-center-line_median	0.3308967745901833
in-drivable-lane_median	4.1000000000000165

other stats

agent_compute-ego_max	0.01733208179473877
agent_compute-ego_mean	0.017144084710341234
agent_compute-ego_median	0.017201141516367594
agent_compute-ego_min	0.016841974013890974
complete-iteration_max	0.18191559155782064
complete-iteration_mean	0.17660572403516525
complete-iteration_median	0.17631362597147623
complete-iteration_min	0.17188005263988787
deviation-center-line_max	0.8293699129900751
deviation-center-line_mean	0.41906146516375353
deviation-center-line_min	0.18508239848457217
deviation-heading_max	3.5085056591535966
deviation-heading_mean	1.9427883325037472
deviation-heading_median	1.761510567287386
deviation-heading_min	0.7396265362866222
driven_any_max	3.8529913939629536
driven_any_mean	3.257558435382061
driven_any_median	3.4706688282621387
driven_any_min	2.2359046910410125
driven_lanedir_consec_max	3.6949620028873937
driven_lanedir_consec_mean	2.1070917948296795
driven_lanedir_consec_min	0.7204906403301093
driven_lanedir_max	3.6949620028873937
driven_lanedir_mean	2.1070917948296795
driven_lanedir_median	2.006457268050607
driven_lanedir_min	0.7204906403301093
get_duckie_state_max	2.8928120930989582e-06
get_duckie_state_mean	2.778264192434458e-06
get_duckie_state_median	2.7793493026342148e-06
get_duckie_state_min	2.661546071370443e-06
get_robot_state_max	0.011775715228838798
get_robot_state_mean	0.01162316537820376
get_robot_state_median	0.01165056347846985
get_robot_state_min	0.01141581932703654
get_state_dump_max	0.01209993044535319
get_state_dump_mean	0.011979203208898889
get_state_dump_median	0.01197136279864189
get_state_dump_min	0.011874156792958578
get_ui_image_max	0.032525231838226316
get_ui_image_mean	0.03187625411229256
get_ui_image_median	0.031941287120183307
get_ui_image_min	0.031097210370577295
in-drivable-lane_max	11.45000000000008
in-drivable-lane_mean	4.912500000000028
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.2359046910410125, "get_ui_image": 0.031097210370577295, "step_physics": 0.06557546059290568, "survival_time": 7.79999999999998, "driven_lanedir": 1.2565095829730488, "get_state_dump": 0.012038252292535244, "sim_render-ego": 0.005158271545018905, "get_robot_state": 0.011775715228838798, "get_duckie_state": 2.8915894337189502e-06, "in-drivable-lane": 3.1999999999999886, "agent_compute-ego": 0.016841974013890974, "deviation-heading": 0.7396265362866222, "complete-iteration": 0.17188005263988787, "set_robot_commands": 0.004456217472369854, "deviation-center-line": 0.21347670154422377, "driven_lanedir_consec": 1.2565095829730488, "sim_compute_sim_state": 0.0213168462117513, "sim_compute_performance-ego": 0.003489378171089368}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.8529913939629536, "get_ui_image": 0.03142962058385213, "step_physics": 0.06681273619333904, "survival_time": 14.950000000000076, "driven_lanedir": 3.6949620028873937, "get_state_dump": 0.011874156792958578, "sim_render-ego": 0.005097212791442871, "get_robot_state": 0.01141581932703654, "get_duckie_state": 2.661546071370443e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017103476524353026, "deviation-heading": 3.5085056591535966, "complete-iteration": 0.17295703967412313, "set_robot_commands": 0.004445327917734782, "deviation-center-line": 0.8293699129900751, "driven_lanedir_consec": 3.6949620028873937, "sim_compute_sim_state": 0.0212416942914327, "sim_compute_performance-ego": 0.0034097607930501303}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.11667518491513, "get_ui_image": 0.032525231838226316, "step_physics": 0.07166848500569661, "survival_time": 14.950000000000076, "driven_lanedir": 0.7204906403301093, "get_state_dump": 0.01209993044535319, "sim_render-ego": 0.005168444315592448, "get_robot_state": 0.0117140531539917, "get_duckie_state": 2.6671091715494793e-06, "in-drivable-lane": 11.45000000000008, "agent_compute-ego": 0.01733208179473877, "deviation-heading": 1.6546264298750717, "complete-iteration": 0.17967021226882934, "set_robot_commands": 0.004352990786234538, "deviation-center-line": 0.18508239848457217, "driven_lanedir_consec": 0.7204906403301093, "sim_compute_sim_state": 0.02123147567113241, "sim_compute_performance-ego": 0.003449966112772624}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.824662471609147, "get_ui_image": 0.03245295365651449, "step_physics": 0.07135138511657715, "survival_time": 14.950000000000076, "driven_lanedir": 2.7564049531281656, "get_state_dump": 0.011904473304748536, "sim_render-ego": 0.004990371863047282, "get_robot_state": 0.011587073802947998, "get_duckie_state": 2.8928120930989582e-06, "in-drivable-lane": 5.000000000000044, "agent_compute-ego": 0.017298806508382163, "deviation-heading": 1.8683947046997005, "complete-iteration": 0.18191559155782064, "set_robot_commands": 0.004527804056803386, "deviation-center-line": 0.4483168476361429, "driven_lanedir_consec": 2.7564049531281656, "sim_compute_sim_state": 0.024311962127685546, "sim_compute_performance-ego": 0.003362123966217041}}
set_robot_commands_max	0.004527804056803386
set_robot_commands_mean	0.0044455850582856395
set_robot_commands_median	0.004450772695052318
set_robot_commands_min	0.004352990786234538
sim_compute_performance-ego_max	0.003489378171089368
sim_compute_performance-ego_mean	0.0034278072607822905
sim_compute_performance-ego_median	0.003429863452911377
sim_compute_performance-ego_min	0.003362123966217041
sim_compute_sim_state_max	0.024311962127685546
sim_compute_sim_state_mean	0.022025494575500487
sim_compute_sim_state_median	0.021279270251592
sim_compute_sim_state_min	0.02123147567113241
sim_render-ego_max	0.005168444315592448
sim_render-ego_mean	0.005103575128775377
sim_render-ego_median	0.005127742168230888
sim_render-ego_min	0.004990371863047282
simulation-passed	1
step_physics_max	0.07166848500569661
step_physics_mean	0.06885201672712962
step_physics_median	0.06908206065495809
step_physics_min	0.06557546059290568
survival_time_max	14.950000000000076
survival_time_mean	13.162500000000051
survival_time_min	7.79999999999998

No reset possible

43113

11607

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-25 20:21:53+00:00

2020-11-25 20:30:40+00:00

0:08:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.737330770392991
survival_time_median	14.950000000000076
deviation-center-line_median	0.5668199924830284
in-drivable-lane_median	2.2750000000000323

other stats

agent_compute-ego_max	0.017769358858299965
agent_compute-ego_mean	0.01756243127207774
agent_compute-ego_median	0.017617355982462564
agent_compute-ego_min	0.017245654265085855
complete-iteration_max	0.21024396162493963
complete-iteration_mean	0.19767890528158333
complete-iteration_median	0.1987942389647166
complete-iteration_min	0.18288318157196048
deviation-center-line_max	0.9569367663382312
deviation-center-line_mean	0.6421547969523318
deviation-center-line_min	0.47804243650503886
deviation-heading_max	2.935561504638464
deviation-heading_mean	2.3261281743471383
deviation-heading_median	2.419669662111562
deviation-heading_min	1.529611868526965
driven_any_max	3.5300798282360564
driven_any_mean	3.1162273289286864
driven_any_median	3.1595601576262915
driven_any_min	2.615709172226107
driven_lanedir_consec_max	3.4687466003750496
driven_lanedir_consec_mean	2.7344459228329008
driven_lanedir_consec_min	1.9943755501705724
driven_lanedir_max	3.4687466003750496
driven_lanedir_mean	2.7344459228329008
driven_lanedir_median	2.737330770392991
driven_lanedir_min	1.9943755501705724
get_duckie_state_max	3.4273778638875176e-06
get_duckie_state_mean	3.31354924146423e-06
get_duckie_state_median	3.344615300496419e-06
get_duckie_state_min	3.1375885009765625e-06
get_robot_state_max	0.015135557651519777
get_robot_state_mean	0.014477698125656064
get_robot_state_median	0.014601825313201772
get_robot_state_min	0.013571584224700927
get_state_dump_max	0.013557211617111715
get_state_dump_mean	0.01322453619526812
get_state_dump_median	0.013310468991597494
get_state_dump_min	0.012719995180765787
get_ui_image_max	0.03531117776069499
get_ui_image_mean	0.034216290163580215
get_ui_image_median	0.034518009821573895
get_ui_image_min	0.03251796325047811
in-drivable-lane_max	3.7500000000000537
in-drivable-lane_mean	2.0750000000000295
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.445253410884653, "get_ui_image": 0.03251796325047811, "step_physics": 0.07038795471191406, "survival_time": 14.950000000000076, "driven_lanedir": 3.0891255444444936, "get_state_dump": 0.012719995180765787, "sim_render-ego": 0.005527044932047526, "get_robot_state": 0.013571584224700927, "get_duckie_state": 3.1375885009765625e-06, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.017245654265085855, "deviation-heading": 2.5133216852890454, "complete-iteration": 0.18288318157196048, "set_robot_commands": 0.004546184539794922, "deviation-center-line": 0.5495982604199312, "driven_lanedir_consec": 3.0891255444444936, "sim_compute_sim_state": 0.02255342960357666, "sim_compute_performance-ego": 0.003675971825917562}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.5300798282360564, "get_ui_image": 0.033890121777852375, "step_physics": 0.07685264587402343, "survival_time": 14.950000000000076, "driven_lanedir": 3.4687466003750496, "get_state_dump": 0.013236570358276366, "sim_render-ego": 0.005809487501780192, "get_robot_state": 0.015024270216623942, "get_duckie_state": 3.380775451660156e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01747962792714437, "deviation-heading": 2.3260176389340783, "complete-iteration": 0.1946173644065857, "set_robot_commands": 0.004724376996358235, "deviation-center-line": 0.5840417245461255, "driven_lanedir_consec": 3.4687466003750496, "sim_compute_sim_state": 0.023513031005859376, "sim_compute_performance-ego": 0.003935593763987224}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.615709172226107, "get_ui_image": 0.03514589786529541, "step_physics": 0.08307802041371663, "survival_time": 14.950000000000076, "driven_lanedir": 1.9943755501705724, "get_state_dump": 0.01338436762491862, "sim_render-ego": 0.00596059799194336, "get_robot_state": 0.015135557651519777, "get_duckie_state": 3.3084551493326824e-06, "in-drivable-lane": 3.3500000000000476, "agent_compute-ego": 0.017755084037780762, "deviation-heading": 2.935561504638464, "complete-iteration": 0.2029711135228475, "set_robot_commands": 0.004652848243713379, "deviation-center-line": 0.9569367663382312, "driven_lanedir_consec": 1.9943755501705724, "sim_compute_sim_state": 0.02378852367401123, "sim_compute_performance-ego": 0.003917977015177409}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8738669043679304, "get_ui_image": 0.03531117776069499, "step_physics": 0.08689449356391084, "survival_time": 13.450000000000056, "driven_lanedir": 2.3855359963414893, "get_state_dump": 0.013557211617111715, "sim_render-ego": 0.005961799267056263, "get_robot_state": 0.0141793804097796, "get_duckie_state": 3.4273778638875176e-06, "in-drivable-lane": 3.7500000000000537, "agent_compute-ego": 0.017769358858299965, "deviation-heading": 1.529611868526965, "complete-iteration": 0.21024396162493963, "set_robot_commands": 0.004574724289564395, "deviation-center-line": 0.47804243650503886, "driven_lanedir_consec": 2.3855359963414893, "sim_compute_sim_state": 0.027840059486020453, "sim_compute_performance-ego": 0.003999467232856609}}
set_robot_commands_max	0.004724376996358235
set_robot_commands_mean	0.004624533517357732
set_robot_commands_median	0.004613786266638886
set_robot_commands_min	0.004546184539794922
sim_compute_performance-ego_max	0.003999467232856609
sim_compute_performance-ego_mean	0.003882252459484701
sim_compute_performance-ego_median	0.003926785389582316
sim_compute_performance-ego_min	0.003675971825917562
sim_compute_sim_state_max	0.027840059486020453
sim_compute_sim_state_mean	0.02442376094236693
sim_compute_sim_state_median	0.023650777339935303
sim_compute_sim_state_min	0.02255342960357666
sim_render-ego_max	0.005961799267056263
sim_render-ego_mean	0.0058147324232068354
sim_render-ego_median	0.005885042746861776
sim_render-ego_min	0.005527044932047526
simulation-passed	1
step_physics_max	0.08689449356391084
step_physics_mean	0.07930327864089123
step_physics_median	0.07996533314387003
step_physics_min	0.07038795471191406
survival_time_max	14.950000000000076
survival_time_mean	14.575000000000074
survival_time_min	13.450000000000056

No reset possible

43090

11603

Jean-Sébastien Grondin 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-25 20:13:09+00:00

2020-11-25 20:20:30+00:00

0:07:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.5273004223713629
survival_time_median	12.150000000000038
deviation-center-line_median	0.5151430784555432
in-drivable-lane_median	1.8000000000000167

other stats

agent_compute-ego_max	0.017357181708017984
agent_compute-ego_mean	0.016862442675546315
agent_compute-ego_median	0.016976771639417625
agent_compute-ego_min	0.01613904571533203
complete-iteration_max	0.20332148869832356
complete-iteration_mean	0.19730775487784183
complete-iteration_median	0.19686393928527832
complete-iteration_min	0.19218165224248712
deviation-center-line_max	0.8653706164314958
deviation-center-line_mean	0.5734010501596768
deviation-center-line_min	0.397947427296125
deviation-heading_max	5.202476552048674
deviation-heading_mean	3.3514071545220254
deviation-heading_median	3.4817377624330343
deviation-heading_min	1.2396765411733597
driven_any_max	3.5735644728921407
driven_any_mean	2.6961628212919946
driven_any_median	2.8826466575212732
driven_any_min	1.4457934972332902
driven_lanedir_consec_max	2.397305189033911
driven_lanedir_consec_mean	1.6744634493094104
driven_lanedir_consec_min	1.245947763461005
driven_lanedir_max	2.397305189033911
driven_lanedir_mean	1.6744634493094104
driven_lanedir_median	1.5273004223713629
driven_lanedir_min	1.245947763461005
get_duckie_state_max	2.7054771382540943e-06
get_duckie_state_mean	2.5631344467135887e-06
get_duckie_state_median	2.585252126057943e-06
get_duckie_state_min	2.376556396484375e-06
get_robot_state_max	0.015793405373891196
get_robot_state_mean	0.014781524072143908
get_robot_state_median	0.014911539892461847
get_robot_state_min	0.013509611129760742
get_state_dump_max	0.01338990290959676
get_state_dump_mean	0.013280595892253406
get_state_dump_median	0.013316984958614685
get_state_dump_min	0.0130985107421875
get_ui_image_max	0.035226577123006184
get_ui_image_mean	0.0346587265772403
get_ui_image_median	0.03469125947212791
get_ui_image_min	0.03402581024169922
in-drivable-lane_max	8.400000000000055
in-drivable-lane_mean	3.112500000000022
in-drivable-lane_min	0.4499999999999984
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.561540044519121, "get_ui_image": 0.035226577123006184, "step_physics": 0.08154018640518189, "survival_time": 14.950000000000076, "driven_lanedir": 2.397305189033911, "get_state_dump": 0.013365627924601236, "sim_render-ego": 0.006255200703938802, "get_robot_state": 0.015793405373891196, "get_duckie_state": 2.6655197143554687e-06, "in-drivable-lane": 3.0500000000000256, "agent_compute-ego": 0.017357181708017984, "deviation-heading": 5.202476552048674, "complete-iteration": 0.20332148869832356, "set_robot_commands": 0.004901025295257568, "deviation-center-line": 0.8653706164314958, "driven_lanedir_consec": 2.397305189033911, "sim_compute_sim_state": 0.024543474515279134, "sim_compute_performance-ego": 0.004192024866739909}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.2037532705234253, "get_ui_image": 0.034913069424144724, "step_physics": 0.07528289499129841, "survival_time": 9.349999999999998, "driven_lanedir": 1.773044639416554, "get_state_dump": 0.013268341992628128, "sim_render-ego": 0.005834580742739101, "get_robot_state": 0.014858201225811147, "get_duckie_state": 2.7054771382540943e-06, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.016928767137986453, "deviation-heading": 4.001482066515644, "complete-iteration": 0.19218165224248712, "set_robot_commands": 0.004717917365823838, "deviation-center-line": 0.6280033628313494, "driven_lanedir_consec": 1.773044639416554, "sim_compute_sim_state": 0.022347164664039, "sim_compute_performance-ego": 0.0038845959831686583}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.5735644728921407, "get_ui_image": 0.034469449520111085, "step_physics": 0.076923348903656, "survival_time": 14.950000000000076, "driven_lanedir": 1.245947763461005, "get_state_dump": 0.01338990290959676, "sim_render-ego": 0.0059448949495951335, "get_robot_state": 0.014964878559112549, "get_duckie_state": 2.5049845377604165e-06, "in-drivable-lane": 8.400000000000055, "agent_compute-ego": 0.017024776140848796, "deviation-heading": 2.961993458350425, "complete-iteration": 0.19410409927368164, "set_robot_commands": 0.004839330514272054, "deviation-center-line": 0.397947427296125, "driven_lanedir_consec": 1.245947763461005, "sim_compute_sim_state": 0.022452925046284992, "sim_compute_performance-ego": 0.003950097560882568}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.4457934972332902, "get_ui_image": 0.03402581024169922, "step_physics": 0.08393122673034668, "survival_time": 6.249999999999986, "driven_lanedir": 1.281556205326171, "get_state_dump": 0.0130985107421875, "sim_render-ego": 0.005530263900756836, "get_robot_state": 0.013509611129760742, "get_duckie_state": 2.376556396484375e-06, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.01613904571533203, "deviation-heading": 1.2396765411733597, "complete-iteration": 0.199623779296875, "set_robot_commands": 0.004282205581665039, "deviation-center-line": 0.402282794079737, "driven_lanedir_consec": 1.281556205326171, "sim_compute_sim_state": 0.025251195907592772, "sim_compute_performance-ego": 0.003718704223632813}}
set_robot_commands_max	0.004901025295257568
set_robot_commands_mean	0.004685119689254625
set_robot_commands_median	0.004778623940047946
set_robot_commands_min	0.004282205581665039
sim_compute_performance-ego_max	0.004192024866739909
sim_compute_performance-ego_mean	0.003936355658605987
sim_compute_performance-ego_median	0.003917346772025613
sim_compute_performance-ego_min	0.003718704223632813
sim_compute_sim_state_max	0.025251195907592772
sim_compute_sim_state_mean	0.023648690033298975
sim_compute_sim_state_median	0.02349819978078206
sim_compute_sim_state_min	0.022347164664039
sim_render-ego_max	0.006255200703938802
sim_render-ego_mean	0.005891235074257468
sim_render-ego_median	0.005889737846167117
sim_render-ego_min	0.005530263900756836
simulation-passed	1
step_physics_max	0.08393122673034668
step_physics_mean	0.07941941425762075
step_physics_median	0.07923176765441894
step_physics_min	0.07528289499129841
survival_time_max	14.950000000000076
survival_time_mean	11.375000000000036
survival_time_min	6.249999999999986

No reset possible

43078

11601

Jean-Sébastien Grondin 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-25 20:07:10+00:00

2020-11-25 20:11:35+00:00

0:04:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4176969083648314
survival_time_median	6.249999999999986
deviation-center-line_median	0.16838674624956795
in-drivable-lane_median	1.4499999999999953

other stats

agent_compute-ego_max	0.016482142928224173
agent_compute-ego_mean	0.016315469538889994
agent_compute-ego_median	0.016353842323448615
agent_compute-ego_min	0.016072050580438577
complete-iteration_max	0.2046647338393312
complete-iteration_mean	0.18495932800166404
complete-iteration_median	0.18057239850674536
complete-iteration_min	0.17402778115383413
deviation-center-line_max	0.6639970366722812
deviation-center-line_mean	0.27933785818980134
deviation-center-line_min	0.11658090358778828
deviation-heading_max	2.087527033229009
deviation-heading_mean	1.317527224271567
deviation-heading_median	1.286392317677807
deviation-heading_min	0.6097972285016453
driven_any_max	1.61660153666514
driven_any_mean	1.1161687251253136
driven_any_median	1.2341816880068592
driven_any_min	0.37970998782239646
driven_lanedir_consec_max	1.4568992977837545
driven_lanedir_consec_mean	0.6404117625917254
driven_lanedir_consec_min	0.26935393585348466
driven_lanedir_max	1.4568992977837545
driven_lanedir_mean	0.6457874780997467
driven_lanedir_median	0.4284483393808739
driven_lanedir_min	0.26935393585348466
get_duckie_state_max	2.456161211121757e-06
get_duckie_state_mean	2.220974977803676e-06
get_duckie_state_median	2.3267304510639155e-06
get_duckie_state_min	1.7742777979651165e-06
get_robot_state_max	0.01425790934829238
get_robot_state_mean	0.013061517135393516
get_robot_state_median	0.012969635770630783
get_robot_state_min	0.01204888765202012
get_state_dump_max	0.012999796205096774
get_state_dump_mean	0.012867119406963437
get_state_dump_median	0.012929813273414336
get_state_dump_min	0.012609054875928302
get_ui_image_max	0.034686676463725405
get_ui_image_mean	0.03300728358448189
get_ui_image_median	0.03276413540107899
get_ui_image_min	0.0318141870720442
in-drivable-lane_max	3.999999999999986
in-drivable-lane_mean	1.7999999999999938
in-drivable-lane_min	0.29999999999999893
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.0300819129330454, "get_ui_image": 0.03253883010936233, "step_physics": 0.06971270408270494, "survival_time": 5.299999999999989, "driven_lanedir": 0.4771353765322275, "get_state_dump": 0.012909918461205825, "sim_render-ego": 0.005327053789822561, "get_robot_state": 0.013095952429861392, "get_duckie_state": 2.456161211121757e-06, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.016072050580438577, "deviation-heading": 0.6097972285016453, "complete-iteration": 0.1794533077275978, "set_robot_commands": 0.004512935314538344, "deviation-center-line": 0.12867037099931508, "driven_lanedir_consec": 0.4771353765322275, "sim_compute_sim_state": 0.021524019961087208, "sim_compute_performance-ego": 0.00361347423409516}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.37970998782239646, "get_ui_image": 0.0318141870720442, "step_physics": 0.06886832104172817, "survival_time": 2.1500000000000004, "driven_lanedir": 0.26935393585348466, "get_state_dump": 0.012609054875928302, "sim_render-ego": 0.0051100753074468565, "get_robot_state": 0.01204888765202012, "get_duckie_state": 1.7742777979651165e-06, "in-drivable-lane": 0.39999999999999947, "agent_compute-ego": 0.01646472686945006, "deviation-heading": 0.6224101421756894, "complete-iteration": 0.17402778115383413, "set_robot_commands": 0.00453108410502589, "deviation-center-line": 0.11658090358778828, "driven_lanedir_consec": 0.26935393585348466, "sim_compute_sim_state": 0.019096635108770327, "sim_compute_performance-ego": 0.0033613692882449126}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.438281463080673, "get_ui_image": 0.03298944069279565, "step_physics": 0.07177325586477916, "survival_time": 7.199999999999982, "driven_lanedir": 0.3797613022295203, "get_state_dump": 0.012999796205096774, "sim_render-ego": 0.0052901456753412885, "get_robot_state": 0.01284331911140018, "get_duckie_state": 2.3477607303195528e-06, "in-drivable-lane": 3.999999999999986, "agent_compute-ego": 0.01624295777744717, "deviation-heading": 2.087527033229009, "complete-iteration": 0.1816914892858929, "set_robot_commands": 0.004407533340983921, "deviation-center-line": 0.2081031214998208, "driven_lanedir_consec": 0.35825844019743536, "sim_compute_sim_state": 0.02138200236691369, "sim_compute_performance-ego": 0.003617828090985616}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.61660153666514, "get_ui_image": 0.034686676463725405, "step_physics": 0.08605334329308931, "survival_time": 8.04999999999998, "driven_lanedir": 1.4568992977837545, "get_state_dump": 0.012949708085622846, "sim_render-ego": 0.00558422070852718, "get_robot_state": 0.01425790934829238, "get_duckie_state": 2.3057001718082783e-06, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.016482142928224173, "deviation-heading": 1.9503744931799245, "complete-iteration": 0.2046647338393312, "set_robot_commands": 0.004617103138325377, "deviation-center-line": 0.6639970366722812, "driven_lanedir_consec": 1.4568992977837545, "sim_compute_sim_state": 0.02605599498156435, "sim_compute_performance-ego": 0.0038216854474559334}}
set_robot_commands_max	0.004617103138325377
set_robot_commands_mean	0.004517163974718383
set_robot_commands_median	0.004522009709782117
set_robot_commands_min	0.004407533340983921
sim_compute_performance-ego_max	0.0038216854474559334
sim_compute_performance-ego_mean	0.0036035892651954055
sim_compute_performance-ego_median	0.003615651162540388
sim_compute_performance-ego_min	0.0033613692882449126
sim_compute_sim_state_max	0.02605599498156435
sim_compute_sim_state_mean	0.022014663104583897
sim_compute_sim_state_median	0.02145301116400045
sim_compute_sim_state_min	0.019096635108770327
sim_render-ego_max	0.00558422070852718
sim_render-ego_mean	0.005327873870284472
sim_render-ego_median	0.005308599732581925
sim_render-ego_min	0.0051100753074468565
simulation-passed	1
step_physics_max	0.08605334329308931
step_physics_mean	0.0741019060705754
step_physics_median	0.07074297997374204
step_physics_min	0.06886832104172817
survival_time_max	8.04999999999998
survival_time_mean	5.674999999999988
survival_time_min	2.1500000000000004

No reset possible

43072

11598

exercise_state_estimation

LFv-sim

success

2020-11-25 19:44:02+00:00

2020-11-25 19:52:46+00:00

0:08:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.7587064734348845
survival_time_median	14.950000000000076
deviation-center-line_median	0.5286671957951138
in-drivable-lane_median	1.0750000000000153

other stats

agent_compute-ego_max	0.017629590034484863
agent_compute-ego_mean	0.017522093454996744
agent_compute-ego_median	0.01759393612543742
agent_compute-ego_min	0.01727091153462728
complete-iteration_max	0.19676881869633991
complete-iteration_mean	0.19031938473383583
complete-iteration_median	0.18915619770685832
complete-iteration_min	0.1861963248252869
deviation-center-line_max	0.7191002086458675
deviation-center-line_mean	0.5285781932002676
deviation-center-line_min	0.3378781725649749
deviation-heading_max	2.3590221223324535
deviation-heading_mean	1.4952859129822316
deviation-heading_median	1.2701530582228662
deviation-heading_min	1.0818154131507407
driven_any_max	1.9399990747845688
driven_any_mean	1.9384082189695475
driven_any_median	1.939982044116118
driven_any_min	1.933669712861387
driven_lanedir_consec_max	1.921841051103544
driven_lanedir_consec_mean	1.7112410534175009
driven_lanedir_consec_min	1.4057102156966903
driven_lanedir_max	1.921841051103544
driven_lanedir_mean	1.7112410534175009
driven_lanedir_median	1.7587064734348845
driven_lanedir_min	1.4057102156966903
get_duckie_state_max	2.509752909342448e-06
get_duckie_state_mean	2.4257103602091475e-06
get_duckie_state_median	2.4481614430745445e-06
get_duckie_state_min	2.296765645345052e-06
get_robot_state_max	0.01441723108291626
get_robot_state_mean	0.013780489166577658
get_robot_state_median	0.013680415153503418
get_robot_state_min	0.013343895276387532
get_state_dump_max	0.01353648821512858
get_state_dump_mean	0.013301698565483092
get_state_dump_median	0.013272597789764404
get_state_dump_min	0.013125110467274983
get_ui_image_max	0.03377907752990723
get_ui_image_mean	0.03345915218194326
get_ui_image_median	0.03353245536486307
get_ui_image_min	0.032992620468139645
in-drivable-lane_max	3.7500000000000537
in-drivable-lane_mean	1.475000000000021
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.933669712861387, "get_ui_image": 0.03328646659851074, "step_physics": 0.07270742972691854, "survival_time": 14.950000000000076, "driven_lanedir": 1.4057102156966903, "get_state_dump": 0.01353648821512858, "sim_render-ego": 0.005651236375172933, "get_robot_state": 0.01441723108291626, "get_duckie_state": 2.4843215942382812e-06, "in-drivable-lane": 3.7500000000000537, "agent_compute-ego": 0.01727091153462728, "deviation-heading": 1.2913373878170384, "complete-iteration": 0.18873303413391113, "set_robot_commands": 0.0045288268725077315, "deviation-center-line": 0.3378781725649749, "driven_lanedir_consec": 1.4057102156966903, "sim_compute_sim_state": 0.023359100818634033, "sim_compute_performance-ego": 0.003827333450317383}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.9399950895401707, "get_ui_image": 0.032992620468139645, "step_physics": 0.07189241488774617, "survival_time": 14.950000000000076, "driven_lanedir": 1.9166590867192204, "get_state_dump": 0.013219475746154783, "sim_render-ego": 0.005716586112976074, "get_robot_state": 0.013791357676188151, "get_duckie_state": 2.4120012919108074e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017629590034484863, "deviation-heading": 1.248968728628694, "complete-iteration": 0.1861963248252869, "set_robot_commands": 0.004457307656606038, "deviation-center-line": 0.7191002086458675, "driven_lanedir_consec": 1.9166590867192204, "sim_compute_sim_state": 0.02244239250818888, "sim_compute_performance-ego": 0.003903199831644694}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.939968998692065, "get_ui_image": 0.03377844413121541, "step_physics": 0.07464840412139892, "survival_time": 14.950000000000076, "driven_lanedir": 1.6007538601505484, "get_state_dump": 0.013325719833374024, "sim_render-ego": 0.005532604058583577, "get_robot_state": 0.013569472630818685, "get_duckie_state": 2.296765645345052e-06, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.017617434660593668, "deviation-heading": 2.3590221223324535, "complete-iteration": 0.18957936127980551, "set_robot_commands": 0.004507523377736409, "deviation-center-line": 0.6830152388349665, "driven_lanedir_consec": 1.6007538601505484, "sim_compute_sim_state": 0.022706773281097412, "sim_compute_performance-ego": 0.003743150234222412}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9399990747845688, "get_ui_image": 0.03377907752990723, "step_physics": 0.08003376483917236, "survival_time": 14.950000000000076, "driven_lanedir": 1.921841051103544, "get_state_dump": 0.013125110467274983, "sim_render-ego": 0.005438071091969808, "get_robot_state": 0.013343895276387532, "get_duckie_state": 2.509752909342448e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01757043759028117, "deviation-heading": 1.0818154131507407, "complete-iteration": 0.19676881869633991, "set_robot_commands": 0.004532504876454672, "deviation-center-line": 0.37431915275526106, "driven_lanedir_consec": 1.921841051103544, "sim_compute_sim_state": 0.025117626984914144, "sim_compute_performance-ego": 0.0036759273211161296}}
set_robot_commands_max	0.004532504876454672
set_robot_commands_mean	0.0045065406958262125
set_robot_commands_median	0.00451817512512207
set_robot_commands_min	0.004457307656606038
sim_compute_performance-ego_max	0.003903199831644694
sim_compute_performance-ego_mean	0.003787402709325154
sim_compute_performance-ego_median	0.0037852418422698974
sim_compute_performance-ego_min	0.0036759273211161296
sim_compute_sim_state_max	0.025117626984914144
sim_compute_sim_state_mean	0.023406473398208616
sim_compute_sim_state_median	0.023032937049865723
sim_compute_sim_state_min	0.02244239250818888
sim_render-ego_max	0.005716586112976074
sim_render-ego_mean	0.005584624409675599
sim_render-ego_median	0.005591920216878255
sim_render-ego_min	0.005438071091969808
simulation-passed	1
step_physics_max	0.08003376483917236
step_physics_mean	0.074820503393809
step_physics_median	0.07367791692415873
step_physics_min	0.07189241488774617
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

43048

11591

Yishu Malhotra 🇨🇦

exercise_state_estimation

LFv-sim

failed

2020-11-25 19:05:55+00:00

2020-11-25 19:09:15+00:00

0:03:20

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 56 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

43010

11584

Yishu Malhotra 🇨🇦

exercise_state_estimation

LFv-sim

failed

2020-11-25 18:01:33+00:00

2020-11-25 18:05:07+00:00

0:03:34

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 154 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42989

11578

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

LFv-sim

success

2020-11-25 14:12:39+00:00

2020-11-25 14:20:55+00:00

0:08:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	5.979708239839006
survival_time_median	14.950000000000076
deviation-center-line_median	0.726025219911431
in-drivable-lane_median	0.6500000000000017

other stats

agent_compute-ego_max	0.01960403362909953
agent_compute-ego_mean	0.0191475248336792
agent_compute-ego_median	0.019136269489924113
agent_compute-ego_min	0.018713526725769043
complete-iteration_max	0.18020069201787312
complete-iteration_mean	0.1761063442627589
complete-iteration_median	0.17566515922546386
complete-iteration_min	0.1728943665822347
deviation-center-line_max	0.7951767406706496
deviation-center-line_mean	0.724770706377866
deviation-center-line_min	0.6518556450179526
deviation-heading_max	3.7663539401992727
deviation-heading_mean	3.3473282915349625
deviation-heading_median	3.3003900108897084
deviation-heading_min	3.0221792041611595
driven_any_max	6.421976796444931
driven_any_mean	6.1577968004677155
driven_any_median	6.363800196438124
driven_any_min	5.481610012549683
driven_lanedir_consec_max	6.140979812028203
driven_lanedir_consec_mean	5.791815574695108
driven_lanedir_consec_min	5.066866007074219
driven_lanedir_max	6.140979812028203
driven_lanedir_mean	5.791815574695108
driven_lanedir_median	5.979708239839006
driven_lanedir_min	5.066866007074219
get_duckie_state_max	2.288818359375e-06
get_duckie_state_mean	2.2015968958536784e-06
get_duckie_state_median	2.2399425506591796e-06
get_duckie_state_min	2.0376841227213542e-06
get_robot_state_max	0.011494069894154867
get_robot_state_mean	0.011324858069419862
get_robot_state_median	0.011340160767237343
get_robot_state_min	0.011125040849049889
get_state_dump_max	0.011917935212453209
get_state_dump_mean	0.011861457228660584
get_state_dump_median	0.011852625608444214
get_state_dump_min	0.0118226424853007
get_ui_image_max	0.03199094533920288
get_ui_image_mean	0.031793949802716576
get_ui_image_median	0.03192476590474447
get_ui_image_min	0.03133532206217448
in-drivable-lane_max	0.8500000000000121
in-drivable-lane_mean	0.5375000000000039
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 6.400917571859083, "get_ui_image": 0.03186196009318034, "step_physics": 0.06649235645929973, "survival_time": 14.950000000000076, "driven_lanedir": 5.999090727141726, "get_state_dump": 0.0118226424853007, "sim_render-ego": 0.0050541075070699056, "get_robot_state": 0.011125040849049889, "get_duckie_state": 2.2681554158528647e-06, "in-drivable-lane": 0.7000000000000055, "agent_compute-ego": 0.01879434665044149, "deviation-heading": 3.189846677123299, "complete-iteration": 0.17516259590784708, "set_robot_commands": 0.004489285945892334, "deviation-center-line": 0.7137830373531049, "driven_lanedir_consec": 5.999090727141726, "sim_compute_sim_state": 0.02197349468866984, "sim_compute_performance-ego": 0.0034232711791992187}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 6.421976796444931, "get_ui_image": 0.03133532206217448, "step_physics": 0.0647860868771871, "survival_time": 14.950000000000076, "driven_lanedir": 5.960325752536285, "get_state_dump": 0.011846623420715331, "sim_render-ego": 0.004995145003000895, "get_robot_state": 0.011257050037384033, "get_duckie_state": 2.0376841227213542e-06, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.01947819232940674, "deviation-heading": 3.410933344656118, "complete-iteration": 0.1728943665822347, "set_robot_commands": 0.004380605220794678, "deviation-center-line": 0.6518556450179526, "driven_lanedir_consec": 5.960325752536285, "sim_compute_sim_state": 0.021297780672709148, "sim_compute_performance-ego": 0.003394908905029297}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 5.481610012549683, "get_ui_image": 0.031987571716308595, "step_physics": 0.06627101182937623, "survival_time": 14.950000000000076, "driven_lanedir": 5.066866007074219, "get_state_dump": 0.011858627796173096, "sim_render-ego": 0.005021247069040934, "get_robot_state": 0.011494069894154867, "get_duckie_state": 2.288818359375e-06, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.01960403362909953, "deviation-heading": 3.7663539401992727, "complete-iteration": 0.17616772254308063, "set_robot_commands": 0.004393169085184733, "deviation-center-line": 0.7951767406706496, "driven_lanedir_consec": 5.066866007074219, "sim_compute_sim_state": 0.021978232860565185, "sim_compute_performance-ego": 0.003434426784515381}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 6.326682821017165, "get_ui_image": 0.03199094533920288, "step_physics": 0.06912503401438395, "survival_time": 14.950000000000076, "driven_lanedir": 6.140979812028203, "get_state_dump": 0.011917935212453209, "sim_render-ego": 0.004852906862894694, "get_robot_state": 0.011423271497090656, "get_duckie_state": 2.211729685465495e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.018713526725769043, "deviation-heading": 3.0221792041611595, "complete-iteration": 0.18020069201787312, "set_robot_commands": 0.004532648722330729, "deviation-center-line": 0.7382674024697572, "driven_lanedir_consec": 6.140979812028203, "sim_compute_sim_state": 0.02422226508458455, "sim_compute_performance-ego": 0.003297734260559082}}
set_robot_commands_max	0.004532648722330729
set_robot_commands_mean	0.004448927243550619
set_robot_commands_median	0.004441227515538534
set_robot_commands_min	0.004380605220794678
sim_compute_performance-ego_max	0.003434426784515381
sim_compute_performance-ego_mean	0.0033875852823257446
sim_compute_performance-ego_median	0.003409090042114258
sim_compute_performance-ego_min	0.003297734260559082
sim_compute_sim_state_max	0.02422226508458455
sim_compute_sim_state_mean	0.02236794332663218
sim_compute_sim_state_median	0.02197586377461751
sim_compute_sim_state_min	0.021297780672709148
sim_render-ego_max	0.0050541075070699056
sim_render-ego_mean	0.004980851610501607
sim_render-ego_median	0.005008196036020915
sim_render-ego_min	0.004852906862894694
simulation-passed	1
step_physics_max	0.06912503401438395
step_physics_mean	0.06666862229506175
step_physics_median	0.06638168414433798
step_physics_min	0.0647860868771871
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42982

11576

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

LFv-sim

success

2020-11-25 13:39:05+00:00

2020-11-25 13:49:35+00:00

0:10:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.6416213865467943
survival_time_median	14.950000000000076
deviation-center-line_median	1.2675040426416144
in-drivable-lane_median	1.5750000000000175

other stats

agent_compute-ego_max	0.01828658898671468
agent_compute-ego_mean	0.01815556526184082
agent_compute-ego_median	0.018210156361262005
agent_compute-ego_min	0.017915359338124593
complete-iteration_max	0.1898339899381002
complete-iteration_mean	0.18305549124876655
complete-iteration_median	0.18157236615816752
complete-iteration_min	0.1792432427406311
deviation-center-line_max	1.351574729550732
deviation-center-line_mean	1.2048562173391626
deviation-center-line_min	0.9328420545226892
deviation-heading_max	4.144782297111805
deviation-heading_mean	3.569495551148078
deviation-heading_median	3.629085855339937
deviation-heading_min	2.875028196800634
driven_any_max	4.412378155521141
driven_any_mean	4.108247957158492
driven_any_median	4.280925616466341
driven_any_min	3.4587624401801422
driven_lanedir_consec_max	3.954156828878167
driven_lanedir_consec_mean	3.5038775318291457
driven_lanedir_consec_min	2.7781105253448275
driven_lanedir_max	3.954156828878167
driven_lanedir_mean	3.626871547676192
driven_lanedir_median	3.8090966016872794
driven_lanedir_min	2.9351361584520426
get_duckie_state_max	2.351601918538411e-06
get_duckie_state_mean	2.332528432210286e-06
get_duckie_state_median	2.3452440897623696e-06
get_duckie_state_min	2.2880236307779946e-06
get_robot_state_max	0.014440076351165771
get_robot_state_mean	0.013242115974426273
get_robot_state_median	0.012988555431365966
get_robot_state_min	0.012551276683807374
get_state_dump_max	0.012712738513946532
get_state_dump_mean	0.012590213418006896
get_state_dump_median	0.012613382736841835
get_state_dump_min	0.01242134968439738
get_ui_image_max	0.033316384156545004
get_ui_image_mean	0.032597997188568116
get_ui_image_median	0.0325676170984904
get_ui_image_min	0.03194037040074666
in-drivable-lane_max	2.300000000000013
in-drivable-lane_mean	1.650000000000016
in-drivable-lane_min	1.1500000000000163
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.412378155521141, "get_ui_image": 0.03194037040074666, "step_physics": 0.06738365093866984, "survival_time": 14.950000000000076, "driven_lanedir": 3.954156828878167, "get_state_dump": 0.012561731338500977, "sim_render-ego": 0.005380469957987468, "get_robot_state": 0.014440076351165771, "get_duckie_state": 2.339680989583333e-06, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.017915359338124593, "deviation-heading": 2.875028196800634, "complete-iteration": 0.1808221395810445, "set_robot_commands": 0.004465794563293457, "deviation-center-line": 1.2897385322481674, "driven_lanedir_consec": 3.954156828878167, "sim_compute_sim_state": 0.023034818172454834, "sim_compute_performance-ego": 0.003571062882741292}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.256520444716255, "get_ui_image": 0.03212783495585124, "step_physics": 0.06836931784947713, "survival_time": 14.950000000000076, "driven_lanedir": 3.768841561098258, "get_state_dump": 0.01242134968439738, "sim_render-ego": 0.0052073248227437335, "get_robot_state": 0.012551276683807374, "get_duckie_state": 2.350807189941406e-06, "in-drivable-lane": 1.3500000000000094, "agent_compute-ego": 0.018179880777994793, "deviation-heading": 4.144782297111805, "complete-iteration": 0.1792432427406311, "set_robot_commands": 0.004323286215464274, "deviation-center-line": 1.351574729550732, "driven_lanedir_consec": 3.4338911308172886, "sim_compute_sim_state": 0.022418647607167563, "sim_compute_performance-ego": 0.003518648147583008}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.4587624401801422, "get_ui_image": 0.03300739924112956, "step_physics": 0.06905054410298665, "survival_time": 14.950000000000076, "driven_lanedir": 2.9351361584520426, "get_state_dump": 0.012712738513946532, "sim_render-ego": 0.005278726418813069, "get_robot_state": 0.013079337279001872, "get_duckie_state": 2.2880236307779946e-06, "in-drivable-lane": 2.300000000000013, "agent_compute-ego": 0.018240431944529217, "deviation-heading": 4.086806909785164, "complete-iteration": 0.18232259273529053, "set_robot_commands": 0.004307299455006917, "deviation-center-line": 0.9328420545226892, "driven_lanedir_consec": 2.7781105253448275, "sim_compute_sim_state": 0.022967958450317384, "sim_compute_performance-ego": 0.0035438839594523113}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 4.305330788216427, "get_ui_image": 0.033316384156545004, "step_physics": 0.07360779921213786, "survival_time": 14.950000000000076, "driven_lanedir": 3.8493516422763, "get_state_dump": 0.0126650341351827, "sim_render-ego": 0.005204391479492187, "get_robot_state": 0.012897773583730062, "get_duckie_state": 2.351601918538411e-06, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.01828658898671468, "deviation-heading": 3.17136480089471, "complete-iteration": 0.1898339899381002, "set_robot_commands": 0.004391899903615316, "deviation-center-line": 1.2452695530350613, "driven_lanedir_consec": 3.8493516422763, "sim_compute_sim_state": 0.025771826108296713, "sim_compute_performance-ego": 0.0035587088267008465}}
set_robot_commands_max	0.004465794563293457
set_robot_commands_mean	0.004372070034344991
set_robot_commands_median	0.004357593059539795
set_robot_commands_min	0.004307299455006917
sim_compute_performance-ego_max	0.003571062882741292
sim_compute_performance-ego_mean	0.0035480759541193646
sim_compute_performance-ego_median	0.003551296393076579
sim_compute_performance-ego_min	0.003518648147583008
sim_compute_sim_state_max	0.025771826108296713
sim_compute_sim_state_mean	0.02354831258455912
sim_compute_sim_state_median	0.02300138831138611
sim_compute_sim_state_min	0.022418647607167563
sim_render-ego_max	0.005380469957987468
sim_render-ego_mean	0.005267728169759115
sim_render-ego_median	0.005243025620778401
sim_render-ego_min	0.005204391479492187
simulation-passed	1
step_physics_max	0.07360779921213786
step_physics_mean	0.06960282802581788
step_physics_median	0.06870993097623189
step_physics_min	0.06738365093866984
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42946

11569

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-25 07:30:46+00:00

2020-11-25 07:36:34+00:00

0:05:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.090521591493371
survival_time_median	7.699999999999987
deviation-center-line_median	0.19183292727655887
in-drivable-lane_median	3.074999999999989

other stats

agent_compute-ego_max	0.017569554646809895
agent_compute-ego_mean	0.017098461053244224
agent_compute-ego_median	0.01709118564804988
agent_compute-ego_min	0.016641918270067238
complete-iteration_max	0.2155159854888916
complete-iteration_mean	0.1887777041255927
complete-iteration_median	0.18240117952005183
complete-iteration_min	0.17479247197337533
deviation-center-line_max	0.26713747436938645
deviation-center-line_mean	0.1938446411349773
deviation-center-line_min	0.12457523561740504
deviation-heading_max	1.77464631878308
deviation-heading_mean	1.021939539347262
deviation-heading_median	0.8854489228907214
deviation-heading_min	0.5422139928245262
driven_any_max	3.4429132587686135
driven_any_mean	2.4848172383609803
driven_any_median	2.2943086773097576
driven_any_min	1.9077383400557943
driven_lanedir_consec_max	1.9004536671719856
driven_lanedir_consec_mean	1.1473184623541823
driven_lanedir_consec_min	0.5077769992580019
driven_lanedir_max	1.9004536671719856
driven_lanedir_mean	1.1473184623541823
driven_lanedir_median	1.090521591493371
driven_lanedir_min	0.5077769992580019
get_duckie_state_max	3.3942858378092447e-06
get_duckie_state_mean	3.2933938153552073e-06
get_duckie_state_median	3.3166301784230702e-06
get_duckie_state_min	3.1460290667654453e-06
get_robot_state_max	0.015044166564941406
get_robot_state_mean	0.013075910962104469
get_robot_state_median	0.012614820428278255
get_robot_state_min	0.012029836426919963
get_state_dump_max	0.013218093872070312
get_state_dump_mean	0.012751708715463874
get_state_dump_median	0.012751636792873514
get_state_dump_min	0.012285467404038158
get_ui_image_max	0.03583045768737793
get_ui_image_mean	0.03327478461779704
get_ui_image_median	0.032799912963933614
get_ui_image_min	0.031668854855943
in-drivable-lane_max	11.200000000000063
in-drivable-lane_mean	4.825000000000012
in-drivable-lane_min	1.9500000000000048
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.049069664182969, "get_ui_image": 0.03203695033913228, "step_physics": 0.06701389533370289, "survival_time": 6.699999999999984, "driven_lanedir": 1.344594447022216, "get_state_dump": 0.012285467404038158, "sim_render-ego": 0.005086920154628469, "get_robot_state": 0.012029836426919963, "get_duckie_state": 3.3182884330180155e-06, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.016738598026446443, "deviation-heading": 0.5765459725494693, "complete-iteration": 0.1749417194679602, "set_robot_commands": 0.004469768324894692, "deviation-center-line": 0.14724001665273995, "driven_lanedir_consec": 1.344594447022216, "sim_compute_sim_state": 0.02168410037880513, "sim_compute_performance-ego": 0.003468735894160484}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.5395476904365464, "get_ui_image": 0.031668854855943, "step_physics": 0.06725508454202235, "survival_time": 8.699999999999989, "driven_lanedir": 1.9004536671719856, "get_state_dump": 0.012523970384707397, "sim_render-ego": 0.005194433804216056, "get_robot_state": 0.01214389965451997, "get_duckie_state": 3.1460290667654453e-06, "in-drivable-lane": 1.9500000000000048, "agent_compute-ego": 0.016641918270067238, "deviation-heading": 1.1943518732319736, "complete-iteration": 0.17479247197337533, "set_robot_commands": 0.00449924496398575, "deviation-center-line": 0.26713747436938645, "driven_lanedir_consec": 1.9004536671719856, "sim_compute_sim_state": 0.02122332035810098, "sim_compute_performance-ego": 0.003511069834917441}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.4429132587686135, "get_ui_image": 0.03356287558873494, "step_physics": 0.07655165036519368, "survival_time": 14.950000000000076, "driven_lanedir": 0.8364487359645262, "get_state_dump": 0.012979303201039632, "sim_render-ego": 0.005592447916666667, "get_robot_state": 0.01308574120203654, "get_duckie_state": 3.3942858378092447e-06, "in-drivable-lane": 11.200000000000063, "agent_compute-ego": 0.017569554646809895, "deviation-heading": 1.77464631878308, "complete-iteration": 0.18986063957214355, "set_robot_commands": 0.0044894035657246905, "deviation-center-line": 0.23642583790037777, "driven_lanedir_consec": 0.8364487359645262, "sim_compute_sim_state": 0.022196864287058513, "sim_compute_performance-ego": 0.003690133094787598}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 1.9077383400557943, "get_ui_image": 0.03583045768737793, "step_physics": 0.09436826133728028, "survival_time": 6.249999999999986, "driven_lanedir": 0.5077769992580019, "get_state_dump": 0.013218093872070312, "sim_render-ego": 0.005643827438354492, "get_robot_state": 0.015044166564941406, "get_duckie_state": 3.314971923828125e-06, "in-drivable-lane": 3.999999999999986, "agent_compute-ego": 0.01744377326965332, "deviation-heading": 0.5422139928245262, "complete-iteration": 0.2155159854888916, "set_robot_commands": 0.004686428070068359, "deviation-center-line": 0.12457523561740504, "driven_lanedir_consec": 0.5077769992580019, "sim_compute_sim_state": 0.025359828948974608, "sim_compute_performance-ego": 0.003782672882080078}}
set_robot_commands_max	0.004686428070068359
set_robot_commands_mean	0.004536211231168373
set_robot_commands_median	0.00449432426485522
set_robot_commands_min	0.004469768324894692
sim_compute_performance-ego_max	0.003782672882080078
sim_compute_performance-ego_mean	0.0036131529264864
sim_compute_performance-ego_median	0.0036006014648525195
sim_compute_performance-ego_min	0.003468735894160484
sim_compute_sim_state_max	0.025359828948974608
sim_compute_sim_state_mean	0.022616028493234807
sim_compute_sim_state_median	0.021940482332931825
sim_compute_sim_state_min	0.02122332035810098
sim_render-ego_max	0.005643827438354492
sim_render-ego_mean	0.005379407328466421
sim_render-ego_median	0.005393440860441362
sim_render-ego_min	0.005086920154628469
simulation-passed	1
step_physics_max	0.09436826133728028
step_physics_mean	0.0762972228945498
step_physics_median	0.07190336745360801
step_physics_min	0.06701389533370289
survival_time_max	14.950000000000076
survival_time_mean	9.15000000000001
survival_time_min	6.249999999999986

No reset possible

42939

11568

Dishank Bansal 🇨🇦

exercise_state_estimation

LFv-sim

failed

2020-11-25 07:22:44+00:00

2020-11-25 07:26:35+00:00

0:03:51

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 188 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42904

11558

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-25 04:57:01+00:00

2020-11-25 05:05:10+00:00

0:08:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	14.950000000000076
deviation-center-line_median	0.3071094952840746
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.017214128176371257
agent_compute-ego_mean	0.017078521450360616
agent_compute-ego_median	0.017081772089004518
agent_compute-ego_min	0.016936413447062173
complete-iteration_max	0.20176268815994264
complete-iteration_mean	0.18363631327946983
complete-iteration_median	0.17813635945320128
complete-iteration_min	0.17650984605153405
deviation-center-line_max	0.6863069918481528
deviation-center-line_mean	0.35998819605511767
deviation-center-line_min	0.13942680180416853
deviation-heading_max	3.7258518640401217
deviation-heading_mean	1.6586762301304627
deviation-heading_median	1.2113904039371066
deviation-heading_min	0.486072248607516
driven_any_max	1.3686924727581474e-13
driven_any_mean	6.950391439969185e-14
driven_any_median	7.057320516147632e-14
driven_any_min	0.0
driven_lanedir_consec_max	1.7821788787841797e-05
driven_lanedir_consec_mean	4.455447196960449e-06
driven_lanedir_consec_min	0.0
driven_lanedir_max	1.7821788787841797e-05
driven_lanedir_mean	4.455447196960449e-06
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	2.0964940388997395e-06
get_duckie_state_mean	2.0378828048706053e-06
get_duckie_state_median	2.029736836751302e-06
get_duckie_state_min	1.995563507080078e-06
get_robot_state_max	0.01415030558904012
get_robot_state_mean	0.013177488247553508
get_robot_state_median	0.0130071759223938
get_robot_state_min	0.012545295556386312
get_state_dump_max	0.013035433292388916
get_state_dump_mean	0.012809870640436809
get_state_dump_median	0.012777667840321858
get_state_dump_min	0.0126487135887146
get_ui_image_max	0.03458547592163086
get_ui_image_mean	0.03291032791137695
get_ui_image_median	0.032762657006581625
get_ui_image_min	0.0315305217107137
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.0315305217107137, "step_physics": 0.06861086050669352, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.0126487135887146, "sim_render-ego": 0.005331141948699951, "get_robot_state": 0.012545295556386312, "get_duckie_state": 2.0964940388997395e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017166876792907716, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.17650984605153405, "set_robot_commands": 0.004514825344085693, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0204254945119222, "sim_compute_performance-ego": 0.003599588871002198}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.03302137772242228, "step_physics": 0.06793394088745117, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.01288109302520752, "sim_render-ego": 0.00532099723815918, "get_robot_state": 0.012889274756113688, "get_duckie_state": 1.995563507080078e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01699666738510132, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.17680100997289022, "set_robot_commands": 0.004471948146820068, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.019595758120218913, "sim_compute_performance-ego": 0.003554831345876058}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.03250393629074097, "step_physics": 0.06925386826197306, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.013035433292388916, "sim_render-ego": 0.005353077252705892, "get_robot_state": 0.013125077088673907, "get_duckie_state": 2.0273526509602866e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017214128176371257, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.17947170893351236, "set_robot_commands": 0.004505454699198405, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.02070038874944051, "sim_compute_performance-ego": 0.003638796806335449}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.03458547592163086, "step_physics": 0.0864322853088379, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.012674242655436195, "sim_render-ego": 0.0054005861282348635, "get_robot_state": 0.01415030558904012, "get_duckie_state": 2.0321210225423177e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016936413447062173, "deviation-heading": 0.486072248607516, "complete-iteration": 0.20176268815994264, "set_robot_commands": 0.004583951632181804, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.023254028956095376, "sim_compute_performance-ego": 0.003607151508331299}}
set_robot_commands_max	0.004583951632181804
set_robot_commands_mean	0.004519044955571492
set_robot_commands_median	0.0045101400216420486
set_robot_commands_min	0.004471948146820068
sim_compute_performance-ego_max	0.003638796806335449
sim_compute_performance-ego_mean	0.0036000921328862507
sim_compute_performance-ego_median	0.003603370189666748
sim_compute_performance-ego_min	0.003554831345876058
sim_compute_sim_state_max	0.023254028956095376
sim_compute_sim_state_mean	0.02099391758441925
sim_compute_sim_state_median	0.020562941630681356
sim_compute_sim_state_min	0.019595758120218913
sim_render-ego_max	0.0054005861282348635
sim_render-ego_mean	0.005351450641949971
sim_render-ego_median	0.005342109600702922
sim_render-ego_min	0.00532099723815918
simulation-passed	1
step_physics_max	0.0864322853088379
step_physics_mean	0.07305773874123891
step_physics_median	0.06893236438433328
step_physics_min	0.06793394088745117
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42881

11551

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

failed

2020-11-25 02:31:35+00:00

2020-11-25 02:39:11+00:00

0:07:36

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 748 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42871

11554

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

failed

2020-11-25 02:19:07+00:00

2020-11-25 02:23:20+00:00

0:04:13

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 208 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42860

11548

Himanshu Arora 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-25 01:46:12+00:00

2020-11-25 01:55:09+00:00

0:08:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.258180991465037
survival_time_median	14.950000000000076
deviation-center-line_median	0.8148849865565875
in-drivable-lane_median	0.4

other stats

agent_compute-ego_max	0.01755496422449748
agent_compute-ego_mean	0.01696303943792979
agent_compute-ego_median	0.016833475828170776
agent_compute-ego_min	0.016630241870880125
complete-iteration_max	0.2084084852536519
complete-iteration_mean	0.2003024351596832
complete-iteration_median	0.2001538642247518
complete-iteration_min	0.1924935269355774
deviation-center-line_max	1.0421808881382577
deviation-center-line_mean	0.8109705280722536
deviation-center-line_min	0.5719312510375818
deviation-heading_max	3.0432427344243824
deviation-heading_mean	2.698832572418869
deviation-heading_median	2.824396756977799
deviation-heading_min	2.103294041295497
driven_any_max	3.896831059989629
driven_any_mean	3.494024360660935
driven_any_median	3.443989558502454
driven_any_min	3.191287265649204
driven_lanedir_consec_max	3.8070001906932376
driven_lanedir_consec_mean	3.292240093177313
driven_lanedir_consec_min	2.845598199085941
driven_lanedir_max	3.8070001906932376
driven_lanedir_mean	3.292240093177313
driven_lanedir_median	3.258180991465037
driven_lanedir_min	2.845598199085941
get_duckie_state_max	2.53756841023763e-06
get_duckie_state_mean	2.466440200805664e-06
get_duckie_state_median	2.497434616088867e-06
get_duckie_state_min	2.333323160807292e-06
get_robot_state_max	0.01594829559326172
get_robot_state_mean	0.014826402266820271
get_robot_state_median	0.0149227778116862
get_robot_state_min	0.013511757850646972
get_state_dump_max	0.01358243942260742
get_state_dump_mean	0.013467095891634622
get_state_dump_median	0.013491315841674805
get_state_dump_min	0.01330331246058146
get_ui_image_max	0.03639801661173503
get_ui_image_mean	0.03502307494481405
get_ui_image_median	0.035054933627446494
get_ui_image_min	0.033584415912628174
in-drivable-lane_max	1.6999999999999962
in-drivable-lane_mean	0.6249999999999991
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.605701543237043, "get_ui_image": 0.033584415912628174, "step_physics": 0.07519653161366781, "survival_time": 14.950000000000076, "driven_lanedir": 3.5624940732090433, "get_state_dump": 0.0134779159228007, "sim_render-ego": 0.005769574642181396, "get_robot_state": 0.014637998739878337, "get_duckie_state": 2.53756841023763e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016935545603434243, "deviation-heading": 2.103294041295497, "complete-iteration": 0.1924935269355774, "set_robot_commands": 0.004714303016662598, "deviation-center-line": 0.8255571666386079, "driven_lanedir_consec": 3.5624940732090433, "sim_compute_sim_state": 0.02418807029724121, "sim_compute_performance-ego": 0.003840606212615967}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.282277573767863, "get_ui_image": 0.03555295705795288, "step_physics": 0.08090978940327963, "survival_time": 14.950000000000076, "driven_lanedir": 2.9538679097210307, "get_state_dump": 0.013504715760548907, "sim_render-ego": 0.006036200523376465, "get_robot_state": 0.01520755688349406, "get_duckie_state": 2.5240580240885415e-06, "in-drivable-lane": 1.6999999999999962, "agent_compute-ego": 0.016731406052907308, "deviation-heading": 2.8163791100792133, "complete-iteration": 0.20046085198720295, "set_robot_commands": 0.004824686050415039, "deviation-center-line": 0.5719312510375818, "driven_lanedir_consec": 2.9538679097210307, "sim_compute_sim_state": 0.023473443190256755, "sim_compute_performance-ego": 0.004064991474151612}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.191287265649204, "get_ui_image": 0.03639801661173503, "step_physics": 0.08470485687255859, "survival_time": 14.950000000000076, "driven_lanedir": 2.845598199085941, "get_state_dump": 0.01358243942260742, "sim_render-ego": 0.006167867183685303, "get_robot_state": 0.01594829559326172, "get_duckie_state": 2.4708112080891927e-06, "in-drivable-lane": 0.8, "agent_compute-ego": 0.01755496422449748, "deviation-heading": 3.0432427344243824, "complete-iteration": 0.2084084852536519, "set_robot_commands": 0.004821639060974121, "deviation-center-line": 0.804212806474567, "driven_lanedir_consec": 2.845598199085941, "sim_compute_sim_state": 0.02494144678115845, "sim_compute_performance-ego": 0.004131333827972412}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.896831059989629, "get_ui_image": 0.034556910196940106, "step_physics": 0.08159146229426066, "survival_time": 14.950000000000076, "driven_lanedir": 3.8070001906932376, "get_state_dump": 0.01330331246058146, "sim_render-ego": 0.005587332248687744, "get_robot_state": 0.013511757850646972, "get_duckie_state": 2.333323160807292e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016630241870880125, "deviation-heading": 2.8324144038763848, "complete-iteration": 0.19984687646230065, "set_robot_commands": 0.004451142152150472, "deviation-center-line": 1.0421808881382577, "driven_lanedir_consec": 3.8070001906932376, "sim_compute_sim_state": 0.02628467321395874, "sim_compute_performance-ego": 0.00377962589263916}}
set_robot_commands_max	0.004824686050415039
set_robot_commands_mean	0.004702942570050557
set_robot_commands_median	0.004767971038818359
set_robot_commands_min	0.004451142152150472
sim_compute_performance-ego_max	0.004131333827972412
sim_compute_performance-ego_mean	0.003954139351844787
sim_compute_performance-ego_median	0.0039527988433837894
sim_compute_performance-ego_min	0.00377962589263916
sim_compute_sim_state_max	0.02628467321395874
sim_compute_sim_state_mean	0.024721908370653783
sim_compute_sim_state_median	0.02456475853919983
sim_compute_sim_state_min	0.023473443190256755
sim_render-ego_max	0.006167867183685303
sim_render-ego_mean	0.005890243649482727
sim_render-ego_median	0.00590288758277893
sim_render-ego_min	0.005587332248687744
simulation-passed	1
step_physics_max	0.08470485687255859
step_physics_mean	0.08060066004594167
step_physics_median	0.08125062584877014
step_physics_min	0.07519653161366781
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42838

11542

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

failed

2020-11-24 23:40:53+00:00

2020-11-24 23:44:29+00:00

0:03:36

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 216, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 540, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 133, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 279, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego-out after 130 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 544, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42833

11538

Jean-Sébastien Grondin 🇨🇦

exercise_state_estimation

LFv-sim

success

2020-11-24 23:26:47+00:00

2020-11-24 23:33:43+00:00

0:06:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.5284143192650492
survival_time_median	14.950000000000076
deviation-center-line_median	0.663255764765048
in-drivable-lane_median	3.400000000000012

other stats

agent_compute-ego_max	0.017627960046132405
agent_compute-ego_mean	0.016879959049678983
agent_compute-ego_median	0.016689197903587707
agent_compute-ego_min	0.016513480345408123
complete-iteration_max	0.19481964338393437
complete-iteration_mean	0.18955619610491253
complete-iteration_median	0.18890351891517637
complete-iteration_min	0.18559810320536296
deviation-center-line_max	0.7459359698808292
deviation-center-line_mean	0.5353181606607919
deviation-center-line_min	0.06882514323224218
deviation-heading_max	2.9659122094865498
deviation-heading_mean	2.0321409009171276
deviation-heading_median	2.398465098414807
deviation-heading_min	0.3657211973523477
driven_any_max	4.594280579435636
driven_any_mean	3.498045092772194
driven_any_median	4.586861332527864
driven_any_min	0.2241771265974132
driven_lanedir_consec_max	3.97618485764006
driven_lanedir_consec_mean	2.2908060900993688
driven_lanedir_consec_min	0.13021086422731587
driven_lanedir_max	3.97618485764006
driven_lanedir_mean	2.2908060900993688
driven_lanedir_median	2.5284143192650492
driven_lanedir_min	0.13021086422731587
get_duckie_state_max	2.4731953938802083e-06
get_duckie_state_mean	2.229838144211542e-06
get_duckie_state_median	2.2466977437337236e-06
get_duckie_state_min	1.9527616954985117e-06
get_robot_state_max	0.014125624497731526
get_robot_state_mean	0.013338601191838582
get_robot_state_median	0.013327053785324096
get_robot_state_min	0.01257467269897461
get_state_dump_max	0.013181517124176026
get_state_dump_mean	0.012871338327725728
get_state_dump_median	0.012876383463541663
get_state_dump_min	0.012551069259643556
get_ui_image_max	0.033554395039876304
get_ui_image_mean	0.033360958099365234
get_ui_image_median	0.033322242498397825
get_ui_image_min	0.03324495236078898
in-drivable-lane_max	6.700000000000079
in-drivable-lane_mean	3.412500000000026
in-drivable-lane_min	0.15000000000000002
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.579475381645463, "get_ui_image": 0.03337915261586507, "step_physics": 0.07274380366007487, "survival_time": 14.950000000000076, "driven_lanedir": 3.97618485764006, "get_state_dump": 0.013181517124176026, "sim_render-ego": 0.005581701596577962, "get_robot_state": 0.014125624497731526, "get_duckie_state": 2.4731953938802083e-06, "in-drivable-lane": 1.4500000000000206, "agent_compute-ego": 0.01669109344482422, "deviation-heading": 2.631298504164542, "complete-iteration": 0.18768948872884111, "set_robot_commands": 0.004654688040415446, "deviation-center-line": 0.7459359698808292, "driven_lanedir_consec": 3.97618485764006, "sim_compute_sim_state": 0.023423024813334147, "sim_compute_performance-ego": 0.003764220078786214}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.594280579435636, "get_ui_image": 0.03324495236078898, "step_physics": 0.07276361068089802, "survival_time": 14.950000000000076, "driven_lanedir": 2.7020248860722846, "get_state_dump": 0.012944506804148355, "sim_render-ego": 0.005578021208445231, "get_robot_state": 0.013443543910980224, "get_duckie_state": 2.288818359375e-06, "in-drivable-lane": 5.350000000000003, "agent_compute-ego": 0.016513480345408123, "deviation-heading": 2.9659122094865498, "complete-iteration": 0.18559810320536296, "set_robot_commands": 0.004392704168955485, "deviation-center-line": 0.7313828644281988, "driven_lanedir_consec": 2.7020248860722846, "sim_compute_sim_state": 0.022900203069051103, "sim_compute_performance-ego": 0.003673548698425293}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 4.594247283410264, "get_ui_image": 0.03326533238093058, "step_physics": 0.07642165422439576, "survival_time": 14.950000000000076, "driven_lanedir": 2.354803752457814, "get_state_dump": 0.012808260122934977, "sim_render-ego": 0.0055265291531880695, "get_robot_state": 0.01321056365966797, "get_duckie_state": 2.204577128092448e-06, "in-drivable-lane": 6.700000000000079, "agent_compute-ego": 0.017627960046132405, "deviation-heading": 2.1656316926650723, "complete-iteration": 0.19011754910151163, "set_robot_commands": 0.004431865215301514, "deviation-center-line": 0.5951286651018972, "driven_lanedir_consec": 2.354803752457814, "sim_compute_sim_state": 0.023075551191965735, "sim_compute_performance-ego": 0.003609143098195394}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.2241771265974132, "get_ui_image": 0.033554395039876304, "step_physics": 0.08138762201581683, "survival_time": 1.0500000000000005, "driven_lanedir": 0.13021086422731587, "get_state_dump": 0.012551069259643556, "sim_render-ego": 0.005381107330322266, "get_robot_state": 0.01257467269897461, "get_duckie_state": 1.9527616954985117e-06, "in-drivable-lane": 0.15000000000000002, "agent_compute-ego": 0.016687302362351192, "deviation-heading": 0.3657211973523477, "complete-iteration": 0.19481964338393437, "set_robot_commands": 0.0046544983273460756, "deviation-center-line": 0.06882514323224218, "driven_lanedir_consec": 0.13021086422731587, "sim_compute_sim_state": 0.02430219877333868, "sim_compute_performance-ego": 0.0035903453826904297}}
set_robot_commands_max	0.004654688040415446
set_robot_commands_mean	0.00453343893800463
set_robot_commands_median	0.004543181771323795
set_robot_commands_min	0.004392704168955485
sim_compute_performance-ego_max	0.003764220078786214
sim_compute_performance-ego_mean	0.0036593143145243327
sim_compute_performance-ego_median	0.003641345898310343
sim_compute_performance-ego_min	0.0035903453826904297
sim_compute_sim_state_max	0.02430219877333868
sim_compute_sim_state_mean	0.02342524446192242
sim_compute_sim_state_median	0.023249288002649943
sim_compute_sim_state_min	0.022900203069051103
sim_render-ego_max	0.005581701596577962
sim_render-ego_mean	0.005516839822133382
sim_render-ego_median	0.0055522751808166505
sim_render-ego_min	0.005381107330322266
simulation-passed	1
step_physics_max	0.08138762201581683
step_physics_mean	0.07582917264529637
step_physics_median	0.07459263245264688
step_physics_min	0.07274380366007487
survival_time_max	14.950000000000076
survival_time_mean	11.475000000000058
survival_time_min	1.0500000000000005

No reset possible

42815

11540

Jean-Sébastien Grondin 🇨🇦

exercise_state_estimation

LFv-sim

success

2020-11-24 23:19:28+00:00

2020-11-24 23:25:41+00:00

0:06:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.6829791507067116
survival_time_median	9.850000000000003
deviation-center-line_median	0.46206313780174313
in-drivable-lane_median	1.4749999999999992

other stats

agent_compute-ego_max	0.01771020067149195
agent_compute-ego_mean	0.017410667298208185
agent_compute-ego_median	0.017458993358376584
agent_compute-ego_min	0.017014481804587624
complete-iteration_max	0.20924902698140083
complete-iteration_mean	0.19889483849157963
complete-iteration_median	0.2000293487173387
complete-iteration_min	0.18627162955024024
deviation-center-line_max	1.2423035069732944
deviation-center-line_mean	0.5536391691224951
deviation-center-line_min	0.048126893913199735
deviation-heading_max	3.4237525400537363
deviation-heading_mean	1.9472323688849824
deviation-heading_median	1.943036312216431
deviation-heading_min	0.4791043110533313
driven_any_max	5.102723926809116
driven_any_mean	3.0948740463429756
driven_any_median	3.314712684932273
driven_any_min	0.6473468886982412
driven_lanedir_consec_max	4.278021996698246
driven_lanedir_consec_mean	2.4477094963110577
driven_lanedir_consec_min	0.14685768713256242
driven_lanedir_max	4.278021996698246
driven_lanedir_mean	2.4477094963110577
driven_lanedir_median	2.6829791507067116
driven_lanedir_min	0.14685768713256242
get_duckie_state_max	3.077767112038352e-06
get_duckie_state_mean	2.713441684974172e-06
get_duckie_state_median	2.659113927819263e-06
get_duckie_state_min	2.457771772219811e-06
get_robot_state_max	0.015834973803881942
get_robot_state_mean	0.014972505284029752
get_robot_state_median	0.015172092737974943
get_robot_state_min	0.013710861856287176
get_state_dump_max	0.013543142326946917
get_state_dump_mean	0.013286375108841168
get_state_dump_median	0.013264007126843488
get_state_dump_min	0.01307434385473078
get_ui_image_max	0.03524374859086398
get_ui_image_mean	0.03458892930366661
get_ui_image_median	0.03491511796727593
get_ui_image_min	0.0332817326892506
in-drivable-lane_max	2.1500000000000075
in-drivable-lane_mean	1.462500000000001
in-drivable-lane_min	0.7499999999999982
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.917782015596443, "get_ui_image": 0.03524374859086398, "step_physics": 0.08185386349414957, "survival_time": 11.60000000000003, "driven_lanedir": 2.975454527812983, "get_state_dump": 0.013543142326946917, "sim_render-ego": 0.006259597581008385, "get_robot_state": 0.015834973803881942, "get_duckie_state": 2.7448966585356612e-06, "in-drivable-lane": 2.1500000000000075, "agent_compute-ego": 0.01771020067149195, "deviation-heading": 2.5369608654262192, "complete-iteration": 0.2045822194938002, "set_robot_commands": 0.004800766706466675, "deviation-center-line": 0.5537064811407305, "driven_lanedir_consec": 2.975454527812983, "sim_compute_sim_state": 0.025130994361022424, "sim_compute_performance-ego": 0.004046211982595509}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 5.102723926809116, "get_ui_image": 0.03463320016860962, "step_physics": 0.07609281380971272, "survival_time": 14.950000000000076, "driven_lanedir": 4.278021996698246, "get_state_dump": 0.013367794354756673, "sim_render-ego": 0.005950071016947428, "get_robot_state": 0.015383971532185872, "get_duckie_state": 2.5733311971028645e-06, "in-drivable-lane": 1.6999999999999986, "agent_compute-ego": 0.017403831481933595, "deviation-heading": 3.4237525400537363, "complete-iteration": 0.19547647794087727, "set_robot_commands": 0.0047501866022745766, "deviation-center-line": 1.2423035069732944, "driven_lanedir_consec": 4.278021996698246, "sim_compute_sim_state": 0.023817357222239176, "sim_compute_performance-ego": 0.00392257293065389}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.6473468886982412, "get_ui_image": 0.0332817326892506, "step_physics": 0.07343916459517046, "survival_time": 2.2, "driven_lanedir": 0.14685768713256242, "get_state_dump": 0.01307434385473078, "sim_render-ego": 0.005687968297438188, "get_robot_state": 0.013710861856287176, "get_duckie_state": 3.077767112038352e-06, "in-drivable-lane": 1.25, "agent_compute-ego": 0.017014481804587624, "deviation-heading": 0.4791043110533313, "complete-iteration": 0.18627162955024024, "set_robot_commands": 0.004395842552185059, "deviation-center-line": 0.048126893913199735, "driven_lanedir_consec": 0.14685768713256242, "sim_compute_sim_state": 0.021676551211964, "sim_compute_performance-ego": 0.003836084495891224}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.7116433542681024, "get_ui_image": 0.035197035765942235, "step_physics": 0.0869343442681395, "survival_time": 8.09999999999998, "driven_lanedir": 2.3905037736004404, "get_state_dump": 0.013160219898930304, "sim_render-ego": 0.00583643972137828, "get_robot_state": 0.014960213943764017, "get_duckie_state": 2.457771772219811e-06, "in-drivable-lane": 0.7499999999999982, "agent_compute-ego": 0.017514155234819577, "deviation-heading": 1.3491117590066426, "complete-iteration": 0.20924902698140083, "set_robot_commands": 0.004729403389824761, "deviation-center-line": 0.3704197944627557, "driven_lanedir_consec": 2.3905037736004404, "sim_compute_sim_state": 0.026775439580281574, "sim_compute_performance-ego": 0.003988717809135531}}
set_robot_commands_max	0.004800766706466675
set_robot_commands_mean	0.0046690498126877675
set_robot_commands_median	0.004739794996049668
set_robot_commands_min	0.004395842552185059
sim_compute_performance-ego_max	0.004046211982595509
sim_compute_performance-ego_mean	0.003948396804569039
sim_compute_performance-ego_median	0.003955645369894711
sim_compute_performance-ego_min	0.003836084495891224
sim_compute_sim_state_max	0.026775439580281574
sim_compute_sim_state_mean	0.024350085593876792
sim_compute_sim_state_median	0.0244741757916308
sim_compute_sim_state_min	0.021676551211964
sim_render-ego_max	0.006259597581008385
sim_render-ego_mean	0.00593351915419307
sim_render-ego_median	0.005893255369162854
sim_render-ego_min	0.005687968297438188
simulation-passed	1
step_physics_max	0.0869343442681395
step_physics_mean	0.07958004654179307
step_physics_median	0.07897333865193115
step_physics_min	0.07343916459517046
survival_time_max	14.950000000000076
survival_time_mean	9.212500000000022
survival_time_min	2.2

No reset possible

42795

11539

Jean-Sébastien Grondin 🇨🇦

exercise_state_estimation

LFv-sim

success

2020-11-24 23:11:39+00:00

2020-11-24 23:18:55+00:00

0:07:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.660773267676668
survival_time_median	14.950000000000076
deviation-center-line_median	0.47353412124693306
in-drivable-lane_median	1.050000000000006

other stats

agent_compute-ego_max	0.017702062129974366
agent_compute-ego_mean	0.017097222407658895
agent_compute-ego_median	0.017016404072443644
agent_compute-ego_min	0.016654019355773927
complete-iteration_max	0.20327575445175172
complete-iteration_mean	0.193942068417867
complete-iteration_median	0.19412150303522743
complete-iteration_min	0.18424951314926147
deviation-center-line_max	0.7831198318151945
deviation-center-line_mean	0.45503876991095393
deviation-center-line_min	0.08996700533475498
deviation-heading_max	3.236205767742069
deviation-heading_mean	2.246249016317919
deviation-heading_median	2.4212216883945414
deviation-heading_min	0.9063469207405238
driven_any_max	3.573490283759085
driven_any_mean	2.8093253146872854
driven_any_median	3.567641468842238
driven_any_min	0.5285280373055788
driven_lanedir_consec_max	3.318301152288261
driven_lanedir_consec_mean	2.1910073715131526
driven_lanedir_consec_min	0.12418179841101262
driven_lanedir_max	3.318301152288261
driven_lanedir_mean	2.192805775137038
driven_lanedir_median	2.660773267676668
driven_lanedir_min	0.13137541290655508
get_duckie_state_max	2.699693044026693e-06
get_duckie_state_mean	2.460281054178874e-06
get_duckie_state_median	2.420345942179362e-06
get_duckie_state_min	2.300739288330078e-06
get_robot_state_max	0.015220210552215577
get_robot_state_mean	0.01490416387716929
get_robot_state_median	0.014979075590769449
get_robot_state_min	0.014438293774922688
get_state_dump_max	0.01347242832183838
get_state_dump_mean	0.013209183812141418
get_state_dump_median	0.0132574729124705
get_state_dump_min	0.012849361101786297
get_ui_image_max	0.034952553113301595
get_ui_image_mean	0.03392011940479279
get_ui_image_median	0.03402787963549296
get_ui_image_min	0.03267216523488363
in-drivable-lane_max	5.65000000000008
in-drivable-lane_mean	2.0875000000000252
in-drivable-lane_min	0.6000000000000085
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.561831437379021, "get_ui_image": 0.034952553113301595, "step_physics": 0.07954574267069499, "survival_time": 14.950000000000076, "driven_lanedir": 3.318301152288261, "get_state_dump": 0.013311663468678792, "sim_render-ego": 0.0059779159228007, "get_robot_state": 0.015220210552215577, "get_duckie_state": 2.699693044026693e-06, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.017702062129974366, "deviation-heading": 2.5825133103509703, "complete-iteration": 0.20082215150197347, "set_robot_commands": 0.004828766981760661, "deviation-center-line": 0.5755431102388974, "driven_lanedir_consec": 3.318301152288261, "sim_compute_sim_state": 0.024988967577616372, "sim_compute_performance-ego": 0.004147709210713705}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.573490283759085, "get_ui_image": 0.03267216523488363, "step_physics": 0.07047835191090902, "survival_time": 14.950000000000076, "driven_lanedir": 3.225945326161698, "get_state_dump": 0.012849361101786297, "sim_render-ego": 0.0056034151713053384, "get_robot_state": 0.014438293774922688, "get_duckie_state": 2.300739288330078e-06, "in-drivable-lane": 0.9000000000000128, "agent_compute-ego": 0.017028366724650065, "deviation-heading": 3.236205767742069, "complete-iteration": 0.18424951314926147, "set_robot_commands": 0.0045249287287394205, "deviation-center-line": 0.7831198318151945, "driven_lanedir_consec": 3.225945326161698, "sim_compute_sim_state": 0.02276290893554687, "sim_compute_performance-ego": 0.0037563673655192057}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.5285280373055788, "get_ui_image": 0.03328868389129638, "step_physics": 0.07248273372650146, "survival_time": 2.499999999999999, "driven_lanedir": 0.13137541290655508, "get_state_dump": 0.013203282356262207, "sim_render-ego": 0.0058334445953369144, "get_robot_state": 0.014823579788208007, "get_duckie_state": 2.384185791015625e-06, "in-drivable-lane": 1.1999999999999993, "agent_compute-ego": 0.016654019355773927, "deviation-heading": 0.9063469207405238, "complete-iteration": 0.18742085456848143, "set_robot_commands": 0.004415931701660156, "deviation-center-line": 0.08996700533475498, "driven_lanedir_consec": 0.12418179841101262, "sim_compute_sim_state": 0.022444138526916502, "sim_compute_performance-ego": 0.004130506515502929}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.573451500305455, "get_ui_image": 0.03476707537968953, "step_physics": 0.08144442478815715, "survival_time": 14.950000000000076, "driven_lanedir": 2.0956012091916376, "get_state_dump": 0.01347242832183838, "sim_render-ego": 0.005851199626922607, "get_robot_state": 0.015134571393330892, "get_duckie_state": 2.456506093343099e-06, "in-drivable-lane": 5.65000000000008, "agent_compute-ego": 0.017004441420237222, "deviation-heading": 2.259930066438113, "complete-iteration": 0.20327575445175172, "set_robot_commands": 0.004721587498982748, "deviation-center-line": 0.3715251322549688, "driven_lanedir_consec": 2.0956012091916376, "sim_compute_sim_state": 0.0268098251024882, "sim_compute_performance-ego": 0.00393046776453654}}
set_robot_commands_max	0.004828766981760661
set_robot_commands_mean	0.004622803727785746
set_robot_commands_median	0.004623258113861084
set_robot_commands_min	0.004415931701660156
sim_compute_performance-ego_max	0.004147709210713705
sim_compute_performance-ego_mean	0.003991262714068095
sim_compute_performance-ego_median	0.004030487140019735
sim_compute_performance-ego_min	0.0037563673655192057
sim_compute_sim_state_max	0.0268098251024882
sim_compute_sim_state_mean	0.024251460035641985
sim_compute_sim_state_median	0.023875938256581623
sim_compute_sim_state_min	0.022444138526916502
sim_render-ego_max	0.0059779159228007
sim_render-ego_mean	0.00581649382909139
sim_render-ego_median	0.00584232211112976
sim_render-ego_min	0.0056034151713053384
simulation-passed	1
step_physics_max	0.08144442478815715
step_physics_mean	0.07598781327406566
step_physics_median	0.07601423819859823
step_physics_min	0.07047835191090902
survival_time_max	14.950000000000076
survival_time_mean	11.83750000000006
survival_time_min	2.499999999999999

No reset possible

42737

11523

sim-exercise-2

LFv-sim

error

2020-11-24 17:45:52+00:00

2020-11-24 17:52:59+00:00

0:07:07

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42718

11518

sim-exercise-2

LFv-sim

success

2020-11-24 17:28:25+00:00

2020-11-24 17:37:03+00:00

0:08:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.704105607406596
survival_time_median	14.950000000000076
deviation-center-line_median	0.5945091242021082
in-drivable-lane_median	1.3500000000000054

other stats

agent_compute-ego_max	0.017256828943888348
agent_compute-ego_mean	0.017050531506538392
agent_compute-ego_median	0.017132706244786577
agent_compute-ego_min	0.016679884592692058
complete-iteration_max	0.20675753990809123
complete-iteration_mean	0.19059156318505605
complete-iteration_median	0.1909396962324778
complete-iteration_min	0.17372932036717734
deviation-center-line_max	1.121064597008992
deviation-center-line_mean	0.6731639794763515
deviation-center-line_min	0.3825730724921976
deviation-heading_max	2.6258793436632852
deviation-heading_mean	1.6872640355886102
deviation-heading_median	1.481779704149116
deviation-heading_min	1.1596173903929246
driven_any_max	3.123107359421804
driven_any_mean	2.9572566851422124
driven_any_median	2.9762162352036476
driven_any_min	2.75348691073975
driven_lanedir_consec_max	3.1016513638902303
driven_lanedir_consec_mean	2.656440201765671
driven_lanedir_consec_min	2.115898228359262
driven_lanedir_max	3.1016513638902303
driven_lanedir_mean	2.656440201765671
driven_lanedir_median	2.704105607406596
driven_lanedir_min	2.115898228359262
get_duckie_state_max	2.72671381632487e-06
get_duckie_state_mean	2.520879109700521e-06
get_duckie_state_median	2.534786860148112e-06
get_duckie_state_min	2.2872289021809897e-06
get_robot_state_max	0.01497323989868164
get_robot_state_mean	0.01384261985619863
get_robot_state_median	0.014413185119628906
get_robot_state_min	0.011570869286855062
get_state_dump_max	0.01350472132364909
get_state_dump_mean	0.012875927885373431
get_state_dump_median	0.012958991527557372
get_state_dump_min	0.0120810071627299
get_ui_image_max	0.035550911426544186
get_ui_image_mean	0.033782784342765805
get_ui_image_median	0.03382286667823792
get_ui_image_min	0.03193449258804321
in-drivable-lane_max	4.20000000000006
in-drivable-lane_mean	1.7250000000000176
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.0668264165493664, "get_ui_image": 0.03193449258804321, "step_physics": 0.06717334032058715, "survival_time": 14.950000000000076, "driven_lanedir": 3.034279526591564, "get_state_dump": 0.0120810071627299, "sim_render-ego": 0.005045448939005534, "get_robot_state": 0.011570869286855062, "get_duckie_state": 2.2872289021809897e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016679884592692058, "deviation-heading": 1.6103715927917932, "complete-iteration": 0.17372932036717734, "set_robot_commands": 0.004438196023305257, "deviation-center-line": 0.6339920038483832, "driven_lanedir_consec": 3.034279526591564, "sim_compute_sim_state": 0.02120508591334025, "sim_compute_performance-ego": 0.003470309575398763}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.123107359421804, "get_ui_image": 0.0322355588277181, "step_physics": 0.06945586760838826, "survival_time": 14.950000000000076, "driven_lanedir": 3.1016513638902303, "get_state_dump": 0.01268261432647705, "sim_render-ego": 0.005460547606150309, "get_robot_state": 0.013867990175882977, "get_duckie_state": 2.5010108947753907e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017071233590443928, "deviation-heading": 1.3531878155064383, "complete-iteration": 0.18081995248794555, "set_robot_commands": 0.004571878910064697, "deviation-center-line": 0.5550262445558333, "driven_lanedir_consec": 3.1016513638902303, "sim_compute_sim_state": 0.021679272651672365, "sim_compute_performance-ego": 0.003658731778462728}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8856060538579293, "get_ui_image": 0.03541017452875773, "step_physics": 0.08176432371139526, "survival_time": 14.950000000000076, "driven_lanedir": 2.373931688221628, "get_state_dump": 0.013235368728637696, "sim_render-ego": 0.005941460132598877, "get_robot_state": 0.014958380063374835, "get_duckie_state": 2.5685628255208338e-06, "in-drivable-lane": 2.700000000000011, "agent_compute-ego": 0.017256828943888348, "deviation-heading": 2.6258793436632852, "complete-iteration": 0.2010594399770101, "set_robot_commands": 0.004826313654581706, "deviation-center-line": 1.121064597008992, "driven_lanedir_consec": 2.373931688221628, "sim_compute_sim_state": 0.023586726983388265, "sim_compute_performance-ego": 0.0039307022094726566}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.75348691073975, "get_ui_image": 0.035550911426544186, "step_physics": 0.08356112480163574, "survival_time": 14.950000000000076, "driven_lanedir": 2.115898228359262, "get_state_dump": 0.01350472132364909, "sim_render-ego": 0.005926973819732666, "get_robot_state": 0.01497323989868164, "get_duckie_state": 2.72671381632487e-06, "in-drivable-lane": 4.20000000000006, "agent_compute-ego": 0.01719417889912923, "deviation-heading": 1.1596173903929246, "complete-iteration": 0.20675753990809123, "set_robot_commands": 0.004664466381072998, "deviation-center-line": 0.3825730724921976, "driven_lanedir_consec": 2.115898228359262, "sim_compute_sim_state": 0.027240381240844727, "sim_compute_performance-ego": 0.003987744649251302}}
set_robot_commands_max	0.004826313654581706
set_robot_commands_mean	0.004625213742256165
set_robot_commands_median	0.004618172645568847
set_robot_commands_min	0.004438196023305257
sim_compute_performance-ego_max	0.003987744649251302
sim_compute_performance-ego_mean	0.003761872053146362
sim_compute_performance-ego_median	0.003794716993967692
sim_compute_performance-ego_min	0.003470309575398763
sim_compute_sim_state_max	0.027240381240844727
sim_compute_sim_state_mean	0.0234278666973114
sim_compute_sim_state_median	0.022632999817530315
sim_compute_sim_state_min	0.02120508591334025
sim_render-ego_max	0.005941460132598877
sim_render-ego_mean	0.005593607624371846
sim_render-ego_median	0.005693760712941488
sim_render-ego_min	0.005045448939005534
simulation-passed	1
step_physics_max	0.08356112480163574
step_physics_mean	0.0754886641105016
step_physics_median	0.07561009565989177
step_physics_min	0.06717334032058715
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42696

11509

sim-exercise-2

LFv-sim

success

2020-11-24 15:51:51+00:00

2020-11-24 15:59:27+00:00

0:07:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.363669442398292
survival_time_median	14.950000000000076
deviation-center-line_median	0.44943986528362345
in-drivable-lane_median	0.5500000000000078

other stats

agent_compute-ego_max	0.02032063678353133
agent_compute-ego_mean	0.017883654722196614
agent_compute-ego_median	0.017253538370132444
agent_compute-ego_min	0.016706905364990234
complete-iteration_max	0.1844152275721232
complete-iteration_mean	0.18107587410661272
complete-iteration_median	0.1817030505339305
complete-iteration_min	0.17648216778646686
deviation-center-line_max	0.6304736964487058
deviation-center-line_mean	0.41359074059763234
deviation-center-line_min	0.12500953537457685
deviation-heading_max	2.016527059618454
deviation-heading_mean	1.3773034332316534
deviation-heading_median	1.4642432547028772
deviation-heading_min	0.5642001639024048
driven_any_max	3.6654816572587854
driven_any_mean	3.139931293308994
driven_any_median	3.538376427984657
driven_any_min	1.8174906600078748
driven_lanedir_consec_max	3.641869098650567
driven_lanedir_consec_mean	2.758013244738919
driven_lanedir_consec_min	0.6628449955085255
driven_lanedir_max	3.641869098650567
driven_lanedir_mean	2.759745910939583
driven_lanedir_median	3.36713477479962
driven_lanedir_min	0.6628449955085255
get_duckie_state_max	2.3523966471354168e-06
get_duckie_state_mean	2.180521121757949e-06
get_duckie_state_median	2.198585731064726e-06
get_duckie_state_min	1.972516377766927e-06
get_robot_state_max	0.01326854387919108
get_robot_state_mean	0.012377297656978675
get_robot_state_median	0.012486143066973505
get_robot_state_min	0.011268360614776611
get_state_dump_max	0.013135139942169189
get_state_dump_mean	0.01257873096508894
get_state_dump_median	0.012634092538418646
get_state_dump_min	0.011911598841349284
get_ui_image_max	0.03309324026107788
get_ui_image_mean	0.03258228730179831
get_ui_image_median	0.032551075617472336
get_ui_image_min	0.03213375771117068
in-drivable-lane_max	5.449999999999986
in-drivable-lane_mean	1.6375000000000004
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.447717135027011, "get_ui_image": 0.032820441722869874, "step_physics": 0.0705620280901591, "survival_time": 14.950000000000076, "driven_lanedir": 3.1367014006546916, "get_state_dump": 0.01310244878133138, "sim_render-ego": 0.005338873068491618, "get_robot_state": 0.01326854387919108, "get_duckie_state": 2.3523966471354168e-06, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.016819804509480795, "deviation-heading": 2.016527059618454, "complete-iteration": 0.1830315852165222, "set_robot_commands": 0.004495829741160075, "deviation-center-line": 0.4070236668847334, "driven_lanedir_consec": 3.129770735852036, "sim_compute_sim_state": 0.02290309270222982, "sim_compute_performance-ego": 0.003587988217671712}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.629035720942303, "get_ui_image": 0.03228170951207479, "step_physics": 0.06930086453755696, "survival_time": 14.950000000000076, "driven_lanedir": 3.597568148944548, "get_state_dump": 0.013135139942169189, "sim_render-ego": 0.005376163323720296, "get_robot_state": 0.013049245675404868, "get_duckie_state": 2.299944559733073e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016706905364990234, "deviation-heading": 1.6727057664595042, "complete-iteration": 0.1803745158513387, "set_robot_commands": 0.004403440157572428, "deviation-center-line": 0.4918560636825136, "driven_lanedir_consec": 3.597568148944548, "sim_compute_sim_state": 0.022322561740875244, "sim_compute_performance-ego": 0.003663582801818848}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.8174906600078748, "get_ui_image": 0.03213375771117068, "step_physics": 0.06648142180756894, "survival_time": 8.349999999999984, "driven_lanedir": 0.6628449955085255, "get_state_dump": 0.012165736295505911, "sim_render-ego": 0.005079840471644601, "get_robot_state": 0.011923040458542145, "get_duckie_state": 2.097226902396379e-06, "in-drivable-lane": 5.449999999999986, "agent_compute-ego": 0.02032063678353133, "deviation-heading": 0.5642001639024048, "complete-iteration": 0.17648216778646686, "set_robot_commands": 0.004394679726240878, "deviation-center-line": 0.12500953537457685, "driven_lanedir_consec": 0.6628449955085255, "sim_compute_sim_state": 0.020395550185334895, "sim_compute_performance-ego": 0.003454997867881181}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.6654816572587854, "get_ui_image": 0.03309324026107788, "step_physics": 0.07414922714233399, "survival_time": 14.950000000000076, "driven_lanedir": 3.641869098650567, "get_state_dump": 0.011911598841349284, "sim_render-ego": 0.004918957551320394, "get_robot_state": 0.011268360614776611, "get_duckie_state": 1.972516377766927e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017687272230784097, "deviation-heading": 1.25578074294625, "complete-iteration": 0.1844152275721232, "set_robot_commands": 0.004347940286000569, "deviation-center-line": 0.6304736964487058, "driven_lanedir_consec": 3.641869098650567, "sim_compute_sim_state": 0.023619887828826906, "sim_compute_performance-ego": 0.003294384479522705}}
set_robot_commands_max	0.004495829741160075
set_robot_commands_mean	0.0044104724777434875
set_robot_commands_median	0.004399059941906653
set_robot_commands_min	0.004347940286000569
sim_compute_performance-ego_max	0.003663582801818848
sim_compute_performance-ego_mean	0.003500238341723612
sim_compute_performance-ego_median	0.0035214930427764466
sim_compute_performance-ego_min	0.003294384479522705
sim_compute_sim_state_max	0.023619887828826906
sim_compute_sim_state_mean	0.02231027311431671
sim_compute_sim_state_median	0.022612827221552532
sim_compute_sim_state_min	0.020395550185334895
sim_render-ego_max	0.005376163323720296
sim_render-ego_mean	0.005178458603794227
sim_render-ego_median	0.00520935677006811
sim_render-ego_min	0.004918957551320394
simulation-passed	1
step_physics_max	0.07414922714233399
step_physics_mean	0.07012338539440474
step_physics_median	0.06993144631385803
step_physics_min	0.06648142180756894
survival_time_max	14.950000000000076
survival_time_mean	13.300000000000054
survival_time_min	8.349999999999984

No reset possible

42682

11505

sim-exercise-2

LFv-sim

success

2020-11-24 15:11:50+00:00

2020-11-24 15:19:16+00:00

0:07:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.623794429765874
survival_time_median	12.575000000000044
deviation-center-line_median	0.34726243615406077
in-drivable-lane_median	3.075000000000039

other stats

agent_compute-ego_max	0.01686004638671875
agent_compute-ego_mean	0.016714399372245753
agent_compute-ego_median	0.01677022479912814
agent_compute-ego_min	0.016457101504007976
complete-iteration_max	0.2045522507499246
complete-iteration_mean	0.18966857485400113
complete-iteration_median	0.18660440983871615
complete-iteration_min	0.18091322898864745
deviation-center-line_max	0.5958084291313248
deviation-center-line_mean	0.3461624218310206
deviation-center-line_min	0.09431638588463592
deviation-heading_max	1.922652053391748
deviation-heading_mean	1.165482145502139
deviation-heading_median	1.112874980688788
deviation-heading_min	0.5135265672392315
driven_any_max	4.111095475004892
driven_any_mean	3.3450804089295794
driven_any_median	3.5293492565625457
driven_any_min	2.210527647588334
driven_lanedir_consec_max	3.7165688784116178
driven_lanedir_consec_mean	2.4086056720007347
driven_lanedir_consec_min	0.6702649500595715
driven_lanedir_max	3.7165688784116178
driven_lanedir_mean	2.4086056720007347
driven_lanedir_median	2.623794429765874
driven_lanedir_min	0.6702649500595715
get_duckie_state_max	2.4110663170908013e-06
get_duckie_state_mean	2.325874771557602e-06
get_duckie_state_median	2.3180991411209106e-06
get_duckie_state_min	2.2562344868977864e-06
get_robot_state_max	0.015306343050564036
get_robot_state_mean	0.014019167351664282
get_robot_state_median	0.013765993068615597
get_robot_state_min	0.0132383402188619
get_state_dump_max	0.013298440213296929
get_state_dump_mean	0.013076824144843744
get_state_dump_median	0.013086620047688484
get_state_dump_min	0.012835616270701093
get_ui_image_max	0.03868590850456088
get_ui_image_mean	0.03428205982800208
get_ui_image_median	0.033198268637061115
get_ui_image_min	0.03204579353332519
in-drivable-lane_max	7.100000000000002
in-drivable-lane_mean	3.637500000000024
in-drivable-lane_min	1.3000000000000185
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.111095475004892, "get_ui_image": 0.03263640562693278, "step_physics": 0.0730564022064209, "survival_time": 14.950000000000076, "driven_lanedir": 3.1042349510683658, "get_state_dump": 0.013014676570892334, "sim_render-ego": 0.005585485299428304, "get_robot_state": 0.013720142046610512, "get_duckie_state": 2.347628275553385e-06, "in-drivable-lane": 3.450000000000049, "agent_compute-ego": 0.01686004638671875, "deviation-heading": 1.246294287829928, "complete-iteration": 0.18649905681610107, "set_robot_commands": 0.004411543210347493, "deviation-center-line": 0.3737470666712854, "driven_lanedir_consec": 3.1042349510683658, "sim_compute_sim_state": 0.023322184880574543, "sim_compute_performance-ego": 0.003744118213653564}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 4.075244312677252, "get_ui_image": 0.03204579353332519, "step_physics": 0.07055423418680827, "survival_time": 14.950000000000076, "driven_lanedir": 3.7165688784116178, "get_state_dump": 0.012835616270701093, "sim_render-ego": 0.005435758431752522, "get_robot_state": 0.0132383402188619, "get_duckie_state": 2.2562344868977864e-06, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.016457101504007976, "deviation-heading": 1.922652053391748, "complete-iteration": 0.18091322898864745, "set_robot_commands": 0.004463788668314616, "deviation-center-line": 0.5958084291313248, "driven_lanedir_consec": 3.7165688784116178, "sim_compute_sim_state": 0.02209782441457113, "sim_compute_performance-ego": 0.0036385822296142577}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.210527647588334, "get_ui_image": 0.03376013164718946, "step_physics": 0.07296728963653247, "survival_time": 9.6, "driven_lanedir": 0.6702649500595715, "get_state_dump": 0.013158563524484634, "sim_render-ego": 0.005740862339735031, "get_robot_state": 0.013811844090620676, "get_duckie_state": 2.288570006688436e-06, "in-drivable-lane": 7.100000000000002, "agent_compute-ego": 0.016726747155189514, "deviation-heading": 0.5135265672392315, "complete-iteration": 0.1867097628613313, "set_robot_commands": 0.00448865940173467, "deviation-center-line": 0.09431638588463592, "driven_lanedir_consec": 0.6702649500595715, "sim_compute_sim_state": 0.022028182943662006, "sim_compute_performance-ego": 0.0038721834619839983}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.9834542004478397, "get_ui_image": 0.03868590850456088, "step_physics": 0.07892293556063783, "survival_time": 10.20000000000001, "driven_lanedir": 2.1433539084633835, "get_state_dump": 0.013298440213296929, "sim_render-ego": 0.005959653386882707, "get_robot_state": 0.015306343050564036, "get_duckie_state": 2.4110663170908013e-06, "in-drivable-lane": 2.7000000000000286, "agent_compute-ego": 0.016813702443066764, "deviation-heading": 0.9794556735476478, "complete-iteration": 0.2045522507499246, "set_robot_commands": 0.00467839428022796, "deviation-center-line": 0.32077780563683617, "driven_lanedir_consec": 2.1433539084633835, "sim_compute_sim_state": 0.02675395619635489, "sim_compute_performance-ego": 0.003976727233213537}}
set_robot_commands_max	0.00467839428022796
set_robot_commands_mean	0.004510596390156185
set_robot_commands_median	0.004476224035024643
set_robot_commands_min	0.004411543210347493
sim_compute_performance-ego_max	0.003976727233213537
sim_compute_performance-ego_mean	0.00380790278461634
sim_compute_performance-ego_median	0.0038081508378187815
sim_compute_performance-ego_min	0.0036385822296142577
sim_compute_sim_state_max	0.02675395619635489
sim_compute_sim_state_mean	0.02355053710879064
sim_compute_sim_state_median	0.022710004647572835
sim_compute_sim_state_min	0.022028182943662006
sim_render-ego_max	0.005959653386882707
sim_render-ego_mean	0.005680439864449641
sim_render-ego_median	0.005663173819581667
sim_render-ego_min	0.005435758431752522
simulation-passed	1
step_physics_max	0.07892293556063783
step_physics_mean	0.07387521539759988
step_physics_median	0.07301184592147669
step_physics_min	0.07055423418680827
survival_time_max	14.950000000000076
survival_time_mean	12.425000000000042
survival_time_min	9.6

No reset possible

42661

11498

sim-exercise-2

LFv-sim

error

2020-11-24 04:58:08+00:00

2020-11-24 05:04:13+00:00

0:06:05

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42650

11499

sim-exercise-2

LFv-sim

error

2020-11-24 04:50:59+00:00

2020-11-24 04:56:23+00:00

0:05:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42631

11499

sim-exercise-2

LFv-sim

error

2020-11-24 04:45:22+00:00

2020-11-24 04:49:53+00:00

0:04:31

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42596

11492

sim-exercise-2

LFv-sim

error

2020-11-24 04:18:45+00:00

2020-11-24 04:25:50+00:00

0:07:05

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42578

11490

exercise_state_estimation

LFv-sim

success

2020-11-24 03:46:02+00:00

2020-11-24 03:54:52+00:00

0:08:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.7864041367482324
survival_time_median	14.950000000000076
deviation-center-line_median	0.6183809313989325
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.01709029674530029
agent_compute-ego_mean	0.01686934272448222
agent_compute-ego_median	0.016865086555480958
agent_compute-ego_min	0.01665690104166667
complete-iteration_max	0.19537468671798705
complete-iteration_mean	0.1897512364387512
complete-iteration_median	0.19084733963012696
complete-iteration_min	0.18193557977676392
deviation-center-line_max	0.990811987196953
deviation-center-line_mean	0.6715102312457938
deviation-center-line_min	0.4584670749883573
deviation-heading_max	2.981654009951344
deviation-heading_mean	2.646728372878256
deviation-heading_median	2.675130657322843
deviation-heading_min	2.2549981669159944
driven_any_max	2.85886608055151
driven_any_mean	2.8565130086901553
driven_any_median	2.858808718619789
driven_any_min	2.8495685169695357
driven_lanedir_consec_max	2.7989326340977883
driven_lanedir_consec_mean	2.580771621134651
driven_lanedir_consec_min	1.951345576944352
driven_lanedir_max	2.7989326340977883
driven_lanedir_mean	2.580771621134651
driven_lanedir_median	2.7864041367482324
driven_lanedir_min	1.951345576944352
get_duckie_state_max	3.734429677327474e-06
get_duckie_state_mean	3.563364346822103e-06
get_duckie_state_median	3.6299228668212894e-06
get_duckie_state_min	3.2591819763183594e-06
get_robot_state_max	0.015499707063039145
get_robot_state_mean	0.013764344851175944
get_robot_state_median	0.013402726252873738
get_robot_state_min	0.012752219835917155
get_state_dump_max	0.013317116896311442
get_state_dump_mean	0.013064815799395243
get_state_dump_median	0.013080310821533204
get_state_dump_min	0.012781524658203125
get_ui_image_max	0.03425748030344645
get_ui_image_mean	0.03351484855016073
get_ui_image_median	0.03360218008359273
get_ui_image_min	0.032597553730010984
in-drivable-lane_max	4.100000000000058
in-drivable-lane_mean	1.0250000000000146
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.8495685169695357, "get_ui_image": 0.03425748030344645, "step_physics": 0.07592024087905884, "survival_time": 14.950000000000076, "driven_lanedir": 2.7989326340977883, "get_state_dump": 0.013317116896311442, "sim_render-ego": 0.00593151330947876, "get_robot_state": 0.015499707063039145, "get_duckie_state": 3.734429677327474e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01709029674530029, "deviation-heading": 2.2549981669159944, "complete-iteration": 0.19452093839645385, "set_robot_commands": 0.004774076143900553, "deviation-center-line": 0.5202421211167793, "driven_lanedir_consec": 2.7989326340977883, "sim_compute_sim_state": 0.02358923991521199, "sim_compute_performance-ego": 0.004003031253814697}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.858848684771276, "get_ui_image": 0.032597553730010984, "step_physics": 0.06987584273020427, "survival_time": 14.950000000000076, "driven_lanedir": 2.7863777102384937, "get_state_dump": 0.013231602509816488, "sim_render-ego": 0.0054736455281575525, "get_robot_state": 0.013653155167897542, "get_duckie_state": 3.658135732014974e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016809068520863852, "deviation-heading": 2.981654009951344, "complete-iteration": 0.18193557977676392, "set_robot_commands": 0.004454538027445476, "deviation-center-line": 0.7165197416810857, "driven_lanedir_consec": 2.7863777102384937, "sim_compute_sim_state": 0.022024765014648437, "sim_compute_performance-ego": 0.003679297765096029}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8587687524683014, "get_ui_image": 0.03336755832036336, "step_physics": 0.07465770165125529, "survival_time": 14.950000000000076, "driven_lanedir": 1.951345576944352, "get_state_dump": 0.012929019133249918, "sim_render-ego": 0.005478560129801432, "get_robot_state": 0.013152297337849934, "get_duckie_state": 3.6017100016276043e-06, "in-drivable-lane": 4.100000000000058, "agent_compute-ego": 0.016921104590098063, "deviation-heading": 2.6373147486274116, "complete-iteration": 0.18717374086380004, "set_robot_commands": 0.0043907809257507325, "deviation-center-line": 0.4584670749883573, "driven_lanedir_consec": 1.951345576944352, "sim_compute_sim_state": 0.02253330945968628, "sim_compute_performance-ego": 0.0036076529820760097}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.85886608055151, "get_ui_image": 0.033836801846822105, "step_physics": 0.08074021259943644, "survival_time": 14.950000000000076, "driven_lanedir": 2.7864305632579716, "get_state_dump": 0.012781524658203125, "sim_render-ego": 0.005300018787384033, "get_robot_state": 0.012752219835917155, "get_duckie_state": 3.2591819763183594e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01665690104166667, "deviation-heading": 2.7129465660182746, "complete-iteration": 0.19537468671798705, "set_robot_commands": 0.004339948495229085, "deviation-center-line": 0.990811987196953, "driven_lanedir_consec": 2.7864305632579716, "sim_compute_sim_state": 0.025265308221181233, "sim_compute_performance-ego": 0.0035702013969421387}}
set_robot_commands_max	0.004774076143900553
set_robot_commands_mean	0.004489835898081461
set_robot_commands_median	0.004422659476598104
set_robot_commands_min	0.004339948495229085
sim_compute_performance-ego_max	0.004003031253814697
sim_compute_performance-ego_mean	0.0037150458494822182
sim_compute_performance-ego_median	0.003643475373586019
sim_compute_performance-ego_min	0.0035702013969421387
sim_compute_sim_state_max	0.025265308221181233
sim_compute_sim_state_mean	0.023353155652681985
sim_compute_sim_state_median	0.02306127468744914
sim_compute_sim_state_min	0.022024765014648437
sim_render-ego_max	0.00593151330947876
sim_render-ego_mean	0.005545934438705445
sim_render-ego_median	0.005476102828979493
sim_render-ego_min	0.005300018787384033
simulation-passed	1
step_physics_max	0.08074021259943644
step_physics_mean	0.0752984994649887
step_physics_median	0.07528897126515707
step_physics_min	0.06987584273020427
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42562

11487

sim-exercise-2

LFv-sim

success

2020-11-24 02:26:47+00:00

2020-11-24 02:35:03+00:00

0:08:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.6550908366204817
survival_time_median	14.950000000000076
deviation-center-line_median	0.715034672984456
in-drivable-lane_median	0.4500000000000064

other stats

agent_compute-ego_max	0.01669152577718099
agent_compute-ego_mean	0.016375892562609094
agent_compute-ego_median	0.016390616502247605
agent_compute-ego_min	0.016030811468760172
complete-iteration_max	0.1894544301664128
complete-iteration_mean	0.17937408631630974
complete-iteration_median	0.17761914213498434
complete-iteration_min	0.1728036308288574
deviation-center-line_max	0.8172814555596885
deviation-center-line_mean	0.6733369426447008
deviation-center-line_min	0.4459969690502027
deviation-heading_max	2.587337332239375
deviation-heading_mean	1.6190056119136265
deviation-heading_median	1.4034194078605262
deviation-heading_min	1.0818462996940783
driven_any_max	2.9482467264840615
driven_any_mean	2.7894950787168833
driven_any_median	2.8012065070389105
driven_any_min	2.6073205743056507
driven_lanedir_consec_max	2.928128491951723
driven_lanedir_consec_mean	2.584215507529041
driven_lanedir_consec_min	2.098551864923478
driven_lanedir_max	2.928128491951723
driven_lanedir_mean	2.584215507529041
driven_lanedir_median	2.6550908366204817
driven_lanedir_min	2.098551864923478
get_duckie_state_max	2.3070971171061196e-06
get_duckie_state_mean	2.188936752431533e-06
get_duckie_state_median	2.1843115488688148e-06
get_duckie_state_min	2.0800267948823817e-06
get_robot_state_max	0.013177934487660728
get_robot_state_mean	0.012087786580417672
get_robot_state_median	0.011803926200258963
get_robot_state_min	0.011565359433492024
get_state_dump_max	0.012824320793151857
get_state_dump_mean	0.012182892111002227
get_state_dump_median	0.012064709955570744
get_state_dump_min	0.011777827739715576
get_ui_image_max	0.03297817531753989
get_ui_image_mean	0.03218771413845174
get_ui_image_median	0.03205460707346598
get_ui_image_min	0.03166346708933512
in-drivable-lane_max	2.6500000000000377
in-drivable-lane_mean	0.8875000000000126
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.908222039835493, "get_ui_image": 0.032268628279368085, "step_physics": 0.07029069662094116, "survival_time": 14.950000000000076, "driven_lanedir": 2.6917009671789978, "get_state_dump": 0.012824320793151857, "sim_render-ego": 0.005371394157409668, "get_robot_state": 0.013177934487660728, "get_duckie_state": 2.3070971171061196e-06, "in-drivable-lane": 0.9000000000000128, "agent_compute-ego": 0.016535654862721762, "deviation-heading": 1.4352982438021988, "complete-iteration": 0.1812454883257548, "set_robot_commands": 0.004404489994049072, "deviation-center-line": 0.6815350359845512, "driven_lanedir_consec": 2.6917009671789978, "sim_compute_sim_state": 0.022609951496124263, "sim_compute_performance-ego": 0.003623429934183757}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.9482467264840615, "get_ui_image": 0.031840585867563886, "step_physics": 0.06670022169748942, "survival_time": 14.950000000000076, "driven_lanedir": 2.928128491951723, "get_state_dump": 0.012194801171620686, "sim_render-ego": 0.005154667695363362, "get_robot_state": 0.01193159262339274, "get_duckie_state": 2.2753079732259114e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016030811468760172, "deviation-heading": 1.3715405719188536, "complete-iteration": 0.1728036308288574, "set_robot_commands": 0.00443853775660197, "deviation-center-line": 0.7485343099843608, "driven_lanedir_consec": 2.928128491951723, "sim_compute_sim_state": 0.020862054824829106, "sim_compute_performance-ego": 0.0035162663459777834}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.694190974242328, "get_ui_image": 0.03166346708933512, "step_physics": 0.06850010633468628, "survival_time": 14.950000000000076, "driven_lanedir": 2.618480706061966, "get_state_dump": 0.011777827739715576, "sim_render-ego": 0.004948761463165283, "get_robot_state": 0.011565359433492024, "get_duckie_state": 2.0933151245117186e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01669152577718099, "deviation-heading": 2.587337332239375, "complete-iteration": 0.17399279594421388, "set_robot_commands": 0.004428724447886149, "deviation-center-line": 0.8172814555596885, "driven_lanedir_consec": 2.618480706061966, "sim_compute_sim_state": 0.020945401191711427, "sim_compute_performance-ego": 0.003340447743733724}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.6073205743056507, "get_ui_image": 0.03297817531753989, "step_physics": 0.07996095892261057, "survival_time": 13.600000000000058, "driven_lanedir": 2.098551864923478, "get_state_dump": 0.011934618739520802, "sim_render-ego": 0.004962076159084544, "get_robot_state": 0.01167625977712519, "get_duckie_state": 2.0800267948823817e-06, "in-drivable-lane": 2.6500000000000377, "agent_compute-ego": 0.016245578141773447, "deviation-heading": 1.0818462996940783, "complete-iteration": 0.1894544301664128, "set_robot_commands": 0.004540640641661251, "deviation-center-line": 0.4459969690502027, "driven_lanedir_consec": 2.098551864923478, "sim_compute_sim_state": 0.023661551230094013, "sim_compute_performance-ego": 0.003364308792002061}}
set_robot_commands_max	0.004540640641661251
set_robot_commands_mean	0.0044530982100496105
set_robot_commands_median	0.004433631102244059
set_robot_commands_min	0.004404489994049072
sim_compute_performance-ego_max	0.003623429934183757
sim_compute_performance-ego_mean	0.0034611132039743314
sim_compute_performance-ego_median	0.0034402875689899222
sim_compute_performance-ego_min	0.003340447743733724
sim_compute_sim_state_max	0.023661551230094013
sim_compute_sim_state_mean	0.022019739685689703
sim_compute_sim_state_median	0.02177767634391785
sim_compute_sim_state_min	0.020862054824829106
sim_render-ego_max	0.005371394157409668
sim_render-ego_mean	0.005109224868755714
sim_render-ego_median	0.005058371927223953
sim_render-ego_min	0.004948761463165283
simulation-passed	1
step_physics_max	0.07996095892261057
step_physics_mean	0.07136299589393186
step_physics_median	0.06939540147781373
step_physics_min	0.06670022169748942
survival_time_max	14.950000000000076
survival_time_mean	14.612500000000074
survival_time_min	13.600000000000058

No reset possible

42552

11484

sim-exercise-2

LFv-sim

error

2020-11-24 02:07:44+00:00

2020-11-24 02:14:14+00:00

0:06:30

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 281, in main
    length_s = await run_episode(
  File "experiment_manager.py", line 554, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 141, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 299, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 327, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 415, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 463, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 167, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 193, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 678, in scoring_context
    yield cie
  File "experiment_manager.py", line 683, in go
    wrap(cie)
  File "experiment_manager.py", line 668, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "experiment_manager.py", line 351, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

42505

11472

Raphael Jean

sim-exercise-2

LFv-sim

success

2020-11-23 14:30:52+00:00

2020-11-23 14:39:24+00:00

0:08:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	14.950000000000076
deviation-center-line_median	0.3071094952840746
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.017439768314361573
agent_compute-ego_mean	0.017034650444984437
agent_compute-ego_median	0.017029531796773273
agent_compute-ego_min	0.01663976987202962
complete-iteration_max	0.19965151230494185
complete-iteration_mean	0.1837476380666097
complete-iteration_median	0.1796528975168864
complete-iteration_min	0.1760332449277242
deviation-center-line_max	0.6863069918481528
deviation-center-line_mean	0.35998819605511767
deviation-center-line_min	0.13942680180416853
deviation-heading_max	3.7258518640401217
deviation-heading_mean	1.6586762301304627
deviation-heading_median	1.2113904039371066
deviation-heading_min	0.486072248607516
driven_any_max	1.3686924727581474e-13
driven_any_mean	6.950391439969185e-14
driven_any_median	7.057320516147632e-14
driven_any_min	0.0
driven_lanedir_consec_max	1.7821788787841797e-05
driven_lanedir_consec_mean	4.455447196960449e-06
driven_lanedir_consec_min	0.0
driven_lanedir_max	1.7821788787841797e-05
driven_lanedir_mean	4.455447196960449e-06
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	3.4578641255696616e-06
get_duckie_state_mean	3.3873319625854495e-06
get_duckie_state_median	3.390312194824219e-06
get_duckie_state_min	3.310839335123698e-06
get_robot_state_max	0.013144343694051108
get_robot_state_mean	0.012945375442504882
get_robot_state_median	0.012913417021433511
get_robot_state_min	0.0128103240331014
get_state_dump_max	0.013001339435577393
get_state_dump_mean	0.012875436544418334
get_state_dump_median	0.01287001371383667
get_state_dump_min	0.012760379314422608
get_ui_image_max	0.033637139002482094
get_ui_image_mean	0.032878440022468564
get_ui_image_median	0.03266969283421835
get_ui_image_min	0.032537235418955486
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.328474932138796e-13, "get_ui_image": 0.032537235418955486, "step_physics": 0.0687218697865804, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.013001339435577393, "sim_render-ego": 0.005448067188262939, "get_robot_state": 0.013144343694051108, "get_duckie_state": 3.4578641255696616e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01687831958134969, "deviation-heading": 1.6198720948235377, "complete-iteration": 0.17892441352208455, "set_robot_commands": 0.004468994935353597, "deviation-center-line": 0.20880585936578705, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.020936912695566814, "sim_compute_performance-ego": 0.003645936648050944}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 1.3686924727581474e-13, "get_ui_image": 0.03276672999064128, "step_physics": 0.06766587893168131, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.012760379314422608, "sim_render-ego": 0.005353389581044515, "get_robot_state": 0.0128103240331014, "get_duckie_state": 3.3926963806152345e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01663976987202962, "deviation-heading": 3.7258518640401217, "complete-iteration": 0.1760332449277242, "set_robot_commands": 0.004488647778828939, "deviation-center-line": 0.13942680180416853, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01975680192311605, "sim_compute_performance-ego": 0.0036515609423319498}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 0.0, "get_ui_image": 0.03257265567779541, "step_physics": 0.07001101970672607, "survival_time": 14.950000000000076, "driven_lanedir": 1.7821788787841797e-05, "get_state_dump": 0.012773627440134685, "sim_render-ego": 0.005460920333862304, "get_robot_state": 0.012998857498168946, "get_duckie_state": 3.310839335123698e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017439768314361573, "deviation-heading": 0.8029087130506755, "complete-iteration": 0.18038138151168823, "set_robot_commands": 0.00451404889424642, "deviation-center-line": 0.4054131312023622, "driven_lanedir_consec": 1.7821788787841797e-05, "sim_compute_sim_state": 0.020814314683278403, "sim_compute_performance-ego": 0.003651013374328613}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 8.298917109073045e-15, "get_ui_image": 0.033637139002482094, "step_physics": 0.08632981618245443, "survival_time": 14.950000000000076, "driven_lanedir": 0.0, "get_state_dump": 0.012966399987538657, "sim_render-ego": 0.00525122324625651, "get_robot_state": 0.01282797654469808, "get_duckie_state": 3.3879280090332033e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01718074401219686, "deviation-heading": 0.486072248607516, "complete-iteration": 0.19965151230494185, "set_robot_commands": 0.00449613094329834, "deviation-center-line": 0.6863069918481528, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.023270070552825928, "sim_compute_performance-ego": 0.0035494200388590494}}
set_robot_commands_max	0.00451404889424642
set_robot_commands_mean	0.004491955637931824
set_robot_commands_median	0.004492389361063639
set_robot_commands_min	0.004468994935353597
sim_compute_performance-ego_max	0.0036515609423319498
sim_compute_performance-ego_mean	0.003624482750892639
sim_compute_performance-ego_median	0.0036484750111897783
sim_compute_performance-ego_min	0.0035494200388590494
sim_compute_sim_state_max	0.023270070552825928
sim_compute_sim_state_mean	0.0211945249636968
sim_compute_sim_state_median	0.02087561368942261
sim_compute_sim_state_min	0.01975680192311605
sim_render-ego_max	0.005460920333862304
sim_render-ego_mean	0.0053784000873565675
sim_render-ego_median	0.005400728384653727
sim_render-ego_min	0.00525122324625651
simulation-passed	1
step_physics_max	0.08632981618245443
step_physics_mean	0.07318214615186056
step_physics_median	0.06936644474665324
step_physics_min	0.06766587893168131
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42492

11469

Raphael Jean

exercise_state_estimation

LFv-sim

success

2020-11-22 22:12:15+00:00

2020-11-22 22:20:59+00:00

0:08:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.639083610877957
survival_time_median	14.950000000000076
deviation-center-line_median	0.5491412116474016
in-drivable-lane_median	0.0

other stats

agent_compute-ego_max	0.01720680554707845
agent_compute-ego_mean	0.016988110542297364
agent_compute-ego_median	0.016962637503941853
agent_compute-ego_min	0.016820361614227296
complete-iteration_max	0.19183552106221516
complete-iteration_mean	0.18045608421166737
complete-iteration_median	0.17828469316164652
complete-iteration_min	0.1734194294611613
deviation-center-line_max	0.7253505053435034
deviation-center-line_mean	0.5646463442626715
deviation-center-line_min	0.43495244841237907
deviation-heading_max	3.0323830747427216
deviation-heading_mean	2.43882977892952
deviation-heading_median	2.422919905678525
deviation-heading_min	1.8770962296183096
driven_any_max	3.8799180179254154
driven_any_mean	3.5965088109389716
driven_any_median	3.7107018124696767
driven_any_min	3.0847136008911167
driven_lanedir_consec_max	3.8340871220085817
driven_lanedir_consec_mean	3.5252818221748092
driven_lanedir_consec_min	2.9888729449347418
driven_lanedir_max	3.8340871220085817
driven_lanedir_mean	3.5252818221748092
driven_lanedir_median	3.639083610877957
driven_lanedir_min	2.9888729449347418
get_duckie_state_max	2.3023287455240885e-06
get_duckie_state_mean	2.237558364868164e-06
get_duckie_state_median	2.258618672688802e-06
get_duckie_state_min	2.1306673685709637e-06
get_robot_state_max	0.012896349430084228
get_robot_state_mean	0.01212921400864919
get_robot_state_median	0.012051955064137778
get_robot_state_min	0.01151659647623698
get_state_dump_max	0.012880229949951172
get_state_dump_mean	0.01237876852353414
get_state_dump_median	0.012381569147109986
get_state_dump_min	0.011871705849965414
get_ui_image_max	0.033697431087493894
get_ui_image_mean	0.03230500817298889
get_ui_image_median	0.032066417932510374
get_ui_image_min	0.03138976573944092
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.775082511883409, "get_ui_image": 0.03138976573944092, "step_physics": 0.06716703732808431, "survival_time": 14.950000000000076, "driven_lanedir": 3.680323710620617, "get_state_dump": 0.011871705849965414, "sim_render-ego": 0.005055281321207682, "get_robot_state": 0.01151659647623698, "get_duckie_state": 2.3023287455240885e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016868723233540852, "deviation-heading": 2.8286032020895853, "complete-iteration": 0.1735430343945821, "set_robot_commands": 0.00447535753250122, "deviation-center-line": 0.5921260744832985, "driven_lanedir_consec": 3.680323710620617, "sim_compute_sim_state": 0.02165196339289347, "sim_compute_performance-ego": 0.0034170118967692055}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.646321113055945, "get_ui_image": 0.03148663600285848, "step_physics": 0.06766372839609781, "survival_time": 14.950000000000076, "driven_lanedir": 3.597843511135296, "get_state_dump": 0.012058128515879313, "sim_render-ego": 0.005014236768086751, "get_robot_state": 0.011650387446085613, "get_duckie_state": 2.1306673685709637e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016820361614227296, "deviation-heading": 2.0172366092674645, "complete-iteration": 0.1734194294611613, "set_robot_commands": 0.004468693733215332, "deviation-center-line": 0.5061563488115047, "driven_lanedir_consec": 3.597843511135296, "sim_compute_sim_state": 0.020732137362162274, "sim_compute_performance-ego": 0.0033947070439656573}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0847136008911167, "get_ui_image": 0.03264619986216227, "step_physics": 0.07253552913665771, "survival_time": 14.950000000000076, "driven_lanedir": 2.9888729449347418, "get_state_dump": 0.012705009778340656, "sim_render-ego": 0.005275837580362956, "get_robot_state": 0.012453522682189942, "get_duckie_state": 2.2824605305989585e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01720680554707845, "deviation-heading": 3.0323830747427216, "complete-iteration": 0.18302635192871097, "set_robot_commands": 0.004530697663625081, "deviation-center-line": 0.7253505053435034, "driven_lanedir_consec": 2.9888729449347418, "sim_compute_sim_state": 0.02196115970611572, "sim_compute_performance-ego": 0.003574201265970866}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.8799180179254154, "get_ui_image": 0.033697431087493894, "step_physics": 0.0765075389544169, "survival_time": 14.950000000000076, "driven_lanedir": 3.8340871220085817, "get_state_dump": 0.012880229949951172, "sim_render-ego": 0.005271846453348795, "get_robot_state": 0.012896349430084228, "get_duckie_state": 2.2347768147786458e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.017056551774342853, "deviation-heading": 1.8770962296183096, "complete-iteration": 0.19183552106221516, "set_robot_commands": 0.004387767314910889, "deviation-center-line": 0.43495244841237907, "driven_lanedir_consec": 3.8340871220085817, "sim_compute_sim_state": 0.02536150296529134, "sim_compute_performance-ego": 0.0036381077766418457}}
set_robot_commands_max	0.004530697663625081
set_robot_commands_mean	0.004465629061063131
set_robot_commands_median	0.004472025632858276
set_robot_commands_min	0.004387767314910889
sim_compute_performance-ego_max	0.0036381077766418457
sim_compute_performance-ego_mean	0.0035060069958368937
sim_compute_performance-ego_median	0.0034956065813700355
sim_compute_performance-ego_min	0.0033947070439656573
sim_compute_sim_state_max	0.02536150296529134
sim_compute_sim_state_mean	0.022426690856615705
sim_compute_sim_state_median	0.021806561549504597
sim_compute_sim_state_min	0.020732137362162274
sim_render-ego_max	0.005275837580362956
sim_render-ego_mean	0.005154300530751546
sim_render-ego_median	0.005163563887278238
sim_render-ego_min	0.005014236768086751
simulation-passed	1
step_physics_max	0.0765075389544169
step_physics_mean	0.07096845845381419
step_physics_median	0.07009962876637776
step_physics_min	0.06716703732808431
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42471

11462

Jerome Labonte 🇨🇦

sim-exercise-2

LFv-sim

success

2020-11-20 23:12:07+00:00

2020-11-20 23:20:58+00:00

0:08:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.2402781573286523
survival_time_median	14.950000000000076
deviation-center-line_median	0.9295471032397322
in-drivable-lane_median	0.9500000000000136

other stats

agent_compute-ego_max	0.01711220661799113
agent_compute-ego_mean	0.016798384388287863
agent_compute-ego_median	0.0168340802192688
agent_compute-ego_min	0.01641317049662272
complete-iteration_max	0.1935349559783935
complete-iteration_mean	0.1867052020629247
complete-iteration_median	0.1856607421239217
complete-iteration_min	0.18196436802546184
deviation-center-line_max	1.1174479352940183
deviation-center-line_mean	0.937687762715044
deviation-center-line_min	0.7742089090866926
deviation-heading_max	3.7091629041110337
deviation-heading_mean	3.2486135185885927
deviation-heading_median	3.1326323962515317
deviation-heading_min	3.0200263777402734
driven_any_max	3.752414677134198
driven_any_mean	3.486320689998274
driven_any_median	3.5574490115898523
driven_any_min	3.0779700596791932
driven_lanedir_consec_max	3.607814401750973
driven_lanedir_consec_mean	3.164850082334608
driven_lanedir_consec_min	2.571029612930152
driven_lanedir_max	3.607814401750973
driven_lanedir_mean	3.164850082334608
driven_lanedir_median	3.2402781573286523
driven_lanedir_min	2.571029612930152
get_duckie_state_max	2.2292137145996093e-06
get_duckie_state_mean	2.2027889887491864e-06
get_duckie_state_median	2.213716506958008e-06
get_duckie_state_min	2.15450922648112e-06
get_robot_state_max	0.015933175086975098
get_robot_state_mean	0.014288514653841657
get_robot_state_median	0.014142675797144571
get_robot_state_min	0.012935531934102375
get_state_dump_max	0.014398975372314451
get_state_dump_mean	0.01307002663612366
get_state_dump_median	0.012650541067123412
get_state_dump_min	0.01258004903793335
get_ui_image_max	0.03386730670928955
get_ui_image_mean	0.03301222642262777
get_ui_image_median	0.033011528650919594
get_ui_image_min	0.03215854167938233
in-drivable-lane_max	2.0000000000000284
in-drivable-lane_mean	0.975000000000014
in-drivable-lane_min	0.0
per-episodes	details {"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.752414677134198, "get_ui_image": 0.03215854167938233, "step_physics": 0.06898696422576904, "survival_time": 14.950000000000076, "driven_lanedir": 3.492397245888309, "get_state_dump": 0.014398975372314451, "sim_render-ego": 0.005354181925455729, "get_robot_state": 0.015933175086975098, "get_duckie_state": 2.2093454996744794e-06, "in-drivable-lane": 0.8000000000000114, "agent_compute-ego": 0.01641317049662272, "deviation-heading": 3.0200263777402734, "complete-iteration": 0.1842744533220927, "set_robot_commands": 0.004664223988850911, "deviation-center-line": 0.8237156372055562, "driven_lanedir_consec": 3.492397245888309, "sim_compute_sim_state": 0.02274583737055461, "sim_compute_performance-ego": 0.0034918737411499022}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.710649202480505, "get_ui_image": 0.03290116310119629, "step_physics": 0.06966573158899943, "survival_time": 14.950000000000076, "driven_lanedir": 3.607814401750973, "get_state_dump": 0.01258004903793335, "sim_render-ego": 0.005437197685241699, "get_robot_state": 0.01419039726257324, "get_duckie_state": 2.15450922648112e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016726210912068686, "deviation-heading": 3.0546641003039836, "complete-iteration": 0.18196436802546184, "set_robot_commands": 0.004574854373931885, "deviation-center-line": 0.7742089090866926, "driven_lanedir_consec": 3.607814401750973, "sim_compute_sim_state": 0.022120054562886557, "sim_compute_performance-ego": 0.00363608439763387}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0779700596791932, "get_ui_image": 0.033121894200642904, "step_physics": 0.07344735145568848, "survival_time": 14.950000000000076, "driven_lanedir": 2.571029612930152, "get_state_dump": 0.012714777787526449, "sim_render-ego": 0.005501690705617269, "get_robot_state": 0.0140949543317159, "get_duckie_state": 2.2180875142415363e-06, "in-drivable-lane": 2.0000000000000284, "agent_compute-ego": 0.01711220661799113, "deviation-heading": 3.2106006921990797, "complete-iteration": 0.18704703092575073, "set_robot_commands": 0.004636205832163493, "deviation-center-line": 1.0353785692739084, "driven_lanedir_consec": 2.571029612930152, "sim_compute_sim_state": 0.022552154858907065, "sim_compute_performance-ego": 0.0037318849563598632}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.4042488206991997, "get_ui_image": 0.03386730670928955, "step_physics": 0.07876926501592, "survival_time": 14.950000000000076, "driven_lanedir": 2.9881590687689963, "get_state_dump": 0.012586304346720378, "sim_render-ego": 0.005168631871541341, "get_robot_state": 0.012935531934102375, "get_duckie_state": 2.2292137145996093e-06, "in-drivable-lane": 1.1000000000000156, "agent_compute-ego": 0.01694194952646891, "deviation-heading": 3.7091629041110337, "complete-iteration": 0.1935349559783935, "set_robot_commands": 0.004434421857198079, "deviation-center-line": 1.1174479352940183, "driven_lanedir_consec": 2.9881590687689963, "sim_compute_sim_state": 0.025167428652445475, "sim_compute_performance-ego": 0.0035338481267293293}}
set_robot_commands_max	0.004664223988850911
set_robot_commands_mean	0.004577426513036092
set_robot_commands_median	0.0046055301030476885
set_robot_commands_min	0.004434421857198079
sim_compute_performance-ego_max	0.0037318849563598632
sim_compute_performance-ego_mean	0.0035984228054682416
sim_compute_performance-ego_median	0.0035849662621816
sim_compute_performance-ego_min	0.0034918737411499022
sim_compute_sim_state_max	0.025167428652445475
sim_compute_sim_state_mean	0.023146368861198426
sim_compute_sim_state_median	0.022648996114730834
sim_compute_sim_state_min	0.022120054562886557
sim_render-ego_max	0.005501690705617269
sim_render-ego_mean	0.005365425546964009
sim_render-ego_median	0.0053956898053487135
sim_render-ego_min	0.005168631871541341
simulation-passed	1
step_physics_max	0.07876926501592
step_physics_mean	0.07271732807159424
step_physics_median	0.07155654152234395
step_physics_min	0.06898696422576904
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

42470

11462

Jerome Labonte 🇨🇦

sim-exercise-2

LFv-sim

success