Duckietown Challenges Home Challenges Submissions

Evaluator 786

ID786
evaluatornutonomy-P50-6318
ownerAndrea Censi 🇨🇭
machinenutonomy-P50
processnutonomy-P50-6318
versiond-c:4.0.18;d-c-r:4.0.28;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success11 19238
# timeout3 19419
# failed1 19361
# error6 19244
# aborted
# host-error1 19475
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
195072578Alexander Karavaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationtimeoutnonutonomy-P50-63181:05:20
I can see how the jo [...]
I can see how the job 19507 is timeout because passed 3920 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
194752621Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationhost-errornonutonomy-P50-63180:13:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 1184, in upload
    aws_object.load()
  File "/usr/local/lib/python3.6/dist-packages/boto3/resources/factory.py", line 505, in do_action
    response = action(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/boto3/resources/action.py", line 83, in __call__
    response = getattr(parent.meta.client, operation_name)(**params)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 661, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (404) when calling the HeadObject operation: Not Found

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1194, in upload
    aws_object.upload_file(realfile, ExtraArgs={'ContentType': mime_type})
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 280, in object_upload_file
    ExtraArgs=ExtraArgs, Callback=Callback, Config=Config)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/inject.py", line 131, in upload_file
    extra_args=ExtraArgs, callback=Callback)
  File "/usr/local/lib/python3.6/dist-packages/boto3/s3/transfer.py", line 279, in upload_file
    future.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 73, in result
    return self._coordinator.result()
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/futures.py", line 233, in result
    raise self._exception
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 258, in send
    decode_content=False,
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 125, in _send_request
    method, url, body, headers, *args, **kwargs)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 159, in _send_output
    self._handle_expect_response(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 202, in _handle_expect_response
    self._send_message_body(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 229, in _send_message_body
    self.send(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 236, in send
    return super(AWSConnection, self).send(str)
  File "/usr/lib/python3.6/http/client.py", line 978, in send
    datablock = data.read(blocksize)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 448, in read
    data = self._fileobj.read(amount_to_read)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 85, in read
    raise self._transfer_coordinator.exception
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 258, in send
    decode_content=False,
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 600, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python3.6/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 125, in _send_request
    method, url, body, headers, *args, **kwargs)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 159, in _send_output
    self._handle_expect_response(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 202, in _handle_expect_response
    self._send_message_body(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 229, in _send_message_body
    self.send(message_body)
  File "/usr/local/lib/python3.6/dist-packages/botocore/awsrequest.py", line 236, in send
    return super(AWSConnection, self).send(str)
  File "/usr/lib/python3.6/http/client.py", line 978, in send
    datablock = data.read(blocksize)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/utils.py", line 448, in read
    data = self._fileobj.read(amount_to_read)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 85, in read
    raise self._transfer_coordinator.exception
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 126, in __call__
    return self._execute_main(kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/tasks.py", line 150, in _execute_main
    return_value = self._main(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/s3transfer/upload.py", line 722, in _main
    Body=body, **extra_args)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 357, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 648, in _make_api_call
    operation_model, request_dict, request_context)
  File "/usr/local/lib/python3.6/dist-packages/botocore/client.py", line 667, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 102, in make_request
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 137, in _send_request
    success_response, exception):
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 231, in _needs_retry
    caught_exception=caught_exception, request_dict=request_dict)
  File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 356, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 228, in emit
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/hooks.py", line 211, in _emit
    response = handler(**kwargs)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 183, in __call__
    if self._checker(attempts, response, caught_exception):
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 251, in __call__
    caught_exception)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 277, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 317, in __call__
    caught_exception)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 223, in __call__
    attempt_number, caught_exception)
  File "/usr/local/lib/python3.6/dist-packages/botocore/retryhandler.py", line 359, in _check_caught_exception
    raise caught_exception
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 200, in _do_get_response
    http_response = self._send(request)
  File "/usr/local/lib/python3.6/dist-packages/botocore/endpoint.py", line 244, in _send
    return self.http_session.send(request)
  File "/usr/local/lib/python3.6/dist-packages/botocore/httpsession.py", line 278, in send
    raise EndpointConnectionError(endpoint_url=request.url, error=e)
botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://duckietown-ai-driving-olympics-1.s3.us-east-2.amazonaws.com/v3/frankfurt/by-value/sha256/75e8d2534bd41953400df68220d80d2642a66f28070415f0592e53fc855207c4?uploadId=eSGALYhvbREu9ChTB05gd._cRfNNMsS06ziBqnd5Jg6Q_swE2xwyAqupOxV2jiJh2SwoZWf8wltTm1EixJZ3XNvxI0bOl5sxuDhBgMypC5vYHDzwHcRhCS7VlngibdRS&partNumber=8"
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
194602649Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validationstep1-simulationtimeoutnonutonomy-P50-63180:12:23
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
194192694Konstantin Chaikachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationtimeoutnonutonomy-P50-63180:28:05
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
193722759Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validationstep1-simulationsuccessnonutonomy-P50-63180:18:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5487132829419987
survival_time_median2.3499999999999996
deviation-center-line_median0.11041400208354252
in-drivable-lane_median0


other stats
agent_compute-ego_max0.04124875645061116
agent_compute-ego_mean0.04015299347434924
agent_compute-ego_median0.040276637444129355
agent_compute-ego_min0.03859019786753553
deviation-center-line_max0.1279102488429998
deviation-center-line_mean0.10518151035257096
deviation-center-line_min0.06917270915638028
deviation-heading_max0.4712184191829178
deviation-heading_mean0.3828337640550057
deviation-heading_median0.36368201628851926
deviation-heading_min0.3257229985354382
driven_any_max1.259664216011687
driven_any_mean0.7702827269903464
driven_any_median0.6642785413159032
driven_any_min0.3059207793076613
driven_lanedir_consec_max0.9402632878459154
driven_lanedir_consec_mean0.588039443394122
driven_lanedir_consec_min0.28022225990343186
driven_lanedir_max0.9402632878459154
driven_lanedir_mean0.588039443394122
driven_lanedir_median0.5487132829419987
driven_lanedir_min0.28022225990343186
in-drivable-lane_max1.8499999999999936
in-drivable-lane_mean0.559999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.018205232736541004, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.03716808121378829, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.0406017739598344, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.05497492231973788, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.02289342007985929, "sim_compute_performance-ego": 0.039534237326645266, "sim_compute_robot_state-ego": 0.041186047763359254, "sim_compute_robot_state-npc0": 0.04072659480862501, "sim_compute_robot_state-npc1": 0.04063242528496719, "sim_compute_robot_state-npc2": 0.03989784601258069, "sim_compute_robot_state-npc3": 0.04039443992986912}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.017531789266146146, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.036258229842552774, "in-drivable-lane": 0, "agent_compute-ego": 0.040276637444129355, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.0606765838769766, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.022339710822472207, "sim_compute_performance-ego": 0.03993670757000263, "sim_compute_robot_state-ego": 0.04032370677361122, "sim_compute_robot_state-npc0": 0.041199372364924505, "sim_compute_robot_state-npc1": 0.04099329618307261, "sim_compute_robot_state-npc2": 0.040331556246830866, "sim_compute_robot_state-npc3": 0.03929195954249455}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.01851807249353287, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.03636072544341392, "in-drivable-lane": 0, "agent_compute-ego": 0.03859019786753553, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.05437054532639524, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.021946323678848592, "sim_compute_performance-ego": 0.03872501596491387, "sim_compute_robot_state-ego": 0.04009800261639534, "sim_compute_robot_state-npc0": 0.039359889131911255, "sim_compute_robot_state-npc1": 0.03906905397455743, "sim_compute_robot_state-npc2": 0.040472076294269965, "sim_compute_robot_state-npc3": 0.0392815407286299}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.01925335873614301, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.036530801228114536, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.04124875645061116, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.0558970393715324, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.022903722721141773, "sim_compute_performance-ego": 0.040528328864129035, "sim_compute_robot_state-ego": 0.041320164125044266, "sim_compute_robot_state-npc0": 0.0409326841543009, "sim_compute_robot_state-npc1": 0.04073833633255172, "sim_compute_robot_state-npc2": 0.041050266433548144, "sim_compute_robot_state-npc3": 0.04145014155042041}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.01745567196293881, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.03650112528549997, "in-drivable-lane": 0, "agent_compute-ego": 0.040047601649635715, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.058391219691226355, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.02355347809038664, "sim_compute_performance-ego": 0.03919142798373574, "sim_compute_robot_state-ego": 0.04118037223815918, "sim_compute_robot_state-npc0": 0.0420395575071636, "sim_compute_robot_state-npc1": 0.04068218406878019, "sim_compute_robot_state-npc2": 0.04172818284285696, "sim_compute_robot_state-npc3": 0.03996757457130834}}
set_robot_commands_max0.0606765838769766
set_robot_commands_mean0.05686206211717369
set_robot_commands_median0.0558970393715324
set_robot_commands_min0.05437054532639524
sim_compute_performance-ego_max0.040528328864129035
sim_compute_performance-ego_mean0.03958314354188531
sim_compute_performance-ego_median0.039534237326645266
sim_compute_performance-ego_min0.03872501596491387
sim_compute_robot_state-ego_max0.041320164125044266
sim_compute_robot_state-ego_mean0.04082165870331385
sim_compute_robot_state-ego_median0.04118037223815918
sim_compute_robot_state-ego_min0.04009800261639534
sim_compute_robot_state-npc0_max0.0420395575071636
sim_compute_robot_state-npc0_mean0.040851619593385055
sim_compute_robot_state-npc0_median0.0409326841543009
sim_compute_robot_state-npc0_min0.039359889131911255
sim_compute_robot_state-npc1_max0.04099329618307261
sim_compute_robot_state-npc1_mean0.04042305916878582
sim_compute_robot_state-npc1_median0.04068218406878019
sim_compute_robot_state-npc1_min0.03906905397455743
sim_compute_robot_state-npc2_max0.04172818284285696
sim_compute_robot_state-npc2_mean0.04069598556601732
sim_compute_robot_state-npc2_median0.040472076294269965
sim_compute_robot_state-npc2_min0.03989784601258069
sim_compute_robot_state-npc3_max0.04145014155042041
sim_compute_robot_state-npc3_mean0.040077131264544465
sim_compute_robot_state-npc3_median0.03996757457130834
sim_compute_robot_state-npc3_min0.0392815407286299
sim_compute_sim_state_max0.02355347809038664
sim_compute_sim_state_mean0.0227273310785417
sim_compute_sim_state_median0.02289342007985929
sim_compute_sim_state_min0.021946323678848592
sim_physics_max0.01925335873614301
sim_physics_mean0.01819282503906037
sim_physics_median0.018205232736541004
sim_physics_min0.01745567196293881
sim_render-ego_max0.03716808121378829
sim_render-ego_mean0.0365637926026739
sim_render-ego_median0.03650112528549997
sim_render-ego_min0.036258229842552774
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean2.839999999999997
survival_time_min1.3000000000000005
No reset possible
193702779Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationerrornonutonomy-P50-63180:00:52
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
193622782Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationerrornonutonomy-P50-63180:01:14
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
193612791Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationfailednonutonomy-P50-63180:01:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 293, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 435, in <module>
    wrap(cie)
  File "experiment_manager.py", line 423, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 297, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
193582983Claudio RuchPython templateaido2-AMOD-efficiencystep2-scoringsuccessyesnutonomy-P50-63180:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency-63.89247587906647


other stats
fleet_size-1000000000
service_quality-32.74004896976725
No reset possible
193452983Claudio RuchPython templateaido2-AMOD-efficiencystep1-simulationsuccessyesnutonomy-P50-63180:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
193312818Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessnonutonomy-P50-63180:05:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.909759304183658
survival_time_median2.3999999999999995
deviation-center-line_median0.0985043663838993
in-drivable-lane_median0.3499999999999992


other stats
agent_compute-ego_max0.08364085091484917
agent_compute-ego_mean0.08251697559737789
agent_compute-ego_median0.08299361575733531
agent_compute-ego_min0.08017607997445499
deviation-center-line_max0.13882443387861454
deviation-center-line_mean0.10001813696907735
deviation-center-line_min0.06219077976537568
deviation-heading_max0.26115230540596424
deviation-heading_mean0.2318832073723368
deviation-heading_median0.23893895947579852
deviation-heading_min0.1984807025035912
driven_any_max1.4367438864906803
driven_any_mean1.030907091561231
driven_any_median0.9157141892899948
driven_any_min0.8462726558162896
driven_lanedir_consec_max0.9542197633771314
driven_lanedir_consec_mean0.795970343519684
driven_lanedir_consec_min0.5348503251906886
driven_lanedir_max0.9542197633771314
driven_lanedir_mean0.795970343519684
driven_lanedir_median0.909759304183658
driven_lanedir_min0.5348503251906886
in-drivable-lane_max1.099999999999998
in-drivable-lane_mean0.4899999999999987
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.009716780680530475, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.03246510703608675, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.0822907843679752, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.05066164934410239, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.02038861220737673, "sim_compute_performance-ego": 0.03556579463886765, "sim_compute_robot_state-ego": 0.03773801281767072}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.009693373333324084, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.03333900191567161, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.08299361575733531, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.052456032146107064, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.02109336311166937, "sim_compute_performance-ego": 0.03664371642199429, "sim_compute_robot_state-ego": 0.03748271682045677}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.009855800204806855, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.03302534421284994, "in-drivable-lane": 0, "agent_compute-ego": 0.08364085091484917, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.05432487593756782, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.021094412273830836, "sim_compute_performance-ego": 0.03628582954406738, "sim_compute_robot_state-ego": 0.03772642877366808}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.009855836629867554, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.03358181814352671, "in-drivable-lane": 0, "agent_compute-ego": 0.08348354697227478, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.05201078454653422, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.02092625697453817, "sim_compute_performance-ego": 0.037119378646214805, "sim_compute_robot_state-ego": 0.037839760382970176}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.010352797367993523, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.032282671507667095, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.08017607997445499, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.05000954165178187, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.019966567263883704, "sim_compute_performance-ego": 0.034751239944906795, "sim_compute_robot_state-ego": 0.03679566172992482}}
set_robot_commands_max0.05432487593756782
set_robot_commands_mean0.05189257672521867
set_robot_commands_median0.05201078454653422
set_robot_commands_min0.05000954165178187
sim_compute_performance-ego_max0.037119378646214805
sim_compute_performance-ego_mean0.036073191839210185
sim_compute_performance-ego_median0.03628582954406738
sim_compute_performance-ego_min0.034751239944906795
sim_compute_robot_state-ego_max0.037839760382970176
sim_compute_robot_state-ego_mean0.037516516104938114
sim_compute_robot_state-ego_median0.03772642877366808
sim_compute_robot_state-ego_min0.03679566172992482
sim_compute_sim_state_max0.021094412273830836
sim_compute_sim_state_mean0.020693842366259763
sim_compute_sim_state_median0.02092625697453817
sim_compute_sim_state_min0.019966567263883704
sim_physics_max0.010352797367993523
sim_physics_mean0.0098949176433045
sim_physics_median0.009855800204806855
sim_physics_min0.009693373333324084
sim_render-ego_max0.03358181814352671
sim_render-ego_mean0.03293878856316042
sim_render-ego_median0.03302534421284994
sim_render-ego_min0.032282671507667095
simulation-passed1
survival_time_max3.399999999999996
survival_time_mean2.579999999999999
survival_time_min2.2
No reset possible
193232832Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerrornonutonomy-P50-63180:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
193182831Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerrornonutonomy-P50-63180:00:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
193022867Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessnonutonomy-P50-63180:05:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6491235881715895
survival_time_median3.1999999999999966
deviation-center-line_median0.053345314340000456
in-drivable-lane_median0.6500000000000006


other stats
agent_compute-ego_max0.10205090487444844
agent_compute-ego_mean0.09913230204904414
agent_compute-ego_median0.10047776624560356
agent_compute-ego_min0.0945946398903342
deviation-center-line_max0.25392339208884884
deviation-center-line_mean0.10099095982826103
deviation-center-line_min0.02806411613499379
deviation-heading_max2.332350360345814
deviation-heading_mean0.791700821685345
deviation-heading_median0.3912390758843141
deviation-heading_min0.22411690249413224
driven_any_max2.3481451916925966
driven_any_mean1.3960565596957062
driven_any_median1.536379281353738
driven_any_min0.509247596776878
driven_lanedir_consec_max1.2550616957781522
driven_lanedir_consec_mean0.7250238900602675
driven_lanedir_consec_min0.1675634503735699
driven_lanedir_max1.3893386417764602
driven_lanedir_mean0.7616716263169674
driven_lanedir_median0.6650319467675185
driven_lanedir_min0.1675634503735699
in-drivable-lane_max2.5999999999999925
in-drivable-lane_mean1.0799999999999976
in-drivable-lane_min0.4499999999999984
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.86431085338208, "sim_physics": 0.011262666611444382, "survival_time": 4.199999999999993, "driven_lanedir": 0.6650319467675185, "sim_render-ego": 0.034355773812248594, "in-drivable-lane": 2.5999999999999925, "agent_compute-ego": 0.10058562528519405, "deviation-heading": 0.3912390758843141, "set_robot_commands": 0.05237840186981928, "deviation-center-line": 0.04479653786806894, "driven_lanedir_consec": 0.6491235881715895, "sim_compute_sim_state": 0.021507986954280307, "sim_compute_performance-ego": 0.037847294693901426, "sim_compute_robot_state-ego": 0.03932944649741763}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3481451916925966, "sim_physics": 0.01118417436426336, "survival_time": 5.4999999999999885, "driven_lanedir": 1.3893386417764602, "sim_render-ego": 0.03438671285455877, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.09795257394964044, "deviation-heading": 2.332350360345814, "set_robot_commands": 0.05267969478260387, "deviation-center-line": 0.25392339208884884, "driven_lanedir_consec": 1.2550616957781522, "sim_compute_sim_state": 0.02197040861303156, "sim_compute_performance-ego": 0.03811801997098056, "sim_compute_robot_state-ego": 0.040306204015558414}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7221998752732383, "sim_physics": 0.010106759912827437, "survival_time": 1.7000000000000008, "driven_lanedir": 0.37870050067724303, "sim_render-ego": 0.03405883732964011, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.0945946398903342, "deviation-heading": 0.22411690249413224, "set_robot_commands": 0.05108381018919103, "deviation-center-line": 0.053345314340000456, "driven_lanedir_consec": 0.37870050067724303, "sim_compute_sim_state": 0.021150133189033055, "sim_compute_performance-ego": 0.03571739617516013, "sim_compute_robot_state-ego": 0.0366143128451179}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.509247596776878, "sim_physics": 0.01189483536614312, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1675634503735699, "sim_render-ego": 0.0365005510824698, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.10205090487444844, "deviation-heading": 0.2622200849667214, "set_robot_commands": 0.05394762533682364, "deviation-center-line": 0.02806411613499379, "driven_lanedir_consec": 0.1675634503735699, "sim_compute_sim_state": 0.02438577899226436, "sim_compute_performance-ego": 0.041053957409328885, "sim_compute_robot_state-ego": 0.04333121688277633}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.536379281353738, "sim_physics": 0.011467985808849336, "survival_time": 3.1999999999999966, "driven_lanedir": 1.2077235919900455, "sim_render-ego": 0.035589348524808884, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.10047776624560356, "deviation-heading": 0.7485776847357427, "set_robot_commands": 0.05295301973819733, "deviation-center-line": 0.1248254387093932, "driven_lanedir_consec": 1.1746702153007824, "sim_compute_sim_state": 0.02189740166068077, "sim_compute_performance-ego": 0.03816778585314751, "sim_compute_robot_state-ego": 0.03990602493286133}}
set_robot_commands_max0.05394762533682364
set_robot_commands_mean0.05260851038332702
set_robot_commands_median0.05267969478260387
set_robot_commands_min0.05108381018919103
sim_compute_performance-ego_max0.041053957409328885
sim_compute_performance-ego_mean0.0381808908205037
sim_compute_performance-ego_median0.03811801997098056
sim_compute_performance-ego_min0.03571739617516013
sim_compute_robot_state-ego_max0.04333121688277633
sim_compute_robot_state-ego_mean0.03989744103474632
sim_compute_robot_state-ego_median0.03990602493286133
sim_compute_robot_state-ego_min0.0366143128451179
sim_compute_sim_state_max0.02438577899226436
sim_compute_sim_state_mean0.022182341881858008
sim_compute_sim_state_median0.02189740166068077
sim_compute_sim_state_min0.021150133189033055
sim_physics_max0.01189483536614312
sim_physics_mean0.011183284412705528
sim_physics_median0.011262666611444382
sim_physics_min0.010106759912827437
sim_render-ego_max0.0365005510824698
sim_render-ego_mean0.03497824472074523
sim_render-ego_median0.03438671285455877
sim_render-ego_min0.03405883732964011
simulation-passed1
survival_time_max5.4999999999999885
survival_time_mean3.1899999999999955
survival_time_min1.3500000000000003
No reset possible
192822893Peter Almasi 🇭🇺Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessnonutonomy-P50-63180:08:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.25558086464938157
survival_time_median8.499999999999986
deviation-center-line_median0.3023947087804573
in-drivable-lane_median1.5999999999999943


other stats
agent_compute-ego_max0.09827130162314082
agent_compute-ego_mean0.09422690343706194
agent_compute-ego_median0.09216528199613094
agent_compute-ego_min0.09174981171434576
deviation-center-line_max0.3640500907467931
deviation-center-line_mean0.26702384713924676
deviation-center-line_min0.1433823457138823
deviation-heading_max3.332086183154782
deviation-heading_mean2.189943420087025
deviation-heading_median1.7039873002803805
deviation-heading_min1.397044788315818
driven_any_max1.9255715340463344
driven_any_mean1.0965204786891376
driven_any_median1.1174422990562174
driven_any_min0.47875011995067673
driven_lanedir_consec_max1.5103935794378984
driven_lanedir_consec_mean0.5914441747795129
driven_lanedir_consec_min0.17237783192624612
driven_lanedir_max1.6669202011428716
driven_lanedir_mean0.7030424349562366
driven_lanedir_median0.6183351815667317
driven_lanedir_min0.1767466996825342
in-drivable-lane_max3.499999999999992
in-drivable-lane_mean1.9499999999999984
in-drivable-lane_min0.8500000000000121
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5656594161325701, "sim_physics": 0.010352270169691606, "survival_time": 4.399999999999992, "driven_lanedir": 0.2546794497667628, "sim_render-ego": 0.032210233536633576, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.09174981171434576, "deviation-heading": 1.7039873002803805, "set_robot_commands": 0.049507132985375145, "deviation-center-line": 0.18814896475689097, "driven_lanedir_consec": 0.22033795526175529, "sim_compute_sim_state": 0.02024769512089816, "sim_compute_performance-ego": 0.03713881698521701, "sim_compute_robot_state-ego": 0.03755413673140786}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9255715340463344, "sim_physics": 0.00958884134888649, "survival_time": 12.800000000000049, "driven_lanedir": 1.6669202011428716, "sim_render-ego": 0.03351886011660099, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.09216528199613094, "deviation-heading": 3.332086183154782, "set_robot_commands": 0.050406171940267086, "deviation-center-line": 0.3640500907467931, "driven_lanedir_consec": 1.5103935794378984, "sim_compute_sim_state": 0.02056881971657276, "sim_compute_performance-ego": 0.03581746481359005, "sim_compute_robot_state-ego": 0.03741064667701721}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.1174422990562174, "sim_physics": 0.009680517982034122, "survival_time": 8.499999999999986, "driven_lanedir": 0.6183351815667317, "sim_render-ego": 0.03283606417038861, "in-drivable-lane": 2.499999999999999, "agent_compute-ego": 0.09189037014456355, "deviation-heading": 2.9551572016218555, "set_robot_commands": 0.04981757893281825, "deviation-center-line": 0.3023947087804573, "driven_lanedir_consec": 0.25558086464938157, "sim_compute_sim_state": 0.02048465644612032, "sim_compute_performance-ego": 0.03515527669121237, "sim_compute_robot_state-ego": 0.037423864532919494}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3951790242598898, "sim_physics": 0.010818955603610264, "survival_time": 8.899999999999991, "driven_lanedir": 0.7985306426222829, "sim_render-ego": 0.034596949480892564, "in-drivable-lane": 3.499999999999992, "agent_compute-ego": 0.09827130162314082, "deviation-heading": 1.397044788315818, "set_robot_commands": 0.05264575159951542, "deviation-center-line": 0.3371431256982101, "driven_lanedir_consec": 0.7985306426222829, "sim_compute_sim_state": 0.021751288617594854, "sim_compute_performance-ego": 0.037385112783882055, "sim_compute_robot_state-ego": 0.0389666168877248}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.47875011995067673, "sim_physics": 0.011359736726090714, "survival_time": 3.699999999999995, "driven_lanedir": 0.1767466996825342, "sim_render-ego": 0.033824985091750685, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.09705775170712858, "deviation-heading": 1.5614416270622895, "set_robot_commands": 0.05160815006977803, "deviation-center-line": 0.1433823457138823, "driven_lanedir_consec": 0.17237783192624612, "sim_compute_sim_state": 0.021292979652817182, "sim_compute_performance-ego": 0.03793797621855865, "sim_compute_robot_state-ego": 0.03880325201395396}}
set_robot_commands_max0.05264575159951542
set_robot_commands_mean0.05079695710555079
set_robot_commands_median0.050406171940267086
set_robot_commands_min0.049507132985375145
sim_compute_performance-ego_max0.03793797621855865
sim_compute_performance-ego_mean0.036686929498492026
sim_compute_performance-ego_median0.03713881698521701
sim_compute_performance-ego_min0.03515527669121237
sim_compute_robot_state-ego_max0.0389666168877248
sim_compute_robot_state-ego_mean0.03803170336860466
sim_compute_robot_state-ego_median0.03755413673140786
sim_compute_robot_state-ego_min0.03741064667701721
sim_compute_sim_state_max0.021751288617594854
sim_compute_sim_state_mean0.020869087910800655
sim_compute_sim_state_median0.02056881971657276
sim_compute_sim_state_min0.02024769512089816
sim_physics_max0.011359736726090714
sim_physics_mean0.010360064366062635
sim_physics_median0.010352270169691606
sim_physics_min0.00958884134888649
sim_render-ego_max0.034596949480892564
sim_render-ego_mean0.03339741847925329
sim_render-ego_median0.03351886011660099
sim_render-ego_min0.032210233536633576
simulation-passed1
survival_time_max12.800000000000049
survival_time_mean7.660000000000002
survival_time_min3.699999999999995
No reset possible
192802936Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationerrornonutonomy-P50-63180:00:59
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
192732873Peter Almasi 🇭🇺challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnonutonomy-P50-63180:06:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06104095587794767
survival_time_median1.5000000000000009
deviation-center-line_median0.020576917685314267
in-drivable-lane_median0.5000000000000004


other stats
agent_compute-ego_max0.10085370540618896
agent_compute-ego_mean0.09627232751538677
agent_compute-ego_median0.09600523312886557
agent_compute-ego_min0.09067362354647727
deviation-center-line_max0.03478349372227787
deviation-center-line_mean0.024634315188949065
deviation-center-line_min0.01868848988065828
deviation-heading_max0.5958259662606283
deviation-heading_mean0.5453347569746397
deviation-heading_median0.5274239314786031
deviation-heading_min0.5136224071068426
driven_any_max0.17878934075958955
driven_any_mean0.16109681032197642
driven_any_median0.15579174418504935
driven_any_min0.15027673630277477
driven_lanedir_consec_max0.08830374623928638
driven_lanedir_consec_mean0.06321953100911704
driven_lanedir_consec_min0.05042138202954716
driven_lanedir_max0.08830374623928638
driven_lanedir_mean0.06321953100911704
driven_lanedir_median0.06104095587794767
driven_lanedir_min0.05042138202954716
in-drivable-lane_max0.6000000000000004
in-drivable-lane_mean0.4900000000000004
in-drivable-lane_min0.4000000000000003
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.15027673630277477, "sim_physics": 0.011098086833953856, "survival_time": 1.4000000000000006, "driven_lanedir": 0.06104095587794767, "sim_render-ego": 0.03463253804615566, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.09451615810394288, "deviation-heading": 0.5721786337099747, "set_robot_commands": 0.05181546722139631, "deviation-center-line": 0.028970972110569603, "driven_lanedir_consec": 0.06104095587794767, "sim_compute_sim_state": 0.02234469141278948, "sim_compute_performance-ego": 0.03782215288707188, "sim_compute_robot_state-ego": 0.03873349939073835}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.17878934075958955, "sim_physics": 0.01167435646057129, "survival_time": 1.5000000000000009, "driven_lanedir": 0.08830374623928638, "sim_render-ego": 0.03595856030782064, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.10085370540618896, "deviation-heading": 0.5958259662606283, "set_robot_commands": 0.05427540143330892, "deviation-center-line": 0.03478349372227787, "driven_lanedir_consec": 0.08830374623928638, "sim_compute_sim_state": 0.024483203887939453, "sim_compute_performance-ego": 0.039770038922627766, "sim_compute_robot_state-ego": 0.04226187070210775}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1522405385396579, "sim_physics": 0.009863015144102035, "survival_time": 1.5500000000000007, "driven_lanedir": 0.05042138202954716, "sim_render-ego": 0.03262840547869282, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.09067362354647727, "deviation-heading": 0.5176228463171497, "set_robot_commands": 0.050838731950329195, "deviation-center-line": 0.01868848988065828, "driven_lanedir_consec": 0.05042138202954716, "sim_compute_sim_state": 0.0207513609240132, "sim_compute_performance-ego": 0.03632613920396374, "sim_compute_robot_state-ego": 0.03752020866640152}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1683856918228105, "sim_physics": 0.010888123512268066, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06132605689408521, "sim_render-ego": 0.035847020149230954, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.09931291739145914, "deviation-heading": 0.5274239314786031, "set_robot_commands": 0.05327526728312174, "deviation-center-line": 0.020151702545925316, "driven_lanedir_consec": 0.06132605689408521, "sim_compute_sim_state": 0.022117805480957032, "sim_compute_performance-ego": 0.03763532638549805, "sim_compute_robot_state-ego": 0.03915257453918457}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15579174418504935, "sim_physics": 0.010896913210550944, "survival_time": 1.5000000000000009, "driven_lanedir": 0.05500551400471876, "sim_render-ego": 0.034574031829833984, "in-drivable-lane": 0.5500000000000004, "agent_compute-ego": 0.09600523312886557, "deviation-heading": 0.5136224071068426, "set_robot_commands": 0.05369946956634521, "deviation-center-line": 0.020576917685314267, "driven_lanedir_consec": 0.05500551400471876, "sim_compute_sim_state": 0.021506460507710774, "sim_compute_performance-ego": 0.038099447886149086, "sim_compute_robot_state-ego": 0.03913036982218424}}
set_robot_commands_max0.05427540143330892
set_robot_commands_mean0.052780867490900274
set_robot_commands_median0.05327526728312174
set_robot_commands_min0.050838731950329195
sim_compute_performance-ego_max0.039770038922627766
sim_compute_performance-ego_mean0.0379306210570621
sim_compute_performance-ego_median0.03782215288707188
sim_compute_performance-ego_min0.03632613920396374
sim_compute_robot_state-ego_max0.04226187070210775
sim_compute_robot_state-ego_mean0.03935970462412329
sim_compute_robot_state-ego_median0.03913036982218424
sim_compute_robot_state-ego_min0.03752020866640152
sim_compute_sim_state_max0.024483203887939453
sim_compute_sim_state_mean0.022240704442681985
sim_compute_sim_state_median0.022117805480957032
sim_compute_sim_state_min0.0207513609240132
sim_physics_max0.01167435646057129
sim_physics_mean0.01088409903228924
sim_physics_median0.010896913210550944
sim_physics_min0.009863015144102035
sim_render-ego_max0.03595856030782064
sim_render-ego_mean0.03472811116234681
sim_render-ego_median0.03463253804615566
sim_render-ego_min0.03262840547869282
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.4900000000000009
survival_time_min1.4000000000000006
No reset possible
192662909Ashwin Ram 🇸🇬challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessnonutonomy-P50-63180:05:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6689196182870398
survival_time_median1.6500000000000008
deviation-center-line_median0.06506999786285284
in-drivable-lane_median0


other stats
agent_compute-ego_max0.15191228461988043
agent_compute-ego_mean0.14380548648623742
agent_compute-ego_median0.1462275620662805
agent_compute-ego_min0.13153048259455982
deviation-center-line_max0.07315212861273317
deviation-center-line_mean0.06705476077411905
deviation-center-line_min0.059777551753803566
deviation-heading_max0.422869365747322
deviation-heading_mean0.2288952732379924
deviation-heading_median0.1788246985654542
deviation-heading_min0.17033941806563674
driven_any_max1.001099496194527
driven_any_mean0.7841600150344521
driven_any_median0.7924488039183246
driven_any_min0.6673109209989685
driven_lanedir_consec_max0.7837305862772768
driven_lanedir_consec_mean0.7025869418731885
driven_lanedir_consec_min0.6204781075310417
driven_lanedir_max0.7837305862772768
driven_lanedir_mean0.7025869418731885
driven_lanedir_median0.6689196182870398
driven_lanedir_min0.6204781075310417
in-drivable-lane_max0.45
in-drivable-lane_mean0.1
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.001099496194527, "sim_physics": 0.008993520969297827, "survival_time": 2.0500000000000007, "driven_lanedir": 0.6689196182870398, "sim_render-ego": 0.03128687346853861, "in-drivable-lane": 0.45, "agent_compute-ego": 0.13153048259455982, "deviation-heading": 0.422869365747322, "set_robot_commands": 0.04755088178122916, "deviation-center-line": 0.06506999786285284, "driven_lanedir_consec": 0.6689196182870398, "sim_compute_sim_state": 0.019494010180961793, "sim_compute_performance-ego": 0.03368413739088105, "sim_compute_robot_state-ego": 0.035502526818252195}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6673109209989685, "sim_physics": 0.011100571731041215, "survival_time": 1.4500000000000006, "driven_lanedir": 0.6204781075310417, "sim_render-ego": 0.03559217781856142, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15009504351122627, "deviation-heading": 0.2021034657459123, "set_robot_commands": 0.055668995298188306, "deviation-center-line": 0.059777551753803566, "driven_lanedir_consec": 0.6204781075310417, "sim_compute_sim_state": 0.02330322923331425, "sim_compute_performance-ego": 0.04759552561003586, "sim_compute_robot_state-ego": 0.04108374694298054}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6674025640213636, "sim_physics": 0.00968875556156553, "survival_time": 1.4500000000000006, "driven_lanedir": 0.656165663220964, "sim_render-ego": 0.03246511262038659, "in-drivable-lane": 0, "agent_compute-ego": 0.13926205963924013, "deviation-heading": 0.1788246985654542, "set_robot_commands": 0.05127212096904886, "deviation-center-line": 0.0641219970284725, "driven_lanedir_consec": 0.656165663220964, "sim_compute_sim_state": 0.02081551222965635, "sim_compute_performance-ego": 0.03585216916840652, "sim_compute_robot_state-ego": 0.03702205625073663}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7925382900390766, "sim_physics": 0.010130073084975736, "survival_time": 1.6500000000000008, "driven_lanedir": 0.7837305862772768, "sim_render-ego": 0.03461239554665305, "in-drivable-lane": 0, "agent_compute-ego": 0.1462275620662805, "deviation-heading": 0.17033941806563674, "set_robot_commands": 0.05265361612493342, "deviation-center-line": 0.07315212861273317, "driven_lanedir_consec": 0.7837305862772768, "sim_compute_sim_state": 0.021445021484837387, "sim_compute_performance-ego": 0.039170698686079544, "sim_compute_robot_state-ego": 0.03983163833618164}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7924488039183246, "sim_physics": 0.010126843596949722, "survival_time": 1.6500000000000008, "driven_lanedir": 0.7836407340496203, "sim_render-ego": 0.03473308592131644, "in-drivable-lane": 0, "agent_compute-ego": 0.15191228461988043, "deviation-heading": 0.17033941806563674, "set_robot_commands": 0.05290589910565001, "deviation-center-line": 0.07315212861273317, "driven_lanedir_consec": 0.7836407340496203, "sim_compute_sim_state": 0.021761287342418324, "sim_compute_performance-ego": 0.037964091156468247, "sim_compute_robot_state-ego": 0.03973348212964607}}
set_robot_commands_max0.055668995298188306
set_robot_commands_mean0.05201030265580995
set_robot_commands_median0.05265361612493342
set_robot_commands_min0.04755088178122916
sim_compute_performance-ego_max0.04759552561003586
sim_compute_performance-ego_mean0.03885332440237425
sim_compute_performance-ego_median0.037964091156468247
sim_compute_performance-ego_min0.03368413739088105
sim_compute_robot_state-ego_max0.04108374694298054
sim_compute_robot_state-ego_mean0.03863469009555941
sim_compute_robot_state-ego_median0.03973348212964607
sim_compute_robot_state-ego_min0.035502526818252195
sim_compute_sim_state_max0.02330322923331425
sim_compute_sim_state_mean0.02136381209423762
sim_compute_sim_state_median0.021445021484837387
sim_compute_sim_state_min0.019494010180961793
sim_physics_max0.011100571731041215
sim_physics_mean0.010007952988766004
sim_physics_median0.010126843596949722
sim_physics_min0.008993520969297827
sim_render-ego_max0.03559217781856142
sim_render-ego_mean0.033737929075091225
sim_render-ego_median0.03461239554665305
sim_render-ego_min0.03128687346853861
simulation-passed1
survival_time_max2.0500000000000007
survival_time_mean1.6500000000000008
survival_time_min1.4500000000000006
No reset possible
192542914Claudio RuchPython templateaido2-AMOD-efficiencystep1-simulationsuccessyesnutonomy-P50-63180:02:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
192492924Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFV-sim-testingstep1-simulationsuccessnonutonomy-P50-63180:05:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0963525960676841
survival_time_median1.3000000000000005
deviation-center-line_median0.05301664729193711
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.10508611569037804
agent_compute-ego_mean0.09361599549487395
agent_compute-ego_median0.09231509268283844
agent_compute-ego_min0.08770114641923171
deviation-center-line_max0.06410358626714134
deviation-center-line_mean0.0521984962011187
deviation-center-line_min0.038015082820974946
deviation-heading_max0.7563043463901452
deviation-heading_mean0.7297357544854309
deviation-heading_median0.7260928756795181
deviation-heading_min0.6889224189830184
driven_any_max0.17436596242003774
driven_any_mean0.1649404036743268
driven_any_median0.1628552859780278
driven_any_min0.15879223205916482
driven_lanedir_consec_max0.11360126065129084
driven_lanedir_consec_mean0.09530363468609782
driven_lanedir_consec_min0.07320336616537393
driven_lanedir_max0.11360126065129084
driven_lanedir_mean0.09530363468609782
driven_lanedir_median0.0963525960676841
driven_lanedir_min0.07320336616537393
in-drivable-lane_max0.4500000000000004
in-drivable-lane_mean0.14000000000000012
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1593089184083226, "sim_physics": 0.017589569091796875, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0974763132750316, "sim_render-ego": 0.03633047067202055, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.10508611569037804, "deviation-heading": 0.7241826930025458, "set_robot_commands": 0.054317511045015775, "deviation-center-line": 0.05370621181876189, "driven_lanedir_consec": 0.0974763132750316, "sim_compute_sim_state": 0.021859022287222057, "sim_compute_performance-ego": 0.03828531045180101, "sim_compute_robot_state-ego": 0.04031740702115572, "sim_compute_robot_state-npc0": 0.04468804139357347, "sim_compute_robot_state-npc1": 0.03922955806438739, "sim_compute_robot_state-npc2": 0.0384824642768273, "sim_compute_robot_state-npc3": 0.03871852617997389}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1628552859780278, "sim_physics": 0.016279944351741245, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0963525960676841, "sim_render-ego": 0.033366220338003974, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.09421370710645403, "deviation-heading": 0.7260928756795181, "set_robot_commands": 0.05195552110671997, "deviation-center-line": 0.05215095280677825, "driven_lanedir_consec": 0.0963525960676841, "sim_compute_sim_state": 0.021259776183537075, "sim_compute_performance-ego": 0.03617120640618461, "sim_compute_robot_state-ego": 0.0378076263836452, "sim_compute_robot_state-npc0": 0.03794806344168527, "sim_compute_robot_state-npc1": 0.037716031074523926, "sim_compute_robot_state-npc2": 0.03723006589072091, "sim_compute_robot_state-npc3": 0.03585442474910191}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17436596242003774, "sim_physics": 0.016166143119335175, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07320336616537393, "sim_render-ego": 0.03244811296463013, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.09231509268283844, "deviation-heading": 0.6889224189830184, "set_robot_commands": 0.04968274384737015, "deviation-center-line": 0.038015082820974946, "driven_lanedir_consec": 0.07320336616537393, "sim_compute_sim_state": 0.020550839602947235, "sim_compute_performance-ego": 0.03500227630138397, "sim_compute_robot_state-ego": 0.03667861223220825, "sim_compute_robot_state-npc0": 0.03687380254268646, "sim_compute_robot_state-npc1": 0.036846935749053955, "sim_compute_robot_state-npc2": 0.03586115688085556, "sim_compute_robot_state-npc3": 0.12963387370109558}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.15879223205916482, "sim_physics": 0.016877357776348408, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09588463727110864, "sim_render-ego": 0.03265593602107121, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08770114641923171, "deviation-heading": 0.7531764383719269, "set_robot_commands": 0.04966368125035213, "deviation-center-line": 0.05301664729193711, "driven_lanedir_consec": 0.09588463727110864, "sim_compute_sim_state": 0.020073395508986253, "sim_compute_performance-ego": 0.03827590208787184, "sim_compute_robot_state-ego": 0.03670230278602013, "sim_compute_robot_state-npc0": 0.03594668094928448, "sim_compute_robot_state-npc1": 0.03535186327420748, "sim_compute_robot_state-npc2": 0.03540139014904316, "sim_compute_robot_state-npc3": 0.03509428867926964}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1693796195060811, "sim_physics": 0.0153424464739286, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11360126065129084, "sim_render-ego": 0.03220696632678692, "in-drivable-lane": 0, "agent_compute-ego": 0.08876391557546762, "deviation-heading": 0.7563043463901452, "set_robot_commands": 0.049427610177260176, "deviation-center-line": 0.06410358626714134, "driven_lanedir_consec": 0.11360126065129084, "sim_compute_sim_state": 0.020441238696758565, "sim_compute_performance-ego": 0.03516398943387545, "sim_compute_robot_state-ego": 0.03623261818519005, "sim_compute_robot_state-npc0": 0.03494385572580191, "sim_compute_robot_state-npc1": 0.0353772731927725, "sim_compute_robot_state-npc2": 0.035676039182222806, "sim_compute_robot_state-npc3": 0.035628098707932696}}
set_robot_commands_max0.054317511045015775
set_robot_commands_mean0.05100941348534364
set_robot_commands_median0.04968274384737015
set_robot_commands_min0.049427610177260176
sim_compute_performance-ego_max0.03828531045180101
sim_compute_performance-ego_mean0.03657973693622337
sim_compute_performance-ego_median0.03617120640618461
sim_compute_performance-ego_min0.03500227630138397
sim_compute_robot_state-ego_max0.04031740702115572
sim_compute_robot_state-ego_mean0.037547713321643875
sim_compute_robot_state-ego_median0.03670230278602013
sim_compute_robot_state-ego_min0.03623261818519005
sim_compute_robot_state-npc0_max0.04468804139357347
sim_compute_robot_state-npc0_mean0.03808008881060632
sim_compute_robot_state-npc0_median0.03687380254268646
sim_compute_robot_state-npc0_min0.03494385572580191
sim_compute_robot_state-npc1_max0.03922955806438739
sim_compute_robot_state-npc1_mean0.036904332270989056
sim_compute_robot_state-npc1_median0.036846935749053955
sim_compute_robot_state-npc1_min0.03535186327420748
sim_compute_robot_state-npc2_max0.0384824642768273
sim_compute_robot_state-npc2_mean0.03653022327593395
sim_compute_robot_state-npc2_median0.03586115688085556
sim_compute_robot_state-npc2_min0.03540139014904316
sim_compute_robot_state-npc3_max0.12963387370109558
sim_compute_robot_state-npc3_mean0.05498584240347474
sim_compute_robot_state-npc3_median0.03585442474910191
sim_compute_robot_state-npc3_min0.03509428867926964
sim_compute_sim_state_max0.021859022287222057
sim_compute_sim_state_mean0.020836854455890237
sim_compute_sim_state_median0.020550839602947235
sim_compute_sim_state_min0.020073395508986253
sim_physics_max0.017589569091796875
sim_physics_mean0.01645109216263006
sim_physics_median0.016279944351741245
sim_physics_min0.0153424464739286
sim_render-ego_max0.03633047067202055
sim_render-ego_mean0.03340154126450255
sim_render-ego_median0.03265593602107121
sim_render-ego_min0.03220696632678692
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean1.3800000000000006
survival_time_min1.3000000000000005
No reset possible
192442937Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationerrornonutonomy-P50-63180:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
192382948Bhairav MehtaBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationsuccessnonutonomy-P50-63180:05:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.10595285730710112
survival_time_median1.3000000000000005
deviation-center-line_median0.0516002469587028
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10055638211114068
agent_compute-ego_mean0.09592923371346444
agent_compute-ego_median0.09539349262530988
agent_compute-ego_min0.09224483489990234
deviation-center-line_max0.06364803338789915
deviation-center-line_mean0.05276115073584177
deviation-center-line_min0.04496223327933722
deviation-heading_max0.7423081602723693
deviation-heading_mean0.706354001635945
deviation-heading_median0.7257234415602533
deviation-heading_min0.6251697915122961
driven_any_max0.17494687927580566
driven_any_mean0.16386340069691524
driven_any_median0.16643366112180488
driven_any_min0.1529405704553876
driven_lanedir_consec_max0.12683359081609202
driven_lanedir_consec_mean0.10340657091932522
driven_lanedir_consec_min0.07990628509734776
driven_lanedir_max0.12683359081609202
driven_lanedir_mean0.10340657091932522
driven_lanedir_median0.10595285730710112
driven_lanedir_min0.07990628509734776
in-drivable-lane_max0.10000000000000007
in-drivable-lane_mean0.04000000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.17104645991035444, "sim_physics": 0.017384162970951626, "survival_time": 1.4000000000000006, "driven_lanedir": 0.10595285730710112, "sim_render-ego": 0.034735841410500665, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.10055638211114068, "deviation-heading": 0.6962976839596691, "set_robot_commands": 0.05287831170218331, "deviation-center-line": 0.04496223327933722, "driven_lanedir_consec": 0.10595285730710112, "sim_compute_sim_state": 0.020825343472617015, "sim_compute_performance-ego": 0.03781572410038539, "sim_compute_robot_state-ego": 0.039602109364100864, "sim_compute_robot_state-npc0": 0.03867538486208234, "sim_compute_robot_state-npc1": 0.0422368049621582, "sim_compute_robot_state-npc2": 0.04074951580592564, "sim_compute_robot_state-npc3": 0.03792569466999599}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16643366112180488, "sim_physics": 0.016175013322096605, "survival_time": 1.3000000000000005, "driven_lanedir": 0.111446048767041, "sim_render-ego": 0.03724742852724515, "in-drivable-lane": 0, "agent_compute-ego": 0.0945669412612915, "deviation-heading": 0.7423081602723693, "set_robot_commands": 0.0523829826941857, "deviation-center-line": 0.06364803338789915, "driven_lanedir_consec": 0.111446048767041, "sim_compute_sim_state": 0.021325184748722956, "sim_compute_performance-ego": 0.04028038795177753, "sim_compute_robot_state-ego": 0.039310611211336575, "sim_compute_robot_state-npc0": 0.03803267845740685, "sim_compute_robot_state-npc1": 0.03852298626532921, "sim_compute_robot_state-npc2": 0.03975553695972149, "sim_compute_robot_state-npc3": 0.038277433468745306}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17494687927580566, "sim_physics": 0.016562538146972658, "survival_time": 1.2500000000000004, "driven_lanedir": 0.12683359081609202, "sim_render-ego": 0.034457311630249024, "in-drivable-lane": 0, "agent_compute-ego": 0.09688451766967772, "deviation-heading": 0.6251697915122961, "set_robot_commands": 0.05343120574951172, "deviation-center-line": 0.058409659239654486, "driven_lanedir_consec": 0.12683359081609202, "sim_compute_sim_state": 0.021089019775390624, "sim_compute_performance-ego": 0.03650299072265625, "sim_compute_robot_state-ego": 0.03797980308532715, "sim_compute_robot_state-npc0": 0.03961817741394043, "sim_compute_robot_state-npc1": 0.04098153114318848, "sim_compute_robot_state-npc2": 0.038289146423339845, "sim_compute_robot_state-npc3": 0.03881333351135254}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1529405704553876, "sim_physics": 0.017611301862276517, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07990628509734776, "sim_render-ego": 0.03370848985818716, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.09539349262530988, "deviation-heading": 0.7257234415602533, "set_robot_commands": 0.05211328543149508, "deviation-center-line": 0.04518558081361517, "driven_lanedir_consec": 0.07990628509734776, "sim_compute_sim_state": 0.02116105189690223, "sim_compute_performance-ego": 0.036444480602557845, "sim_compute_robot_state-ego": 0.0409094370328463, "sim_compute_robot_state-npc0": 0.03979046528155987, "sim_compute_robot_state-npc1": 0.038733528210566595, "sim_compute_robot_state-npc2": 0.03866158081935002, "sim_compute_robot_state-npc3": 0.03779121545644907}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15394943272122358, "sim_physics": 0.015527515411376954, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09289407260904414, "sim_render-ego": 0.03529136657714844, "in-drivable-lane": 0, "agent_compute-ego": 0.09224483489990234, "deviation-heading": 0.742270930875137, "set_robot_commands": 0.05401811599731445, "deviation-center-line": 0.0516002469587028, "driven_lanedir_consec": 0.09289407260904414, "sim_compute_sim_state": 0.02076101303100586, "sim_compute_performance-ego": 0.03781256675720215, "sim_compute_robot_state-ego": 0.03876467704772949, "sim_compute_robot_state-npc0": 0.03978848457336426, "sim_compute_robot_state-npc1": 0.03835688591003418, "sim_compute_robot_state-npc2": 0.038443374633789065, "sim_compute_robot_state-npc3": 0.03845947265625}}
set_robot_commands_max0.05401811599731445
set_robot_commands_mean0.05296478031493805
set_robot_commands_median0.05287831170218331
set_robot_commands_min0.05211328543149508
sim_compute_performance-ego_max0.04028038795177753
sim_compute_performance-ego_mean0.037771230026915834
sim_compute_performance-ego_median0.03781256675720215
sim_compute_performance-ego_min0.036444480602557845
sim_compute_robot_state-ego_max0.0409094370328463
sim_compute_robot_state-ego_mean0.03931332754826807
sim_compute_robot_state-ego_median0.039310611211336575
sim_compute_robot_state-ego_min0.03797980308532715
sim_compute_robot_state-npc0_max0.03979046528155987
sim_compute_robot_state-npc0_mean0.03918103811767075
sim_compute_robot_state-npc0_median0.03961817741394043
sim_compute_robot_state-npc0_min0.03803267845740685
sim_compute_robot_state-npc1_max0.0422368049621582
sim_compute_robot_state-npc1_mean0.03976634729825533
sim_compute_robot_state-npc1_median0.038733528210566595
sim_compute_robot_state-npc1_min0.03835688591003418
sim_compute_robot_state-npc2_max0.04074951580592564
sim_compute_robot_state-npc2_mean0.03917983092842521
sim_compute_robot_state-npc2_median0.03866158081935002
sim_compute_robot_state-npc2_min0.038289146423339845
sim_compute_robot_state-npc3_max0.03881333351135254
sim_compute_robot_state-npc3_mean0.03825342995255858
sim_compute_robot_state-npc3_median0.038277433468745306
sim_compute_robot_state-npc3_min0.03779121545644907
sim_compute_sim_state_max0.021325184748722956
sim_compute_sim_state_mean0.021032322584927737
sim_compute_sim_state_median0.021089019775390624
sim_compute_sim_state_min0.02076101303100586
sim_physics_max0.017611301862276517
sim_physics_mean0.016652106342734875
sim_physics_median0.016562538146972658
sim_physics_min0.015527515411376954
sim_render-ego_max0.03724742852724515
sim_render-ego_mean0.03508808760066608
sim_render-ego_median0.034735841410500665
sim_render-ego_min0.03370848985818716
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.3000000000000005
survival_time_min1.2500000000000004
No reset possible