Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 66355
14119
Andrea Censi Β π¨πexercises_braitenberg mooc-BV1
421 failed yes gpu-production-spot-1-04
2021-04-10 12:02:05+00:00 2021-04-10 12:04:04+00:00 0:01:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 581, in run_episode
agent_ci.write_topic_and_expect_zero("observations", obs_plus)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:
error in ego0 |Exception while handling a message on topic "observations".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
|| f(**kwargs)
|| File "/agent/solution/agent.py", line 65, in on_received_observations
|| context.info("received first observations", data=data)
|| TypeError: info() got an unexpected keyword argument 'data'
||
|| The above exception was the direct cause of the following exception:
||
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
|| raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
|| zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method BraitenbergAgent.on_received_observations of <__main__.BraitenbergAgent object at 0x7f137b17d880>>.
|| β f: <bound method BraitenbergAgent.on_received_observations of <__main__.BraitenbergAgent object at 0x7f137b17d880>>
|| β args: dict[2]
|| β β data :
|| β β DB20Observations
|| β β β camera : JPGImage(jpg_data =53233 bytes b'\xff\xd8\xff\xe0\x00\x10JFIF' )
|| β β β odometry :
|| β β β DB20Odometry
|| β β β β resolution_rad : 0.046542113386515455
|| β β β β axis_left_rad : 0.0
|| β β β β axis_right_rad : 0.0
|| β β context : <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f1368bc6340>
|| β argspec: <class 'inspect.FullArgSpec'> [7]
|| β #0 [self, context, data]
|| β #1 None
|| β #2 None
|| β #3 None
|| β #4 []
|| β #5 None
|| β #6 dict[2]
|| β β context : <class 'zuper_nodes_wrapper.interface.Context'>
|| β β data :
|| β β dataclass aido_schemas.schemas.DB20Observations
|| β β field camera : dataclass aido_schemas.protocol_simulator.JPGImage
|| β β field jpg_data : bytes
|| β β __doc__
|| β β An image in JPG format.
|| β β
|| β β jpg_data
|| β β field odometry : dataclass aido_schemas.schemas.DB20Odometry
|| β β field resolution_rad : float
|| β β field axis_left_rad : float
|| β β field axis_right_rad : float
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
yield cie
File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
wrap(cie)
File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
asyncio.run(main(cie, logdir, attempts), debug=True)
File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 312, in main
length_s = await run_episode(
File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 593, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 66347
14117
Jacopo Tani exercises_braitenberg mooc-BV1
421 success yes gpu-production-spot-1-04
2021-04-10 02:27:48+00:00 2021-04-10 02:33:29+00:00 0:05:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats agent_compute-ego0_max 0.013152173770371305 agent_compute-ego0_mean 0.013152173770371305 agent_compute-ego0_median 0.013152173770371305 agent_compute-ego0_min 0.013152173770371305 complete-iteration_max 0.19817788797467412 complete-iteration_mean 0.19817788797467412 complete-iteration_median 0.19817788797467412 complete-iteration_min 0.19817788797467412 deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 driven_any_max 1.608600000000037 driven_any_mean 1.608600000000037 driven_any_median 1.608600000000037 driven_any_min 1.608600000000037 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 get_duckie_state_max 0.042559469899823586 get_duckie_state_mean 0.042559469899823586 get_duckie_state_median 0.042559469899823586 get_duckie_state_min 0.042559469899823586 get_robot_state_max 0.0039584991325187 get_robot_state_mean 0.0039584991325187 get_robot_state_median 0.0039584991325187 get_robot_state_min 0.0039584991325187 get_state_dump_max 0.01176552960522286 get_state_dump_mean 0.01176552960522286 get_state_dump_median 0.01176552960522286 get_state_dump_min 0.01176552960522286 get_ui_image_max 0.02581487334330022 get_ui_image_mean 0.02581487334330022 get_ui_image_median 0.02581487334330022 get_ui_image_min 0.02581487334330022 in-drivable-lane_max 27.85000000000026 in-drivable-lane_mean 27.85000000000026 in-drivable-lane_median 27.85000000000026 in-drivable-lane_min 27.85000000000026 per-episodes details {"t08d20-ego0": {"driven_any": 1.608600000000037, "get_ui_image": 0.02581487334330022, "step_physics": 0.08181086278730823, "survival_time": 27.85000000000026, "driven_lanedir": 0.0, "get_state_dump": 0.01176552960522286, "get_robot_state": 0.0039584991325187, "sim_render-ego0": 0.003877638915960934, "get_duckie_state": 0.042559469899823586, "in-drivable-lane": 27.85000000000026, "deviation-heading": 0.0, "agent_compute-ego0": 0.013152173770371305, "complete-iteration": 0.19817788797467412, "set_robot_commands": 0.002312549126190951, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.01077577546505945, "sim_compute_performance-ego0": 0.0020512158725424054}}set_robot_commands_max 0.002312549126190951 set_robot_commands_mean 0.002312549126190951 set_robot_commands_median 0.002312549126190951 set_robot_commands_min 0.002312549126190951 sim_compute_performance-ego0_max 0.0020512158725424054 sim_compute_performance-ego0_mean 0.0020512158725424054 sim_compute_performance-ego0_median 0.0020512158725424054 sim_compute_performance-ego0_min 0.0020512158725424054 sim_compute_sim_state_max 0.01077577546505945 sim_compute_sim_state_mean 0.01077577546505945 sim_compute_sim_state_median 0.01077577546505945 sim_compute_sim_state_min 0.01077577546505945 sim_render-ego0_max 0.003877638915960934 sim_render-ego0_mean 0.003877638915960934 sim_render-ego0_median 0.003877638915960934 sim_render-ego0_min 0.003877638915960934 simulation-passed 1 step_physics_max 0.08181086278730823 step_physics_mean 0.08181086278730823 step_physics_median 0.08181086278730823 step_physics_min 0.08181086278730823 survival_time_max 27.85000000000026 survival_time_mean 27.85000000000026 survival_time_median 27.85000000000026 survival_time_min 27.85000000000026
No reset possible 66314
13939
YU CHEN CBC Net v2 test - added mar 31 dataset aido-LFP-sim-validation
sim-1of4 success no gpu-production-spot-1-04
2021-04-09 14:54:30+00:00 2021-04-09 14:56:33+00:00 0:02:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.7499999999999805 in-drivable-lane_median 3.699999999999987 driven_lanedir_consec_median 1.2454732351234088 deviation-center-line_median 0.3001217680682904
other stats agent_compute-ego0_max 0.0949176977842282 agent_compute-ego0_mean 0.0949176977842282 agent_compute-ego0_median 0.0949176977842282 agent_compute-ego0_min 0.0949176977842282 complete-iteration_max 0.2714173549260849 complete-iteration_mean 0.2714173549260849 complete-iteration_median 0.2714173549260849 complete-iteration_min 0.2714173549260849 deviation-center-line_max 0.3001217680682904 deviation-center-line_mean 0.3001217680682904 deviation-center-line_min 0.3001217680682904 deviation-heading_max 1.1754833187233278 deviation-heading_mean 1.1754833187233278 deviation-heading_median 1.1754833187233278 deviation-heading_min 1.1754833187233278 driven_any_max 2.06905620545571 driven_any_mean 2.06905620545571 driven_any_median 2.06905620545571 driven_any_min 2.06905620545571 driven_lanedir_consec_max 1.2454732351234088 driven_lanedir_consec_mean 1.2454732351234088 driven_lanedir_consec_min 1.2454732351234088 driven_lanedir_max 1.2454732351234088 driven_lanedir_mean 1.2454732351234088 driven_lanedir_median 1.2454732351234088 driven_lanedir_min 1.2454732351234088 get_duckie_state_max 0.0044296964620932555 get_duckie_state_mean 0.0044296964620932555 get_duckie_state_median 0.0044296964620932555 get_duckie_state_min 0.0044296964620932555 get_robot_state_max 0.003908524146446815 get_robot_state_mean 0.003908524146446815 get_robot_state_median 0.003908524146446815 get_robot_state_min 0.003908524146446815 get_state_dump_max 0.0056727070074815015 get_state_dump_mean 0.0056727070074815015 get_state_dump_median 0.0056727070074815015 get_state_dump_min 0.0056727070074815015 get_ui_image_max 0.02810912101696699 get_ui_image_mean 0.02810912101696699 get_ui_image_median 0.02810912101696699 get_ui_image_min 0.02810912101696699 in-drivable-lane_max 3.699999999999987 in-drivable-lane_mean 3.699999999999987 in-drivable-lane_min 3.699999999999987 per-episodes details {"LFP-norm-small_loop-000-ego0": {"driven_any": 2.06905620545571, "get_ui_image": 0.02810912101696699, "step_physics": 0.11971673598656288, "survival_time": 7.7499999999999805, "driven_lanedir": 1.2454732351234088, "get_state_dump": 0.0056727070074815015, "get_robot_state": 0.003908524146446815, "sim_render-ego0": 0.003931368008638039, "get_duckie_state": 0.0044296964620932555, "in-drivable-lane": 3.699999999999987, "deviation-heading": 1.1754833187233278, "agent_compute-ego0": 0.0949176977842282, "complete-iteration": 0.2714173549260849, "set_robot_commands": 0.002422704146458552, "deviation-center-line": 0.3001217680682904, "driven_lanedir_consec": 1.2454732351234088, "sim_compute_sim_state": 0.006151767877432017, "sim_compute_performance-ego0": 0.0020604821351858284}}set_robot_commands_max 0.002422704146458552 set_robot_commands_mean 0.002422704146458552 set_robot_commands_median 0.002422704146458552 set_robot_commands_min 0.002422704146458552 sim_compute_performance-ego0_max 0.0020604821351858284 sim_compute_performance-ego0_mean 0.0020604821351858284 sim_compute_performance-ego0_median 0.0020604821351858284 sim_compute_performance-ego0_min 0.0020604821351858284 sim_compute_sim_state_max 0.006151767877432017 sim_compute_sim_state_mean 0.006151767877432017 sim_compute_sim_state_median 0.006151767877432017 sim_compute_sim_state_min 0.006151767877432017 sim_render-ego0_max 0.003931368008638039 sim_render-ego0_mean 0.003931368008638039 sim_render-ego0_median 0.003931368008638039 sim_render-ego0_min 0.003931368008638039 simulation-passed 1 step_physics_max 0.11971673598656288 step_physics_mean 0.11971673598656288 step_physics_median 0.11971673598656288 step_physics_min 0.11971673598656288 survival_time_max 7.7499999999999805 survival_time_mean 7.7499999999999805 survival_time_min 7.7499999999999805
No reset possible 66307
13912
YU CHEN CBC Net v2 - test aido-LFP-sim-validation
sim-2of4 success no gpu-production-spot-1-04
2021-04-09 14:52:14+00:00 2021-04-09 14:54:10+00:00 0:01:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.849999999999987 in-drivable-lane_median 0.34999999999999876 driven_lanedir_consec_median 2.0977623435044706 deviation-center-line_median 0.4624492337574673
other stats agent_compute-ego0_max 0.09518978555323714 agent_compute-ego0_mean 0.09518978555323714 agent_compute-ego0_median 0.09518978555323714 agent_compute-ego0_min 0.09518978555323714 complete-iteration_max 0.3245592218334392 complete-iteration_mean 0.3245592218334392 complete-iteration_median 0.3245592218334392 complete-iteration_min 0.3245592218334392 deviation-center-line_max 0.4624492337574673 deviation-center-line_mean 0.4624492337574673 deviation-center-line_min 0.4624492337574673 deviation-heading_max 1.293432697597198 deviation-heading_mean 1.293432697597198 deviation-heading_median 1.293432697597198 deviation-heading_min 1.293432697597198 driven_any_max 2.286404587024805 driven_any_mean 2.286404587024805 driven_any_median 2.286404587024805 driven_any_min 2.286404587024805 driven_lanedir_consec_max 2.0977623435044706 driven_lanedir_consec_mean 2.0977623435044706 driven_lanedir_consec_min 2.0977623435044706 driven_lanedir_max 2.0977623435044706 driven_lanedir_mean 2.0977623435044706 driven_lanedir_median 2.0977623435044706 driven_lanedir_min 2.0977623435044706 get_duckie_state_max 0.026809221607143597 get_duckie_state_mean 0.026809221607143597 get_duckie_state_median 0.026809221607143597 get_duckie_state_min 0.026809221607143597 get_robot_state_max 0.004184151099900068 get_robot_state_mean 0.004184151099900068 get_robot_state_median 0.004184151099900068 get_robot_state_min 0.004184151099900068 get_state_dump_max 0.00988064580044504 get_state_dump_mean 0.00988064580044504 get_state_dump_median 0.00988064580044504 get_state_dump_min 0.00988064580044504 get_ui_image_max 0.03551075620166326 get_ui_image_mean 0.03551075620166326 get_ui_image_median 0.03551075620166326 get_ui_image_min 0.03551075620166326 in-drivable-lane_max 0.34999999999999876 in-drivable-lane_mean 0.34999999999999876 in-drivable-lane_min 0.34999999999999876 per-episodes details {"LFP-norm-loop-000-ego0": {"driven_any": 2.286404587024805, "get_ui_image": 0.03551075620166326, "step_physics": 0.13596757185661187, "survival_time": 5.849999999999987, "driven_lanedir": 2.0977623435044706, "get_state_dump": 0.00988064580044504, "get_robot_state": 0.004184151099900068, "sim_render-ego0": 0.00406128471180544, "get_duckie_state": 0.026809221607143597, "in-drivable-lane": 0.34999999999999876, "deviation-heading": 1.293432697597198, "agent_compute-ego0": 0.09518978555323714, "complete-iteration": 0.3245592218334392, "set_robot_commands": 0.0025099414890095337, "deviation-center-line": 0.4624492337574673, "driven_lanedir_consec": 2.0977623435044706, "sim_compute_sim_state": 0.008189771134974592, "sim_compute_performance-ego0": 0.002140580597570387}}set_robot_commands_max 0.0025099414890095337 set_robot_commands_mean 0.0025099414890095337 set_robot_commands_median 0.0025099414890095337 set_robot_commands_min 0.0025099414890095337 sim_compute_performance-ego0_max 0.002140580597570387 sim_compute_performance-ego0_mean 0.002140580597570387 sim_compute_performance-ego0_median 0.002140580597570387 sim_compute_performance-ego0_min 0.002140580597570387 sim_compute_sim_state_max 0.008189771134974592 sim_compute_sim_state_mean 0.008189771134974592 sim_compute_sim_state_median 0.008189771134974592 sim_compute_sim_state_min 0.008189771134974592 sim_render-ego0_max 0.00406128471180544 sim_render-ego0_mean 0.00406128471180544 sim_render-ego0_median 0.00406128471180544 sim_render-ego0_min 0.00406128471180544 simulation-passed 1 step_physics_max 0.13596757185661187 step_physics_mean 0.13596757185661187 step_physics_median 0.13596757185661187 step_physics_min 0.13596757185661187 survival_time_max 5.849999999999987 survival_time_mean 5.849999999999987 survival_time_min 5.849999999999987
No reset possible 66290
13798
Nicholas Kostelnik template-random aido-hello-sim-validation
370 aborted no gpu-production-spot-1-04
2021-04-09 14:48:13+00:00 2021-04-09 14:48:35+00:00 0:00:22 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
raise create_api_error_from_http_exception(e)
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691 tag None
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 66286
13798
Nicholas Kostelnik template-random aido-hello-sim-validation
370 aborted no gpu-production-spot-1-04
2021-04-09 14:47:17+00:00 2021-04-09 14:47:40+00:00 0:00:23 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
raise create_api_error_from_http_exception(e)
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691 tag None
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 66269
13694
Samuel Alexander template-tensorflow aido-LF-sim-validation
sim-2of4 success no gpu-production-spot-1-04
2021-04-09 14:43:34+00:00 2021-04-09 14:46:51+00:00 0:03:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.20974163323638173 survival_time_median 5.899999999999987 deviation-center-line_median 0.08330758100913338 in-drivable-lane_median 4.449999999999989
other stats agent_compute-ego0_max 0.03064762444055381 agent_compute-ego0_mean 0.03064762444055381 agent_compute-ego0_median 0.03064762444055381 agent_compute-ego0_min 0.03064762444055381 complete-iteration_max 0.18978278176123356 complete-iteration_mean 0.18978278176123356 complete-iteration_median 0.18978278176123356 complete-iteration_min 0.18978278176123356 deviation-center-line_max 0.08330758100913338 deviation-center-line_mean 0.08330758100913338 deviation-center-line_min 0.08330758100913338 deviation-heading_max 1.061369761525336 deviation-heading_mean 1.061369761525336 deviation-heading_median 1.061369761525336 deviation-heading_min 1.061369761525336 driven_any_max 2.119516977414813 driven_any_mean 2.119516977414813 driven_any_median 2.119516977414813 driven_any_min 2.119516977414813 driven_lanedir_consec_max 0.20974163323638173 driven_lanedir_consec_mean 0.20974163323638173 driven_lanedir_consec_min 0.20974163323638173 driven_lanedir_max 0.20974163323638173 driven_lanedir_mean 0.20974163323638173 driven_lanedir_median 0.20974163323638173 driven_lanedir_min 0.20974163323638173 get_duckie_state_max 1.2001069653935793e-06 get_duckie_state_mean 1.2001069653935793e-06 get_duckie_state_median 1.2001069653935793e-06 get_duckie_state_min 1.2001069653935793e-06 get_robot_state_max 0.003962659034408441 get_robot_state_mean 0.003962659034408441 get_robot_state_median 0.003962659034408441 get_robot_state_min 0.003962659034408441 get_state_dump_max 0.004908784096982299 get_state_dump_mean 0.004908784096982299 get_state_dump_median 0.004908784096982299 get_state_dump_min 0.004908784096982299 get_ui_image_max 0.027341421912698186 get_ui_image_mean 0.027341421912698186 get_ui_image_median 0.027341421912698186 get_ui_image_min 0.027341421912698186 in-drivable-lane_max 4.449999999999989 in-drivable-lane_mean 4.449999999999989 in-drivable-lane_min 4.449999999999989 per-episodes details {"LF-norm-small_loop-000-ego0": {"driven_any": 2.119516977414813, "get_ui_image": 0.027341421912698186, "step_physics": 0.10710478430034734, "survival_time": 5.899999999999987, "driven_lanedir": 0.20974163323638173, "get_state_dump": 0.004908784096982299, "get_robot_state": 0.003962659034408441, "sim_render-ego0": 0.004200604783386744, "get_duckie_state": 1.2001069653935793e-06, "in-drivable-lane": 4.449999999999989, "deviation-heading": 1.061369761525336, "agent_compute-ego0": 0.03064762444055381, "complete-iteration": 0.18978278176123356, "set_robot_commands": 0.002617240953846138, "deviation-center-line": 0.08330758100913338, "driven_lanedir_consec": 0.20974163323638173, "sim_compute_sim_state": 0.006710499274630507, "sim_compute_performance-ego0": 0.0022023946297268907}}set_robot_commands_max 0.002617240953846138 set_robot_commands_mean 0.002617240953846138 set_robot_commands_median 0.002617240953846138 set_robot_commands_min 0.002617240953846138 sim_compute_performance-ego0_max 0.0022023946297268907 sim_compute_performance-ego0_mean 0.0022023946297268907 sim_compute_performance-ego0_median 0.0022023946297268907 sim_compute_performance-ego0_min 0.0022023946297268907 sim_compute_sim_state_max 0.006710499274630507 sim_compute_sim_state_mean 0.006710499274630507 sim_compute_sim_state_median 0.006710499274630507 sim_compute_sim_state_min 0.006710499274630507 sim_render-ego0_max 0.004200604783386744 sim_render-ego0_mean 0.004200604783386744 sim_render-ego0_median 0.004200604783386744 sim_render-ego0_min 0.004200604783386744 simulation-passed 1 step_physics_max 0.10710478430034734 step_physics_mean 0.10710478430034734 step_physics_median 0.10710478430034734 step_physics_min 0.10710478430034734 survival_time_max 5.899999999999987 survival_time_mean 5.899999999999987 survival_time_min 5.899999999999987
No reset possible 66242
13730
YU CHEN BC Net V2 aido-LF-sim-validation
sim-0of4 success no gpu-production-spot-1-04
2021-04-09 14:36:47+00:00 2021-04-09 14:43:18+00:00 0:06:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 7.120576606286187 survival_time_median 25.05000000000022 deviation-center-line_median 1.286612871657754 in-drivable-lane_median 9.100000000000096
other stats agent_compute-ego0_max 0.059960011467040775 agent_compute-ego0_mean 0.059960011467040775 agent_compute-ego0_median 0.059960011467040775 agent_compute-ego0_min 0.059960011467040775 complete-iteration_max 0.2756151986787044 complete-iteration_mean 0.2756151986787044 complete-iteration_median 0.2756151986787044 complete-iteration_min 0.2756151986787044 deviation-center-line_max 1.286612871657754 deviation-center-line_mean 1.286612871657754 deviation-center-line_min 1.286612871657754 deviation-heading_max 3.993585369028216 deviation-heading_mean 3.993585369028216 deviation-heading_median 3.993585369028216 deviation-heading_min 3.993585369028216 driven_any_max 10.159166614020137 driven_any_mean 10.159166614020137 driven_any_median 10.159166614020137 driven_any_min 10.159166614020137 driven_lanedir_consec_max 7.120576606286187 driven_lanedir_consec_mean 7.120576606286187 driven_lanedir_consec_min 7.120576606286187 driven_lanedir_max 7.120576606286187 driven_lanedir_mean 7.120576606286187 driven_lanedir_median 7.120576606286187 driven_lanedir_min 7.120576606286187 get_duckie_state_max 1.706450108987877e-06 get_duckie_state_mean 1.706450108987877e-06 get_duckie_state_median 1.706450108987877e-06 get_duckie_state_min 1.706450108987877e-06 get_robot_state_max 0.004255644353737394 get_robot_state_mean 0.004255644353737394 get_robot_state_median 0.004255644353737394 get_robot_state_min 0.004255644353737394 get_state_dump_max 0.005528560672623228 get_state_dump_mean 0.005528560672623228 get_state_dump_median 0.005528560672623228 get_state_dump_min 0.005528560672623228 get_ui_image_max 0.03244505935456173 get_ui_image_mean 0.03244505935456173 get_ui_image_median 0.03244505935456173 get_ui_image_min 0.03244505935456173 in-drivable-lane_max 9.100000000000096 in-drivable-lane_mean 9.100000000000096 in-drivable-lane_min 9.100000000000096 per-episodes details {"LF-norm-loop-000-ego0": {"driven_any": 10.159166614020137, "get_ui_image": 0.03244505935456173, "step_physics": 0.15357432137447524, "survival_time": 25.05000000000022, "driven_lanedir": 7.120576606286187, "get_state_dump": 0.005528560672623228, "get_robot_state": 0.004255644353737394, "sim_render-ego0": 0.00443796807551289, "get_duckie_state": 1.706450108987877e-06, "in-drivable-lane": 9.100000000000096, "deviation-heading": 3.993585369028216, "agent_compute-ego0": 0.059960011467040775, "complete-iteration": 0.2756151986787044, "set_robot_commands": 0.002629565527714581, "deviation-center-line": 1.286612871657754, "driven_lanedir_consec": 7.120576606286187, "sim_compute_sim_state": 0.01031417865677184, "sim_compute_performance-ego0": 0.002367094218493458}}set_robot_commands_max 0.002629565527714581 set_robot_commands_mean 0.002629565527714581 set_robot_commands_median 0.002629565527714581 set_robot_commands_min 0.002629565527714581 sim_compute_performance-ego0_max 0.002367094218493458 sim_compute_performance-ego0_mean 0.002367094218493458 sim_compute_performance-ego0_median 0.002367094218493458 sim_compute_performance-ego0_min 0.002367094218493458 sim_compute_sim_state_max 0.01031417865677184 sim_compute_sim_state_mean 0.01031417865677184 sim_compute_sim_state_median 0.01031417865677184 sim_compute_sim_state_min 0.01031417865677184 sim_render-ego0_max 0.00443796807551289 sim_render-ego0_mean 0.00443796807551289 sim_render-ego0_median 0.00443796807551289 sim_render-ego0_min 0.00443796807551289 simulation-passed 1 step_physics_max 0.15357432137447524 step_physics_mean 0.15357432137447524 step_physics_median 0.15357432137447524 step_physics_min 0.15357432137447524 survival_time_max 25.05000000000022 survival_time_mean 25.05000000000022 survival_time_min 25.05000000000022
No reset possible 66213
13941
YU CHEN CBC Net v2 test - added mar 31 anomaly + mar 28 bc aido-LFP-sim-validation
sim-3of4 success no gpu-production-spot-1-04
2021-04-09 14:25:22+00:00 2021-04-09 14:36:20+00:00 0:10:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 50.69999999999926 in-drivable-lane_median 15.899999999999736 driven_lanedir_consec_median 13.89024342591542 deviation-center-line_median 2.668952560017124
other stats agent_compute-ego0_max 0.0935754914589116 agent_compute-ego0_mean 0.0935754914589116 agent_compute-ego0_median 0.0935754914589116 agent_compute-ego0_min 0.0935754914589116 complete-iteration_max 0.35694976111350973 complete-iteration_mean 0.35694976111350973 complete-iteration_median 0.35694976111350973 complete-iteration_min 0.35694976111350973 deviation-center-line_max 2.668952560017124 deviation-center-line_mean 2.668952560017124 deviation-center-line_min 2.668952560017124 deviation-heading_max 10.56613316814414 deviation-heading_mean 10.56613316814414 deviation-heading_median 10.56613316814414 deviation-heading_min 10.56613316814414 driven_any_max 21.86537032200918 driven_any_mean 21.86537032200918 driven_any_median 21.86537032200918 driven_any_min 21.86537032200918 driven_lanedir_consec_max 13.89024342591542 driven_lanedir_consec_mean 13.89024342591542 driven_lanedir_consec_min 13.89024342591542 driven_lanedir_max 13.89024342591542 driven_lanedir_mean 13.89024342591542 driven_lanedir_median 13.89024342591542 driven_lanedir_min 13.89024342591542 get_duckie_state_max 0.02249622885229552 get_duckie_state_mean 0.02249622885229552 get_duckie_state_median 0.02249622885229552 get_duckie_state_min 0.02249622885229552 get_robot_state_max 0.004129534049574377 get_robot_state_mean 0.004129534049574377 get_robot_state_median 0.004129534049574377 get_robot_state_min 0.004129534049574377 get_state_dump_max 0.008468750075166448 get_state_dump_mean 0.008468750075166448 get_state_dump_median 0.008468750075166448 get_state_dump_min 0.008468750075166448 get_ui_image_max 0.03910774104113649 get_ui_image_mean 0.03910774104113649 get_ui_image_median 0.03910774104113649 get_ui_image_min 0.03910774104113649 in-drivable-lane_max 15.899999999999736 in-drivable-lane_mean 15.899999999999736 in-drivable-lane_min 15.899999999999736 per-episodes details {"LFP-norm-techtrack-000-ego0": {"driven_any": 21.86537032200918, "get_ui_image": 0.03910774104113649, "step_physics": 0.1667177735878329, "survival_time": 50.69999999999926, "driven_lanedir": 13.89024342591542, "get_state_dump": 0.008468750075166448, "get_robot_state": 0.004129534049574377, "sim_render-ego0": 0.004179090114649881, "get_duckie_state": 0.02249622885229552, "in-drivable-lane": 15.899999999999736, "deviation-heading": 10.56613316814414, "agent_compute-ego0": 0.0935754914589116, "complete-iteration": 0.35694976111350973, "set_robot_commands": 0.002593920618442479, "deviation-center-line": 2.668952560017124, "driven_lanedir_consec": 13.89024342591542, "sim_compute_sim_state": 0.013320384941664822, "sim_compute_performance-ego0": 0.0022532618104530674}}set_robot_commands_max 0.002593920618442479 set_robot_commands_mean 0.002593920618442479 set_robot_commands_median 0.002593920618442479 set_robot_commands_min 0.002593920618442479 sim_compute_performance-ego0_max 0.0022532618104530674 sim_compute_performance-ego0_mean 0.0022532618104530674 sim_compute_performance-ego0_median 0.0022532618104530674 sim_compute_performance-ego0_min 0.0022532618104530674 sim_compute_sim_state_max 0.013320384941664822 sim_compute_sim_state_mean 0.013320384941664822 sim_compute_sim_state_median 0.013320384941664822 sim_compute_sim_state_min 0.013320384941664822 sim_render-ego0_max 0.004179090114649881 sim_render-ego0_mean 0.004179090114649881 sim_render-ego0_median 0.004179090114649881 sim_render-ego0_min 0.004179090114649881 simulation-passed 1 step_physics_max 0.1667177735878329 step_physics_mean 0.1667177735878329 step_physics_median 0.1667177735878329 step_physics_min 0.1667177735878329 survival_time_max 50.69999999999926 survival_time_mean 50.69999999999926 survival_time_min 50.69999999999926
No reset possible 66198
13946
YU CHEN CBC Net v2 test - added APR 1 2 times anomaly + mar 28 bc_v1 aido-LFP-sim-validation
sim-2of4 success no gpu-production-spot-1-04
2021-04-09 14:23:02+00:00 2021-04-09 14:25:15+00:00 0:02:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.699999999999984 in-drivable-lane_median 1.499999999999995 driven_lanedir_consec_median 1.8862341720374312 deviation-center-line_median 0.39928862486221983
other stats agent_compute-ego0_max 0.1028321901957194 agent_compute-ego0_mean 0.1028321901957194 agent_compute-ego0_median 0.1028321901957194 agent_compute-ego0_min 0.1028321901957194 complete-iteration_max 0.3547862812324806 complete-iteration_mean 0.3547862812324806 complete-iteration_median 0.3547862812324806 complete-iteration_min 0.3547862812324806 deviation-center-line_max 0.39928862486221983 deviation-center-line_mean 0.39928862486221983 deviation-center-line_min 0.39928862486221983 deviation-heading_max 1.5532450490877847 deviation-heading_mean 1.5532450490877847 deviation-heading_median 1.5532450490877847 deviation-heading_min 1.5532450490877847 driven_any_max 2.4130243568951792 driven_any_mean 2.4130243568951792 driven_any_median 2.4130243568951792 driven_any_min 2.4130243568951792 driven_lanedir_consec_max 1.8862341720374312 driven_lanedir_consec_mean 1.8862341720374312 driven_lanedir_consec_min 1.8862341720374312 driven_lanedir_max 1.8862341720374312 driven_lanedir_mean 1.8862341720374312 driven_lanedir_median 1.8862341720374312 driven_lanedir_min 1.8862341720374312 get_duckie_state_max 0.028122101889716256 get_duckie_state_mean 0.028122101889716256 get_duckie_state_median 0.028122101889716256 get_duckie_state_min 0.028122101889716256 get_robot_state_max 0.00431627697414822 get_robot_state_mean 0.00431627697414822 get_robot_state_median 0.00431627697414822 get_robot_state_min 0.00431627697414822 get_state_dump_max 0.00988278035764341 get_state_dump_mean 0.00988278035764341 get_state_dump_median 0.00988278035764341 get_state_dump_min 0.00988278035764341 get_ui_image_max 0.03588447570800781 get_ui_image_mean 0.03588447570800781 get_ui_image_median 0.03588447570800781 get_ui_image_min 0.03588447570800781 in-drivable-lane_max 1.499999999999995 in-drivable-lane_mean 1.499999999999995 in-drivable-lane_min 1.499999999999995 per-episodes details {"LFP-norm-loop-000-ego0": {"driven_any": 2.4130243568951792, "get_ui_image": 0.03588447570800781, "step_physics": 0.15576630345097295, "survival_time": 6.699999999999984, "driven_lanedir": 1.8862341720374312, "get_state_dump": 0.00988278035764341, "get_robot_state": 0.00431627697414822, "sim_render-ego0": 0.004269343835336191, "get_duckie_state": 0.028122101889716256, "in-drivable-lane": 1.499999999999995, "deviation-heading": 1.5532450490877847, "agent_compute-ego0": 0.1028321901957194, "complete-iteration": 0.3547862812324806, "set_robot_commands": 0.0025111463334825303, "deviation-center-line": 0.39928862486221983, "driven_lanedir_consec": 1.8862341720374312, "sim_compute_sim_state": 0.008821164237128363, "sim_compute_performance-ego0": 0.002266565958658854}}set_robot_commands_max 0.0025111463334825303 set_robot_commands_mean 0.0025111463334825303 set_robot_commands_median 0.0025111463334825303 set_robot_commands_min 0.0025111463334825303 sim_compute_performance-ego0_max 0.002266565958658854 sim_compute_performance-ego0_mean 0.002266565958658854 sim_compute_performance-ego0_median 0.002266565958658854 sim_compute_performance-ego0_min 0.002266565958658854 sim_compute_sim_state_max 0.008821164237128363 sim_compute_sim_state_mean 0.008821164237128363 sim_compute_sim_state_median 0.008821164237128363 sim_compute_sim_state_min 0.008821164237128363 sim_render-ego0_max 0.004269343835336191 sim_render-ego0_mean 0.004269343835336191 sim_render-ego0_median 0.004269343835336191 sim_render-ego0_min 0.004269343835336191 simulation-passed 1 step_physics_max 0.15576630345097295 step_physics_mean 0.15576630345097295 step_physics_median 0.15576630345097295 step_physics_min 0.15576630345097295 survival_time_max 6.699999999999984 survival_time_mean 6.699999999999984 survival_time_min 6.699999999999984
No reset possible 66184
13946
YU CHEN CBC Net v2 test - added APR 1 2 times anomaly + mar 28 bc_v1 aido-LFP-sim-validation
sim-2of4 success no gpu-production-spot-1-04
2021-04-09 14:20:25+00:00 2021-04-09 14:22:43+00:00 0:02:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.099999999999983 in-drivable-lane_median 1.949999999999993 driven_lanedir_consec_median 1.8696525165556752 deviation-center-line_median 0.4557592879456817
other stats agent_compute-ego0_max 0.10130477951956796 agent_compute-ego0_mean 0.10130477951956796 agent_compute-ego0_median 0.10130477951956796 agent_compute-ego0_min 0.10130477951956796 complete-iteration_max 0.35689012320725233 complete-iteration_mean 0.35689012320725233 complete-iteration_median 0.35689012320725233 complete-iteration_min 0.35689012320725233 deviation-center-line_max 0.4557592879456817 deviation-center-line_mean 0.4557592879456817 deviation-center-line_min 0.4557592879456817 deviation-heading_max 1.7646440345978984 deviation-heading_mean 1.7646440345978984 deviation-heading_median 1.7646440345978984 deviation-heading_min 1.7646440345978984 driven_any_max 2.458968362022328 driven_any_mean 2.458968362022328 driven_any_median 2.458968362022328 driven_any_min 2.458968362022328 driven_lanedir_consec_max 1.8696525165556752 driven_lanedir_consec_mean 1.8696525165556752 driven_lanedir_consec_min 1.8696525165556752 driven_lanedir_max 1.8696525165556752 driven_lanedir_mean 1.8696525165556752 driven_lanedir_median 1.8696525165556752 driven_lanedir_min 1.8696525165556752 get_duckie_state_max 0.027836484508914548 get_duckie_state_mean 0.027836484508914548 get_duckie_state_median 0.027836484508914548 get_duckie_state_min 0.027836484508914548 get_robot_state_max 0.0042828663245781315 get_robot_state_mean 0.0042828663245781315 get_robot_state_median 0.0042828663245781315 get_robot_state_min 0.0042828663245781315 get_state_dump_max 0.009925848954207414 get_state_dump_mean 0.009925848954207414 get_state_dump_median 0.009925848954207414 get_state_dump_min 0.009925848954207414 get_ui_image_max 0.0367564388088413 get_ui_image_mean 0.0367564388088413 get_ui_image_median 0.0367564388088413 get_ui_image_min 0.0367564388088413 in-drivable-lane_max 1.949999999999993 in-drivable-lane_mean 1.949999999999993 in-drivable-lane_min 1.949999999999993 per-episodes details {"LFP-norm-loop-000-ego0": {"driven_any": 2.458968362022328, "get_ui_image": 0.0367564388088413, "step_physics": 0.15897549615873324, "survival_time": 7.099999999999983, "driven_lanedir": 1.8696525165556752, "get_state_dump": 0.009925848954207414, "get_robot_state": 0.0042828663245781315, "sim_render-ego0": 0.004269229782211197, "get_duckie_state": 0.027836484508914548, "in-drivable-lane": 1.949999999999993, "deviation-heading": 1.7646440345978984, "agent_compute-ego0": 0.10130477951956796, "complete-iteration": 0.35689012320725233, "set_robot_commands": 0.0026552643809285197, "deviation-center-line": 0.4557592879456817, "driven_lanedir_consec": 1.8696525165556752, "sim_compute_sim_state": 0.008495934359677187, "sim_compute_performance-ego0": 0.0022654566731486287}}set_robot_commands_max 0.0026552643809285197 set_robot_commands_mean 0.0026552643809285197 set_robot_commands_median 0.0026552643809285197 set_robot_commands_min 0.0026552643809285197 sim_compute_performance-ego0_max 0.0022654566731486287 sim_compute_performance-ego0_mean 0.0022654566731486287 sim_compute_performance-ego0_median 0.0022654566731486287 sim_compute_performance-ego0_min 0.0022654566731486287 sim_compute_sim_state_max 0.008495934359677187 sim_compute_sim_state_mean 0.008495934359677187 sim_compute_sim_state_median 0.008495934359677187 sim_compute_sim_state_min 0.008495934359677187 sim_render-ego0_max 0.004269229782211197 sim_render-ego0_mean 0.004269229782211197 sim_render-ego0_median 0.004269229782211197 sim_render-ego0_min 0.004269229782211197 simulation-passed 1 step_physics_max 0.15897549615873324 step_physics_mean 0.15897549615873324 step_physics_median 0.15897549615873324 step_physics_min 0.15897549615873324 survival_time_max 7.099999999999983 survival_time_mean 7.099999999999983 survival_time_min 7.099999999999983
No reset possible 66173
13965
YU CHEN CBC Net v2 test - APR 3 BC TFdata + mar 28 anomaly aido-LFP-sim-validation
sim-1of4 success no gpu-production-spot-1-04
2021-04-09 14:18:24+00:00 2021-04-09 14:20:00+00:00 0:01:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.199999999999993 in-drivable-lane_median 2.349999999999992 driven_lanedir_consec_median 0.6081148449974982 deviation-center-line_median 0.10983243218258376
other stats agent_compute-ego0_max 0.09246211332433364 agent_compute-ego0_mean 0.09246211332433364 agent_compute-ego0_median 0.09246211332433364 agent_compute-ego0_min 0.09246211332433364 complete-iteration_max 0.24556212425231932 complete-iteration_mean 0.24556212425231932 complete-iteration_median 0.24556212425231932 complete-iteration_min 0.24556212425231932 deviation-center-line_max 0.10983243218258376 deviation-center-line_mean 0.10983243218258376 deviation-center-line_min 0.10983243218258376 deviation-heading_max 0.5047644389670692 deviation-heading_mean 0.5047644389670692 deviation-heading_median 0.5047644389670692 deviation-heading_min 0.5047644389670692 driven_any_max 1.264607973786022 driven_any_mean 1.264607973786022 driven_any_median 1.264607973786022 driven_any_min 1.264607973786022 driven_lanedir_consec_max 0.6081148449974982 driven_lanedir_consec_mean 0.6081148449974982 driven_lanedir_consec_min 0.6081148449974982 driven_lanedir_max 0.6081148449974982 driven_lanedir_mean 0.6081148449974982 driven_lanedir_median 0.6081148449974982 driven_lanedir_min 0.6081148449974982 get_duckie_state_max 0.004488246581133675 get_duckie_state_mean 0.004488246581133675 get_duckie_state_median 0.004488246581133675 get_duckie_state_min 0.004488246581133675 get_robot_state_max 0.003867017521577723 get_robot_state_mean 0.003867017521577723 get_robot_state_median 0.003867017521577723 get_robot_state_min 0.003867017521577723 get_state_dump_max 0.005675369150498334 get_state_dump_mean 0.005675369150498334 get_state_dump_median 0.005675369150498334 get_state_dump_min 0.005675369150498334 get_ui_image_max 0.02770824712865493 get_ui_image_mean 0.02770824712865493 get_ui_image_median 0.02770824712865493 get_ui_image_min 0.02770824712865493 in-drivable-lane_max 2.349999999999992 in-drivable-lane_mean 2.349999999999992 in-drivable-lane_min 2.349999999999992 per-episodes details {"LFP-norm-small_loop-000-ego0": {"driven_any": 1.264607973786022, "get_ui_image": 0.02770824712865493, "step_physics": 0.0958268502179314, "survival_time": 4.199999999999993, "driven_lanedir": 0.6081148449974982, "get_state_dump": 0.005675369150498334, "get_robot_state": 0.003867017521577723, "sim_render-ego0": 0.00413219788495232, "get_duckie_state": 0.004488246581133675, "in-drivable-lane": 2.349999999999992, "deviation-heading": 0.5047644389670692, "agent_compute-ego0": 0.09246211332433364, "complete-iteration": 0.24556212425231932, "set_robot_commands": 0.0024976618149701287, "deviation-center-line": 0.10983243218258376, "driven_lanedir_consec": 0.6081148449974982, "sim_compute_sim_state": 0.0066787158741670495, "sim_compute_performance-ego0": 0.002132244671092314}}set_robot_commands_max 0.0024976618149701287 set_robot_commands_mean 0.0024976618149701287 set_robot_commands_median 0.0024976618149701287 set_robot_commands_min 0.0024976618149701287 sim_compute_performance-ego0_max 0.002132244671092314 sim_compute_performance-ego0_mean 0.002132244671092314 sim_compute_performance-ego0_median 0.002132244671092314 sim_compute_performance-ego0_min 0.002132244671092314 sim_compute_sim_state_max 0.0066787158741670495 sim_compute_sim_state_mean 0.0066787158741670495 sim_compute_sim_state_median 0.0066787158741670495 sim_compute_sim_state_min 0.0066787158741670495 sim_render-ego0_max 0.00413219788495232 sim_render-ego0_mean 0.00413219788495232 sim_render-ego0_median 0.00413219788495232 sim_render-ego0_min 0.00413219788495232 simulation-passed 1 step_physics_max 0.0958268502179314 step_physics_mean 0.0958268502179314 step_physics_median 0.0958268502179314 step_physics_min 0.0958268502179314 survival_time_max 4.199999999999993 survival_time_mean 4.199999999999993 survival_time_min 4.199999999999993
No reset possible 66135
14034
YU CHEN CBC V2, mar28_apr6 bc, mar31_apr6 anomaly aido-LFP-sim-validation
sim-1of4 success no gpu-production-spot-1-04
2021-04-09 14:11:06+00:00 2021-04-09 14:18:05+00:00 0:06:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 37.350000000000016 in-drivable-lane_median 25.749999999999964 driven_lanedir_consec_median 3.1037634006005472 deviation-center-line_median 0.7891638144319489
other stats agent_compute-ego0_max 0.0938663269109267 agent_compute-ego0_mean 0.0938663269109267 agent_compute-ego0_median 0.0938663269109267 agent_compute-ego0_min 0.0938663269109267 complete-iteration_max 0.28633896839172446 complete-iteration_mean 0.28633896839172446 complete-iteration_median 0.28633896839172446 complete-iteration_min 0.28633896839172446 deviation-center-line_max 0.7891638144319489 deviation-center-line_mean 0.7891638144319489 deviation-center-line_min 0.7891638144319489 deviation-heading_max 4.5666617046959095 deviation-heading_mean 4.5666617046959095 deviation-heading_median 4.5666617046959095 deviation-heading_min 4.5666617046959095 driven_any_max 11.90278025745798 driven_any_mean 11.90278025745798 driven_any_median 11.90278025745798 driven_any_min 11.90278025745798 driven_lanedir_consec_max 3.1037634006005472 driven_lanedir_consec_mean 3.1037634006005472 driven_lanedir_consec_min 3.1037634006005472 driven_lanedir_max 3.1037634006005472 driven_lanedir_mean 3.1037634006005472 driven_lanedir_median 3.1037634006005472 driven_lanedir_min 3.1037634006005472 get_duckie_state_max 0.004651908249778544 get_duckie_state_mean 0.004651908249778544 get_duckie_state_median 0.004651908249778544 get_duckie_state_min 0.004651908249778544 get_robot_state_max 0.00406216650723136 get_robot_state_mean 0.00406216650723136 get_robot_state_median 0.00406216650723136 get_robot_state_min 0.00406216650723136 get_state_dump_max 0.005887386633113106 get_state_dump_mean 0.005887386633113106 get_state_dump_median 0.005887386633113106 get_state_dump_min 0.005887386633113106 get_ui_image_max 0.02937826083943168 get_ui_image_mean 0.02937826083943168 get_ui_image_median 0.02937826083943168 get_ui_image_min 0.02937826083943168 in-drivable-lane_max 25.749999999999964 in-drivable-lane_mean 25.749999999999964 in-drivable-lane_min 25.749999999999964 per-episodes details {"LFP-norm-small_loop-000-ego0": {"driven_any": 11.90278025745798, "get_ui_image": 0.02937826083943168, "step_physics": 0.1329651777757043, "survival_time": 37.350000000000016, "driven_lanedir": 3.1037634006005472, "get_state_dump": 0.005887386633113106, "get_robot_state": 0.00406216650723136, "sim_render-ego0": 0.004137909667377166, "get_duckie_state": 0.004651908249778544, "in-drivable-lane": 25.749999999999964, "deviation-heading": 4.5666617046959095, "agent_compute-ego0": 0.0938663269109267, "complete-iteration": 0.28633896839172446, "set_robot_commands": 0.002521845427426425, "deviation-center-line": 0.7891638144319489, "driven_lanedir_consec": 3.1037634006005472, "sim_compute_sim_state": 0.006562945358255968, "sim_compute_performance-ego0": 0.0021894035492351347}}set_robot_commands_max 0.002521845427426425 set_robot_commands_mean 0.002521845427426425 set_robot_commands_median 0.002521845427426425 set_robot_commands_min 0.002521845427426425 sim_compute_performance-ego0_max 0.0021894035492351347 sim_compute_performance-ego0_mean 0.0021894035492351347 sim_compute_performance-ego0_median 0.0021894035492351347 sim_compute_performance-ego0_min 0.0021894035492351347 sim_compute_sim_state_max 0.006562945358255968 sim_compute_sim_state_mean 0.006562945358255968 sim_compute_sim_state_median 0.006562945358255968 sim_compute_sim_state_min 0.006562945358255968 sim_render-ego0_max 0.004137909667377166 sim_render-ego0_mean 0.004137909667377166 sim_render-ego0_median 0.004137909667377166 sim_render-ego0_min 0.004137909667377166 simulation-passed 1 step_physics_max 0.1329651777757043 step_physics_mean 0.1329651777757043 step_physics_median 0.1329651777757043 step_physics_min 0.1329651777757043 survival_time_max 37.350000000000016 survival_time_mean 37.350000000000016 survival_time_min 37.350000000000016
No reset possible 66118
14036
YU CHEN CBC V2 non dropout comparsion, mar28_apr6 bc, mar31_apr6 anomaly aido-LFP-sim-validation
sim-0of4 success no gpu-production-spot-1-04
2021-04-09 14:06:22+00:00 2021-04-09 14:11:00+00:00 0:04:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 11.050000000000022 in-drivable-lane_median 5.100000000000011 driven_lanedir_consec_median 1.6497667901243769 deviation-center-line_median 0.4843491790202828
other stats agent_compute-ego0_max 0.09321114823624894 agent_compute-ego0_mean 0.09321114823624894 agent_compute-ego0_median 0.09321114823624894 agent_compute-ego0_min 0.09321114823624894 complete-iteration_max 0.35748790728079305 complete-iteration_mean 0.35748790728079305 complete-iteration_median 0.35748790728079305 complete-iteration_min 0.35748790728079305 deviation-center-line_max 0.4843491790202828 deviation-center-line_mean 0.4843491790202828 deviation-center-line_min 0.4843491790202828 deviation-heading_max 2.1944313888932965 deviation-heading_mean 2.1944313888932965 deviation-heading_median 2.1944313888932965 deviation-heading_min 2.1944313888932965 driven_any_max 3.4785507835860545 driven_any_mean 3.4785507835860545 driven_any_median 3.4785507835860545 driven_any_min 3.4785507835860545 driven_lanedir_consec_max 1.6497667901243769 driven_lanedir_consec_mean 1.6497667901243769 driven_lanedir_consec_min 1.6497667901243769 driven_lanedir_max 1.6497667901243769 driven_lanedir_mean 1.6497667901243769 driven_lanedir_median 1.6497667901243769 driven_lanedir_min 1.6497667901243769 get_duckie_state_max 0.02229360954181568 get_duckie_state_mean 0.02229360954181568 get_duckie_state_median 0.02229360954181568 get_duckie_state_min 0.02229360954181568 get_robot_state_max 0.004052378035880424 get_robot_state_mean 0.004052378035880424 get_robot_state_median 0.004052378035880424 get_robot_state_min 0.004052378035880424 get_state_dump_max 0.008377644392821166 get_state_dump_mean 0.008377644392821166 get_state_dump_median 0.008377644392821166 get_state_dump_min 0.008377644392821166 get_ui_image_max 0.041355109429574224 get_ui_image_mean 0.041355109429574224 get_ui_image_median 0.041355109429574224 get_ui_image_min 0.041355109429574224 in-drivable-lane_max 5.100000000000011 in-drivable-lane_mean 5.100000000000011 in-drivable-lane_min 5.100000000000011 per-episodes details {"LFP-norm-zigzag-000-ego0": {"driven_any": 3.4785507835860545, "get_ui_image": 0.041355109429574224, "step_physics": 0.16749057039484247, "survival_time": 11.050000000000022, "driven_lanedir": 1.6497667901243769, "get_state_dump": 0.008377644392821166, "get_robot_state": 0.004052378035880424, "sim_render-ego0": 0.004116603920051643, "get_duckie_state": 0.02229360954181568, "in-drivable-lane": 5.100000000000011, "deviation-heading": 2.1944313888932965, "agent_compute-ego0": 0.09321114823624894, "complete-iteration": 0.35748790728079305, "set_robot_commands": 0.0025433806685714036, "deviation-center-line": 0.4843491790202828, "driven_lanedir_consec": 1.6497667901243769, "sim_compute_sim_state": 0.011779617618870091, "sim_compute_performance-ego0": 0.0021725893020629883}}set_robot_commands_max 0.0025433806685714036 set_robot_commands_mean 0.0025433806685714036 set_robot_commands_median 0.0025433806685714036 set_robot_commands_min 0.0025433806685714036 sim_compute_performance-ego0_max 0.0021725893020629883 sim_compute_performance-ego0_mean 0.0021725893020629883 sim_compute_performance-ego0_median 0.0021725893020629883 sim_compute_performance-ego0_min 0.0021725893020629883 sim_compute_sim_state_max 0.011779617618870091 sim_compute_sim_state_mean 0.011779617618870091 sim_compute_sim_state_median 0.011779617618870091 sim_compute_sim_state_min 0.011779617618870091 sim_render-ego0_max 0.004116603920051643 sim_render-ego0_mean 0.004116603920051643 sim_render-ego0_median 0.004116603920051643 sim_render-ego0_min 0.004116603920051643 simulation-passed 1 step_physics_max 0.16749057039484247 step_physics_mean 0.16749057039484247 step_physics_median 0.16749057039484247 step_physics_min 0.16749057039484247 survival_time_max 11.050000000000022 survival_time_mean 11.050000000000022 survival_time_min 11.050000000000022
No reset possible 66081
13534
AndrΓ‘s Kalapos Β ππΊ3090 aido-LF-sim-testing
sim-0of4 success no gpu-production-spot-1-04
2021-04-09 13:56:31+00:00 2021-04-09 14:05:41+00:00 0:09:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 28.314937776752767 survival_time_median 59.99999999999873 deviation-center-line_median 2.245195352266652 in-drivable-lane_median 0.0
other stats agent_compute-ego0_max 0.01402167674405291 agent_compute-ego0_mean 0.01402167674405291 agent_compute-ego0_median 0.01402167674405291 agent_compute-ego0_min 0.01402167674405291 complete-iteration_max 0.2228502955265982 complete-iteration_mean 0.2228502955265982 complete-iteration_median 0.2228502955265982 complete-iteration_min 0.2228502955265982 deviation-center-line_max 2.245195352266652 deviation-center-line_mean 2.245195352266652 deviation-center-line_min 2.245195352266652 deviation-heading_max 9.892809404746949 deviation-heading_mean 9.892809404746949 deviation-heading_median 9.892809404746949 deviation-heading_min 9.892809404746949 driven_any_max 28.863090914615835 driven_any_mean 28.863090914615835 driven_any_median 28.863090914615835 driven_any_min 28.863090914615835 driven_lanedir_consec_max 28.314937776752767 driven_lanedir_consec_mean 28.314937776752767 driven_lanedir_consec_min 28.314937776752767 driven_lanedir_max 28.314937776752767 driven_lanedir_mean 28.314937776752767 driven_lanedir_median 28.314937776752767 driven_lanedir_min 28.314937776752767 get_duckie_state_max 1.3185480452894073e-06 get_duckie_state_mean 1.3185480452894073e-06 get_duckie_state_median 1.3185480452894073e-06 get_duckie_state_min 1.3185480452894073e-06 get_robot_state_max 0.004022566900960016 get_robot_state_mean 0.004022566900960016 get_robot_state_median 0.004022566900960016 get_robot_state_min 0.004022566900960016 get_state_dump_max 0.004819586116209515 get_state_dump_mean 0.004819586116209515 get_state_dump_median 0.004819586116209515 get_state_dump_min 0.004819586116209515 get_ui_image_max 0.03065317219044148 get_ui_image_mean 0.03065317219044148 get_ui_image_median 0.03065317219044148 get_ui_image_min 0.03065317219044148 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LF-norm-loop-000-ego0": {"driven_any": 28.863090914615835, "get_ui_image": 0.03065317219044148, "step_physics": 0.15095675974265424, "survival_time": 59.99999999999873, "driven_lanedir": 28.314937776752767, "get_state_dump": 0.004819586116209515, "get_robot_state": 0.004022566900960016, "sim_render-ego0": 0.004012223981401506, "get_duckie_state": 1.3185480452894073e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.892809404746949, "agent_compute-ego0": 0.01402167674405291, "complete-iteration": 0.2228502955265982, "set_robot_commands": 0.0024485071930261974, "deviation-center-line": 2.245195352266652, "driven_lanedir_consec": 28.314937776752767, "sim_compute_sim_state": 0.009679562046962614, "sim_compute_performance-ego0": 0.002153143299112312}}set_robot_commands_max 0.0024485071930261974 set_robot_commands_mean 0.0024485071930261974 set_robot_commands_median 0.0024485071930261974 set_robot_commands_min 0.0024485071930261974 sim_compute_performance-ego0_max 0.002153143299112312 sim_compute_performance-ego0_mean 0.002153143299112312 sim_compute_performance-ego0_median 0.002153143299112312 sim_compute_performance-ego0_min 0.002153143299112312 sim_compute_sim_state_max 0.009679562046962614 sim_compute_sim_state_mean 0.009679562046962614 sim_compute_sim_state_median 0.009679562046962614 sim_compute_sim_state_min 0.009679562046962614 sim_render-ego0_max 0.004012223981401506 sim_render-ego0_mean 0.004012223981401506 sim_render-ego0_median 0.004012223981401506 sim_render-ego0_min 0.004012223981401506 simulation-passed 1 step_physics_max 0.15095675974265424 step_physics_mean 0.15095675974265424 step_physics_median 0.15095675974265424 step_physics_min 0.15095675974265424 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 66074
13541
AndrΓ‘s Kalapos Β ππΊ3090 aido-LFP-sim-validation
sim-3of4 success no gpu-production-spot-1-04
2021-04-09 13:54:26+00:00 2021-04-09 13:56:17+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.699999999999991 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.7640229437141628 deviation-center-line_median 0.203328002626892
other stats agent_compute-ego0_max 0.0170104654211747 agent_compute-ego0_mean 0.0170104654211747 agent_compute-ego0_median 0.0170104654211747 agent_compute-ego0_min 0.0170104654211747 complete-iteration_max 0.3014408738989579 complete-iteration_mean 0.3014408738989579 complete-iteration_median 0.3014408738989579 complete-iteration_min 0.3014408738989579 deviation-center-line_max 0.203328002626892 deviation-center-line_mean 0.203328002626892 deviation-center-line_min 0.203328002626892 deviation-heading_max 0.6380894623613551 deviation-heading_mean 0.6380894623613551 deviation-heading_median 0.6380894623613551 deviation-heading_min 0.6380894623613551 driven_any_max 1.78804614674032 driven_any_mean 1.78804614674032 driven_any_median 1.78804614674032 driven_any_min 1.78804614674032 driven_lanedir_consec_max 1.7640229437141628 driven_lanedir_consec_mean 1.7640229437141628 driven_lanedir_consec_min 1.7640229437141628 driven_lanedir_max 1.7640229437141628 driven_lanedir_mean 1.7640229437141628 driven_lanedir_median 1.7640229437141628 driven_lanedir_min 1.7640229437141628 get_duckie_state_max 0.023298449265329466 get_duckie_state_mean 0.023298449265329466 get_duckie_state_median 0.023298449265329466 get_duckie_state_min 0.023298449265329466 get_robot_state_max 0.004278140319021124 get_robot_state_mean 0.004278140319021124 get_robot_state_median 0.004278140319021124 get_robot_state_min 0.004278140319021124 get_state_dump_max 0.008842781970375463 get_state_dump_mean 0.008842781970375463 get_state_dump_median 0.008842781970375463 get_state_dump_min 0.008842781970375463 get_ui_image_max 0.03877398842259457 get_ui_image_mean 0.03877398842259457 get_ui_image_median 0.03877398842259457 get_ui_image_min 0.03877398842259457 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LFP-norm-techtrack-000-ego0": {"driven_any": 1.78804614674032, "get_ui_image": 0.03877398842259457, "step_physics": 0.1860937846334357, "survival_time": 4.699999999999991, "driven_lanedir": 1.7640229437141628, "get_state_dump": 0.008842781970375463, "get_robot_state": 0.004278140319021124, "sim_render-ego0": 0.004292724007054379, "get_duckie_state": 0.023298449265329466, "in-drivable-lane": 0.0, "deviation-heading": 0.6380894623613551, "agent_compute-ego0": 0.0170104654211747, "complete-iteration": 0.3014408738989579, "set_robot_commands": 0.0025956404836554275, "deviation-center-line": 0.203328002626892, "driven_lanedir_consec": 1.7640229437141628, "sim_compute_sim_state": 0.013826297458849456, "sim_compute_performance-ego0": 0.002306007084093596}}set_robot_commands_max 0.0025956404836554275 set_robot_commands_mean 0.0025956404836554275 set_robot_commands_median 0.0025956404836554275 set_robot_commands_min 0.0025956404836554275 sim_compute_performance-ego0_max 0.002306007084093596 sim_compute_performance-ego0_mean 0.002306007084093596 sim_compute_performance-ego0_median 0.002306007084093596 sim_compute_performance-ego0_min 0.002306007084093596 sim_compute_sim_state_max 0.013826297458849456 sim_compute_sim_state_mean 0.013826297458849456 sim_compute_sim_state_median 0.013826297458849456 sim_compute_sim_state_min 0.013826297458849456 sim_render-ego0_max 0.004292724007054379 sim_render-ego0_mean 0.004292724007054379 sim_render-ego0_median 0.004292724007054379 sim_render-ego0_min 0.004292724007054379 simulation-passed 1 step_physics_max 0.1860937846334357 step_physics_mean 0.1860937846334357 step_physics_median 0.1860937846334357 step_physics_min 0.1860937846334357 survival_time_max 4.699999999999991 survival_time_mean 4.699999999999991 survival_time_min 4.699999999999991
No reset possible 66050
13572
MΓ‘rton Tim Β ππΊ3626 aido-LFV-sim-validation
sim-2of4 success no gpu-production-spot-1-04
2021-04-09 13:48:43+00:00 2021-04-09 13:53:46+00:00 0:05:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.650000000000016 in-drivable-lane_median 0.0 driven_lanedir_consec_median 4.661639228589754 deviation-center-line_median 0.5570329612797645
other stats agent_compute-ego0_max 0.04652581927932312 agent_compute-ego0_mean 0.04652581927932312 agent_compute-ego0_median 0.04652581927932312 agent_compute-ego0_min 0.04652581927932312 agent_compute-npc0_max 0.0322083769557632 agent_compute-npc0_mean 0.0322083769557632 agent_compute-npc0_median 0.0322083769557632 agent_compute-npc0_min 0.0322083769557632 agent_compute-npc1_max 0.033014316425145226 agent_compute-npc1_mean 0.033014316425145226 agent_compute-npc1_median 0.033014316425145226 agent_compute-npc1_min 0.033014316425145226 agent_compute-npc2_max 0.035932990992180655 agent_compute-npc2_mean 0.035932990992180655 agent_compute-npc2_median 0.035932990992180655 agent_compute-npc2_min 0.035932990992180655 complete-iteration_max 0.6166192883643035 complete-iteration_mean 0.6166192883643035 complete-iteration_median 0.6166192883643035 complete-iteration_min 0.6166192883643035 deviation-center-line_max 0.5570329612797645 deviation-center-line_mean 0.5570329612797645 deviation-center-line_min 0.5570329612797645 deviation-heading_max 1.5781055796160883 deviation-heading_mean 1.5781055796160883 deviation-heading_median 1.5781055796160883 deviation-heading_min 1.5781055796160883 driven_any_max 4.746614272990423 driven_any_mean 4.746614272990423 driven_any_median 4.746614272990423 driven_any_min 4.746614272990423 driven_lanedir_consec_max 4.661639228589754 driven_lanedir_consec_mean 4.661639228589754 driven_lanedir_consec_min 4.661639228589754 driven_lanedir_max 4.661639228589754 driven_lanedir_mean 4.661639228589754 driven_lanedir_median 4.661639228589754 driven_lanedir_min 4.661639228589754 get_duckie_state_max 1.5341232870226708e-06 get_duckie_state_mean 1.5341232870226708e-06 get_duckie_state_median 1.5341232870226708e-06 get_duckie_state_min 1.5341232870226708e-06 get_robot_state_max 0.015353779926478303 get_robot_state_mean 0.015353779926478303 get_robot_state_median 0.015353779926478303 get_robot_state_min 0.015353779926478303 get_state_dump_max 0.010360889345686013 get_state_dump_mean 0.010360889345686013 get_state_dump_median 0.010360889345686013 get_state_dump_min 0.010360889345686013 get_ui_image_max 0.04772936295126086 get_ui_image_mean 0.04772936295126086 get_ui_image_median 0.04772936295126086 get_ui_image_min 0.04772936295126086 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LFV-norm-loop-000-ego0": {"driven_any": 4.746614272990423, "get_ui_image": 0.04772936295126086, "step_physics": 0.333233290743605, "survival_time": 10.650000000000016, "driven_lanedir": 4.661639228589754, "get_state_dump": 0.010360889345686013, "get_robot_state": 0.015353779926478303, "sim_render-ego0": 0.004041108015541719, "sim_render-npc0": 0.003966078579982864, "sim_render-npc1": 0.004039101511518532, "sim_render-npc2": 0.004234918924135582, "get_duckie_state": 1.5341232870226708e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.5781055796160883, "agent_compute-ego0": 0.04652581927932312, "agent_compute-npc0": 0.0322083769557632, "agent_compute-npc1": 0.033014316425145226, "agent_compute-npc2": 0.035932990992180655, "complete-iteration": 0.6166192883643035, "set_robot_commands": 0.002584119823491462, "deviation-center-line": 0.5570329612797645, "driven_lanedir_consec": 4.661639228589754, "sim_compute_sim_state": 0.027210684580223583, "sim_compute_performance-ego0": 0.00220979374145793, "sim_compute_performance-npc0": 0.002086150311978064, "sim_compute_performance-npc1": 0.002167766339310976, "sim_compute_performance-npc2": 0.00224298071638446}}set_robot_commands_max 0.002584119823491462 set_robot_commands_mean 0.002584119823491462 set_robot_commands_median 0.002584119823491462 set_robot_commands_min 0.002584119823491462 sim_compute_performance-ego0_max 0.00220979374145793 sim_compute_performance-ego0_mean 0.00220979374145793 sim_compute_performance-ego0_median 0.00220979374145793 sim_compute_performance-ego0_min 0.00220979374145793 sim_compute_performance-npc0_max 0.002086150311978064 sim_compute_performance-npc0_mean 0.002086150311978064 sim_compute_performance-npc0_median 0.002086150311978064 sim_compute_performance-npc0_min 0.002086150311978064 sim_compute_performance-npc1_max 0.002167766339310976 sim_compute_performance-npc1_mean 0.002167766339310976 sim_compute_performance-npc1_median 0.002167766339310976 sim_compute_performance-npc1_min 0.002167766339310976 sim_compute_performance-npc2_max 0.00224298071638446 sim_compute_performance-npc2_mean 0.00224298071638446 sim_compute_performance-npc2_median 0.00224298071638446 sim_compute_performance-npc2_min 0.00224298071638446 sim_compute_sim_state_max 0.027210684580223583 sim_compute_sim_state_mean 0.027210684580223583 sim_compute_sim_state_median 0.027210684580223583 sim_compute_sim_state_min 0.027210684580223583 sim_render-ego0_max 0.004041108015541719 sim_render-ego0_mean 0.004041108015541719 sim_render-ego0_median 0.004041108015541719 sim_render-ego0_min 0.004041108015541719 sim_render-npc0_max 0.003966078579982864 sim_render-npc0_mean 0.003966078579982864 sim_render-npc0_median 0.003966078579982864 sim_render-npc0_min 0.003966078579982864 sim_render-npc1_max 0.004039101511518532 sim_render-npc1_mean 0.004039101511518532 sim_render-npc1_median 0.004039101511518532 sim_render-npc1_min 0.004039101511518532 sim_render-npc2_max 0.004234918924135582 sim_render-npc2_mean 0.004234918924135582 sim_render-npc2_median 0.004234918924135582 sim_render-npc2_min 0.004234918924135582 simulation-passed 1 step_physics_max 0.333233290743605 step_physics_mean 0.333233290743605 step_physics_median 0.333233290743605 step_physics_min 0.333233290743605 survival_time_max 10.650000000000016 survival_time_mean 10.650000000000016 survival_time_min 10.650000000000016
No reset possible 66045
13585
Andras Beres 202-1 aido-LFP-sim-testing
sim-2of4 success no gpu-production-spot-1-04
2021-04-09 13:47:02+00:00 2021-04-09 13:48:09+00:00 0:01:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 1.7500000000000009 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.38761234606265793 deviation-center-line_median 0.11194673860424872
other stats agent_compute-ego0_max 0.019097096390194364 agent_compute-ego0_mean 0.019097096390194364 agent_compute-ego0_median 0.019097096390194364 agent_compute-ego0_min 0.019097096390194364 complete-iteration_max 0.20244498385323417 complete-iteration_mean 0.20244498385323417 complete-iteration_median 0.20244498385323417 complete-iteration_min 0.20244498385323417 deviation-center-line_max 0.11194673860424872 deviation-center-line_mean 0.11194673860424872 deviation-center-line_min 0.11194673860424872 deviation-heading_max 0.18593020382390824 deviation-heading_mean 0.18593020382390824 deviation-heading_median 0.18593020382390824 deviation-heading_min 0.18593020382390824 driven_any_max 0.39175923747263214 driven_any_mean 0.39175923747263214 driven_any_median 0.39175923747263214 driven_any_min 0.39175923747263214 driven_lanedir_consec_max 0.38761234606265793 driven_lanedir_consec_mean 0.38761234606265793 driven_lanedir_consec_min 0.38761234606265793 driven_lanedir_max 0.38761234606265793 driven_lanedir_mean 0.38761234606265793 driven_lanedir_median 0.38761234606265793 driven_lanedir_min 0.38761234606265793 get_duckie_state_max 0.026599360836876765 get_duckie_state_mean 0.026599360836876765 get_duckie_state_median 0.026599360836876765 get_duckie_state_min 0.026599360836876765 get_robot_state_max 0.00400490230984158 get_robot_state_mean 0.00400490230984158 get_robot_state_median 0.00400490230984158 get_robot_state_min 0.00400490230984158 get_state_dump_max 0.009252402517530654 get_state_dump_mean 0.009252402517530654 get_state_dump_median 0.009252402517530654 get_state_dump_min 0.009252402517530654 get_ui_image_max 0.03545077641805013 get_ui_image_mean 0.03545077641805013 get_ui_image_median 0.03545077641805013 get_ui_image_min 0.03545077641805013 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LFP-norm-loop-000-ego0": {"driven_any": 0.39175923747263214, "get_ui_image": 0.03545077641805013, "step_physics": 0.09339235888587104, "survival_time": 1.7500000000000009, "driven_lanedir": 0.38761234606265793, "get_state_dump": 0.009252402517530654, "get_robot_state": 0.00400490230984158, "sim_render-ego0": 0.003911018371582031, "get_duckie_state": 0.026599360836876765, "in-drivable-lane": 0.0, "deviation-heading": 0.18593020382390824, "agent_compute-ego0": 0.019097096390194364, "complete-iteration": 0.20244498385323417, "set_robot_commands": 0.002651830514272054, "deviation-center-line": 0.11194673860424872, "driven_lanedir_consec": 0.38761234606265793, "sim_compute_sim_state": 0.005893839730156792, "sim_compute_performance-ego0": 0.002096460925208198}}set_robot_commands_max 0.002651830514272054 set_robot_commands_mean 0.002651830514272054 set_robot_commands_median 0.002651830514272054 set_robot_commands_min 0.002651830514272054 sim_compute_performance-ego0_max 0.002096460925208198 sim_compute_performance-ego0_mean 0.002096460925208198 sim_compute_performance-ego0_median 0.002096460925208198 sim_compute_performance-ego0_min 0.002096460925208198 sim_compute_sim_state_max 0.005893839730156792 sim_compute_sim_state_mean 0.005893839730156792 sim_compute_sim_state_median 0.005893839730156792 sim_compute_sim_state_min 0.005893839730156792 sim_render-ego0_max 0.003911018371582031 sim_render-ego0_mean 0.003911018371582031 sim_render-ego0_median 0.003911018371582031 sim_render-ego0_min 0.003911018371582031 simulation-passed 1 step_physics_max 0.09339235888587104 step_physics_mean 0.09339235888587104 step_physics_median 0.09339235888587104 step_physics_min 0.09339235888587104 survival_time_max 1.7500000000000009 survival_time_mean 1.7500000000000009 survival_time_min 1.7500000000000009
No reset possible 66023
13964
YU CHEN CBC Net v2 test - APR 3 BC TFdata + mar 28 anomaly aido-LF-sim-validation
sim-2of4 success no gpu-production-spot-1-04
2021-04-09 13:36:05+00:00 2021-04-09 13:46:21+00:00 0:10:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 10.394022334427074 survival_time_median 59.99999999999873 deviation-center-line_median 2.450827567432979 in-drivable-lane_median 30.9499999999993
other stats agent_compute-ego0_max 0.08860421458648504 agent_compute-ego0_mean 0.08860421458648504 agent_compute-ego0_median 0.08860421458648504 agent_compute-ego0_min 0.08860421458648504 complete-iteration_max 0.2717293513803855 complete-iteration_mean 0.2717293513803855 complete-iteration_median 0.2717293513803855 complete-iteration_min 0.2717293513803855 deviation-center-line_max 2.450827567432979 deviation-center-line_mean 2.450827567432979 deviation-center-line_min 2.450827567432979 deviation-heading_max 11.62698861557886 deviation-heading_mean 11.62698861557886 deviation-heading_median 11.62698861557886 deviation-heading_min 11.62698861557886 driven_any_max 20.79788085223899 driven_any_mean 20.79788085223899 driven_any_median 20.79788085223899 driven_any_min 20.79788085223899 driven_lanedir_consec_max 10.394022334427074 driven_lanedir_consec_mean 10.394022334427074 driven_lanedir_consec_min 10.394022334427074 driven_lanedir_max 10.394022334427074 driven_lanedir_mean 10.394022334427074 driven_lanedir_median 10.394022334427074 driven_lanedir_min 10.394022334427074 get_duckie_state_max 1.627638576231233e-06 get_duckie_state_mean 1.627638576231233e-06 get_duckie_state_median 1.627638576231233e-06 get_duckie_state_min 1.627638576231233e-06 get_robot_state_max 0.003937690680866733 get_robot_state_mean 0.003937690680866733 get_robot_state_median 0.003937690680866733 get_robot_state_min 0.003937690680866733 get_state_dump_max 0.004784775614043656 get_state_dump_mean 0.004784775614043656 get_state_dump_median 0.004784775614043656 get_state_dump_min 0.004784775614043656 get_ui_image_max 0.028403812602199582 get_ui_image_mean 0.028403812602199582 get_ui_image_median 0.028403812602199582 get_ui_image_min 0.028403812602199582 in-drivable-lane_max 30.9499999999993 in-drivable-lane_mean 30.9499999999993 in-drivable-lane_min 30.9499999999993 per-episodes details {"LF-norm-small_loop-000-ego0": {"driven_any": 20.79788085223899, "get_ui_image": 0.028403812602199582, "step_physics": 0.1306902983107237, "survival_time": 59.99999999999873, "driven_lanedir": 10.394022334427074, "get_state_dump": 0.004784775614043656, "get_robot_state": 0.003937690680866733, "sim_render-ego0": 0.004002212187729707, "get_duckie_state": 1.627638576231233e-06, "in-drivable-lane": 30.9499999999993, "deviation-heading": 11.62698861557886, "agent_compute-ego0": 0.08860421458648504, "complete-iteration": 0.2717293513803855, "set_robot_commands": 0.002489816735527299, "deviation-center-line": 2.450827567432979, "driven_lanedir_consec": 10.394022334427074, "sim_compute_sim_state": 0.006621273232935668, "sim_compute_performance-ego0": 0.0021035502494920004}}set_robot_commands_max 0.002489816735527299 set_robot_commands_mean 0.002489816735527299 set_robot_commands_median 0.002489816735527299 set_robot_commands_min 0.002489816735527299 sim_compute_performance-ego0_max 0.0021035502494920004 sim_compute_performance-ego0_mean 0.0021035502494920004 sim_compute_performance-ego0_median 0.0021035502494920004 sim_compute_performance-ego0_min 0.0021035502494920004 sim_compute_sim_state_max 0.006621273232935668 sim_compute_sim_state_mean 0.006621273232935668 sim_compute_sim_state_median 0.006621273232935668 sim_compute_sim_state_min 0.006621273232935668 sim_render-ego0_max 0.004002212187729707 sim_render-ego0_mean 0.004002212187729707 sim_render-ego0_median 0.004002212187729707 sim_render-ego0_min 0.004002212187729707 simulation-passed 1 step_physics_max 0.1306902983107237 step_physics_mean 0.1306902983107237 step_physics_median 0.1306902983107237 step_physics_min 0.1306902983107237 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 66013
13993
Frank (Chude) Qian Β π¨π¦CBC Net - MixTraining - Expert LF Human LFP - Best Loss aido-LF-sim-validation
sim-0of4 success no gpu-production-spot-1-04
2021-04-09 13:33:35+00:00 2021-04-09 13:35:40+00:00 0:02:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.0873051403258875 survival_time_median 7.94999999999998 deviation-center-line_median 0.4145867246699389 in-drivable-lane_median 3.2499999999999885
other stats agent_compute-ego0_max 0.057697844505310056 agent_compute-ego0_mean 0.057697844505310056 agent_compute-ego0_median 0.057697844505310056 agent_compute-ego0_min 0.057697844505310056 complete-iteration_max 0.23507903516292572 complete-iteration_mean 0.23507903516292572 complete-iteration_median 0.23507903516292572 complete-iteration_min 0.23507903516292572 deviation-center-line_max 0.4145867246699389 deviation-center-line_mean 0.4145867246699389 deviation-center-line_min 0.4145867246699389 deviation-heading_max 1.1107262290410511 deviation-heading_mean 1.1107262290410511 deviation-heading_median 1.1107262290410511 deviation-heading_min 1.1107262290410511 driven_any_max 3.2322050632189123 driven_any_mean 3.2322050632189123 driven_any_median 3.2322050632189123 driven_any_min 3.2322050632189123 driven_lanedir_consec_max 2.0873051403258875 driven_lanedir_consec_mean 2.0873051403258875 driven_lanedir_consec_min 2.0873051403258875 driven_lanedir_max 2.0873051403258875 driven_lanedir_mean 2.0873051403258875 driven_lanedir_median 2.0873051403258875 driven_lanedir_min 2.0873051403258875 get_duckie_state_max 1.4573335647583007e-06 get_duckie_state_mean 1.4573335647583007e-06 get_duckie_state_median 1.4573335647583007e-06 get_duckie_state_min 1.4573335647583007e-06 get_robot_state_max 0.004055635631084442 get_robot_state_mean 0.004055635631084442 get_robot_state_median 0.004055635631084442 get_robot_state_min 0.004055635631084442 get_state_dump_max 0.005145137012004852 get_state_dump_mean 0.005145137012004852 get_state_dump_median 0.005145137012004852 get_state_dump_min 0.005145137012004852 get_ui_image_max 0.03075980842113495 get_ui_image_mean 0.03075980842113495 get_ui_image_median 0.03075980842113495 get_ui_image_min 0.03075980842113495 in-drivable-lane_max 3.2499999999999885 in-drivable-lane_mean 3.2499999999999885 in-drivable-lane_min 3.2499999999999885 per-episodes details {"LF-norm-loop-000-ego0": {"driven_any": 3.2322050632189123, "get_ui_image": 0.03075980842113495, "step_physics": 0.11812923997640608, "survival_time": 7.94999999999998, "driven_lanedir": 2.0873051403258875, "get_state_dump": 0.005145137012004852, "get_robot_state": 0.004055635631084442, "sim_render-ego0": 0.004105047881603241, "get_duckie_state": 1.4573335647583007e-06, "in-drivable-lane": 3.2499999999999885, "deviation-heading": 1.1107262290410511, "agent_compute-ego0": 0.057697844505310056, "complete-iteration": 0.23507903516292572, "set_robot_commands": 0.002662353217601776, "deviation-center-line": 0.4145867246699389, "driven_lanedir_consec": 2.0873051403258875, "sim_compute_sim_state": 0.01024792492389679, "sim_compute_performance-ego0": 0.0021768271923065185}}set_robot_commands_max 0.002662353217601776 set_robot_commands_mean 0.002662353217601776 set_robot_commands_median 0.002662353217601776 set_robot_commands_min 0.002662353217601776 sim_compute_performance-ego0_max 0.0021768271923065185 sim_compute_performance-ego0_mean 0.0021768271923065185 sim_compute_performance-ego0_median 0.0021768271923065185 sim_compute_performance-ego0_min 0.0021768271923065185 sim_compute_sim_state_max 0.01024792492389679 sim_compute_sim_state_mean 0.01024792492389679 sim_compute_sim_state_median 0.01024792492389679 sim_compute_sim_state_min 0.01024792492389679 sim_render-ego0_max 0.004105047881603241 sim_render-ego0_mean 0.004105047881603241 sim_render-ego0_median 0.004105047881603241 sim_render-ego0_min 0.004105047881603241 simulation-passed 1 step_physics_max 0.11812923997640608 step_physics_mean 0.11812923997640608 step_physics_median 0.11812923997640608 step_physics_min 0.11812923997640608 survival_time_max 7.94999999999998 survival_time_mean 7.94999999999998 survival_time_min 7.94999999999998
No reset possible 65996
13993
Frank (Chude) Qian Β π¨π¦CBC Net - MixTraining - Expert LF Human LFP - Best Loss aido-LF-sim-validation
sim-0of4 success no gpu-production-spot-1-04
2021-04-09 13:30:13+00:00 2021-04-09 13:33:02+00:00 0:02:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 3.1229329761960023 survival_time_median 9.349999999999998 deviation-center-line_median 0.6360969642861032 in-drivable-lane_median 2.1500000000000155
other stats agent_compute-ego0_max 0.058215400005908725 agent_compute-ego0_mean 0.058215400005908725 agent_compute-ego0_median 0.058215400005908725 agent_compute-ego0_min 0.058215400005908725 complete-iteration_max 0.26646998080801454 complete-iteration_mean 0.26646998080801454 complete-iteration_median 0.26646998080801454 complete-iteration_min 0.26646998080801454 deviation-center-line_max 0.6360969642861032 deviation-center-line_mean 0.6360969642861032 deviation-center-line_min 0.6360969642861032 deviation-heading_max 1.8450754066754844 deviation-heading_mean 1.8450754066754844 deviation-heading_median 1.8450754066754844 deviation-heading_min 1.8450754066754844 driven_any_max 3.890775897902667 driven_any_mean 3.890775897902667 driven_any_median 3.890775897902667 driven_any_min 3.890775897902667 driven_lanedir_consec_max 3.1229329761960023 driven_lanedir_consec_mean 3.1229329761960023 driven_lanedir_consec_min 3.1229329761960023 driven_lanedir_max 3.1229329761960023 driven_lanedir_mean 3.1229329761960023 driven_lanedir_median 3.1229329761960023 driven_lanedir_min 3.1229329761960023 get_duckie_state_max 1.4508024175116356e-06 get_duckie_state_mean 1.4508024175116356e-06 get_duckie_state_median 1.4508024175116356e-06 get_duckie_state_min 1.4508024175116356e-06 get_robot_state_max 0.0042494712991917385 get_robot_state_mean 0.0042494712991917385 get_robot_state_median 0.0042494712991917385 get_robot_state_min 0.0042494712991917385 get_state_dump_max 0.005320666952336088 get_state_dump_mean 0.005320666952336088 get_state_dump_median 0.005320666952336088 get_state_dump_min 0.005320666952336088 get_ui_image_max 0.03266783090347939 get_ui_image_mean 0.03266783090347939 get_ui_image_median 0.03266783090347939 get_ui_image_min 0.03266783090347939 in-drivable-lane_max 2.1500000000000155 in-drivable-lane_mean 2.1500000000000155 in-drivable-lane_min 2.1500000000000155 per-episodes details {"LF-norm-loop-000-ego0": {"driven_any": 3.890775897902667, "get_ui_image": 0.03266783090347939, "step_physics": 0.14542929035552005, "survival_time": 9.349999999999998, "driven_lanedir": 3.1229329761960023, "get_state_dump": 0.005320666952336088, "get_robot_state": 0.0042494712991917385, "sim_render-ego0": 0.00429468332452977, "get_duckie_state": 1.4508024175116356e-06, "in-drivable-lane": 2.1500000000000155, "deviation-heading": 1.8450754066754844, "agent_compute-ego0": 0.058215400005908725, "complete-iteration": 0.26646998080801454, "set_robot_commands": 0.0027618205293695975, "deviation-center-line": 0.6360969642861032, "driven_lanedir_consec": 3.1229329761960023, "sim_compute_sim_state": 0.01109382446776045, "sim_compute_performance-ego0": 0.0023266406769448136}}set_robot_commands_max 0.0027618205293695975 set_robot_commands_mean 0.0027618205293695975 set_robot_commands_median 0.0027618205293695975 set_robot_commands_min 0.0027618205293695975 sim_compute_performance-ego0_max 0.0023266406769448136 sim_compute_performance-ego0_mean 0.0023266406769448136 sim_compute_performance-ego0_median 0.0023266406769448136 sim_compute_performance-ego0_min 0.0023266406769448136 sim_compute_sim_state_max 0.01109382446776045 sim_compute_sim_state_mean 0.01109382446776045 sim_compute_sim_state_median 0.01109382446776045 sim_compute_sim_state_min 0.01109382446776045 sim_render-ego0_max 0.00429468332452977 sim_render-ego0_mean 0.00429468332452977 sim_render-ego0_median 0.00429468332452977 sim_render-ego0_min 0.00429468332452977 simulation-passed 1 step_physics_max 0.14542929035552005 step_physics_mean 0.14542929035552005 step_physics_median 0.14542929035552005 step_physics_min 0.14542929035552005 survival_time_max 9.349999999999998 survival_time_mean 9.349999999999998 survival_time_min 9.349999999999998
No reset possible 65986
13997
Frank (Chude) Qian Β π¨π¦baseline-behavior-cloning New Dataset aido-LF-sim-validation
sim-2of4 success no gpu-production-spot-1-04
2021-04-09 13:28:40+00:00 2021-04-09 13:30:06+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.63481466050301 survival_time_median 4.199999999999993 deviation-center-line_median 0.08304260116924536 in-drivable-lane_median 2.5999999999999925
other stats agent_compute-ego0_max 0.05789081629584817 agent_compute-ego0_mean 0.05789081629584817 agent_compute-ego0_median 0.05789081629584817 agent_compute-ego0_min 0.05789081629584817 complete-iteration_max 0.18319612390854775 complete-iteration_mean 0.18319612390854775 complete-iteration_median 0.18319612390854775 complete-iteration_min 0.18319612390854775 deviation-center-line_max 0.08304260116924536 deviation-center-line_mean 0.08304260116924536 deviation-center-line_min 0.08304260116924536 deviation-heading_max 0.2579736497624691 deviation-heading_mean 0.2579736497624691 deviation-heading_median 0.2579736497624691 deviation-heading_min 0.2579736497624691 driven_any_max 1.6432800654387676 driven_any_mean 1.6432800654387676 driven_any_median 1.6432800654387676 driven_any_min 1.6432800654387676 driven_lanedir_consec_max 0.63481466050301 driven_lanedir_consec_mean 0.63481466050301 driven_lanedir_consec_min 0.63481466050301 driven_lanedir_max 0.63481466050301 driven_lanedir_mean 0.63481466050301 driven_lanedir_median 0.63481466050301 driven_lanedir_min 0.63481466050301 get_duckie_state_max 1.4249016256893385e-06 get_duckie_state_mean 1.4249016256893385e-06 get_duckie_state_median 1.4249016256893385e-06 get_duckie_state_min 1.4249016256893385e-06 get_robot_state_max 0.004188128078685087 get_robot_state_mean 0.004188128078685087 get_robot_state_median 0.004188128078685087 get_robot_state_min 0.004188128078685087 get_state_dump_max 0.005488154467414407 get_state_dump_mean 0.005488154467414407 get_state_dump_median 0.005488154467414407 get_state_dump_min 0.005488154467414407 get_ui_image_max 0.029844281252692728 get_ui_image_mean 0.029844281252692728 get_ui_image_median 0.029844281252692728 get_ui_image_min 0.029844281252692728 in-drivable-lane_max 2.5999999999999925 in-drivable-lane_mean 2.5999999999999925 in-drivable-lane_min 2.5999999999999925 per-episodes details {"LF-norm-small_loop-000-ego0": {"driven_any": 1.6432800654387676, "get_ui_image": 0.029844281252692728, "step_physics": 0.07105967858258416, "survival_time": 4.199999999999993, "driven_lanedir": 0.63481466050301, "get_state_dump": 0.005488154467414407, "get_robot_state": 0.004188128078685087, "sim_render-ego0": 0.004272937774658203, "get_duckie_state": 1.4249016256893385e-06, "in-drivable-lane": 2.5999999999999925, "deviation-heading": 0.2579736497624691, "agent_compute-ego0": 0.05789081629584817, "complete-iteration": 0.18319612390854775, "set_robot_commands": 0.0026083918178782745, "deviation-center-line": 0.08304260116924536, "driven_lanedir_consec": 0.63481466050301, "sim_compute_sim_state": 0.005483495487886317, "sim_compute_performance-ego0": 0.0022621351129868453}}set_robot_commands_max 0.0026083918178782745 set_robot_commands_mean 0.0026083918178782745 set_robot_commands_median 0.0026083918178782745 set_robot_commands_min 0.0026083918178782745 sim_compute_performance-ego0_max 0.0022621351129868453 sim_compute_performance-ego0_mean 0.0022621351129868453 sim_compute_performance-ego0_median 0.0022621351129868453 sim_compute_performance-ego0_min 0.0022621351129868453 sim_compute_sim_state_max 0.005483495487886317 sim_compute_sim_state_mean 0.005483495487886317 sim_compute_sim_state_median 0.005483495487886317 sim_compute_sim_state_min 0.005483495487886317 sim_render-ego0_max 0.004272937774658203 sim_render-ego0_mean 0.004272937774658203 sim_render-ego0_median 0.004272937774658203 sim_render-ego0_min 0.004272937774658203 simulation-passed 1 step_physics_max 0.07105967858258416 step_physics_mean 0.07105967858258416 step_physics_median 0.07105967858258416 step_physics_min 0.07105967858258416 survival_time_max 4.199999999999993 survival_time_mean 4.199999999999993 survival_time_min 4.199999999999993
No reset possible 65977
13997
Frank (Chude) Qian Β π¨π¦baseline-behavior-cloning New Dataset aido-LF-sim-validation
sim-2of4 success no gpu-production-spot-1-04
2021-04-09 13:27:05+00:00 2021-04-09 13:28:28+00:00 0:01:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.63481466050301 survival_time_median 4.199999999999993 deviation-center-line_median 0.08304260116924536 in-drivable-lane_median 2.5999999999999925
other stats agent_compute-ego0_max 0.05524621851303998 agent_compute-ego0_mean 0.05524621851303998 agent_compute-ego0_median 0.05524621851303998 agent_compute-ego0_min 0.05524621851303998 complete-iteration_max 0.17751437074997845 complete-iteration_mean 0.17751437074997845 complete-iteration_median 0.17751437074997845 complete-iteration_min 0.17751437074997845 deviation-center-line_max 0.08304260116924536 deviation-center-line_mean 0.08304260116924536 deviation-center-line_min 0.08304260116924536 deviation-heading_max 0.2579736497624691 deviation-heading_mean 0.2579736497624691 deviation-heading_median 0.2579736497624691 deviation-heading_min 0.2579736497624691 driven_any_max 1.6432800654387676 driven_any_mean 1.6432800654387676 driven_any_median 1.6432800654387676 driven_any_min 1.6432800654387676 driven_lanedir_consec_max 0.63481466050301 driven_lanedir_consec_mean 0.63481466050301 driven_lanedir_consec_min 0.63481466050301 driven_lanedir_max 0.63481466050301 driven_lanedir_mean 0.63481466050301 driven_lanedir_median 0.63481466050301 driven_lanedir_min 0.63481466050301 get_duckie_state_max 1.2650209314682904e-06 get_duckie_state_mean 1.2650209314682904e-06 get_duckie_state_median 1.2650209314682904e-06 get_duckie_state_min 1.2650209314682904e-06 get_robot_state_max 0.004169769848094267 get_robot_state_mean 0.004169769848094267 get_robot_state_median 0.004169769848094267 get_robot_state_min 0.004169769848094267 get_state_dump_max 0.005141249824972714 get_state_dump_mean 0.005141249824972714 get_state_dump_median 0.005141249824972714 get_state_dump_min 0.005141249824972714 get_ui_image_max 0.02931475358850816 get_ui_image_mean 0.02931475358850816 get_ui_image_median 0.02931475358850816 get_ui_image_min 0.02931475358850816 in-drivable-lane_max 2.5999999999999925 in-drivable-lane_mean 2.5999999999999925 in-drivable-lane_min 2.5999999999999925 per-episodes details {"LF-norm-small_loop-000-ego0": {"driven_any": 1.6432800654387676, "get_ui_image": 0.02931475358850816, "step_physics": 0.06878039977129768, "survival_time": 4.199999999999993, "driven_lanedir": 0.63481466050301, "get_state_dump": 0.005141249824972714, "get_robot_state": 0.004169769848094267, "sim_render-ego0": 0.004328194786520565, "get_duckie_state": 1.2650209314682904e-06, "in-drivable-lane": 2.5999999999999925, "deviation-heading": 0.2579736497624691, "agent_compute-ego0": 0.05524621851303998, "complete-iteration": 0.17751437074997845, "set_robot_commands": 0.002649674696080825, "deviation-center-line": 0.08304260116924536, "driven_lanedir_consec": 0.63481466050301, "sim_compute_sim_state": 0.005515112596399644, "sim_compute_performance-ego0": 0.002271239897784065}}set_robot_commands_max 0.002649674696080825 set_robot_commands_mean 0.002649674696080825 set_robot_commands_median 0.002649674696080825 set_robot_commands_min 0.002649674696080825 sim_compute_performance-ego0_max 0.002271239897784065 sim_compute_performance-ego0_mean 0.002271239897784065 sim_compute_performance-ego0_median 0.002271239897784065 sim_compute_performance-ego0_min 0.002271239897784065 sim_compute_sim_state_max 0.005515112596399644 sim_compute_sim_state_mean 0.005515112596399644 sim_compute_sim_state_median 0.005515112596399644 sim_compute_sim_state_min 0.005515112596399644 sim_render-ego0_max 0.004328194786520565 sim_render-ego0_mean 0.004328194786520565 sim_render-ego0_median 0.004328194786520565 sim_render-ego0_min 0.004328194786520565 simulation-passed 1 step_physics_max 0.06878039977129768 step_physics_mean 0.06878039977129768 step_physics_median 0.06878039977129768 step_physics_min 0.06878039977129768 survival_time_max 4.199999999999993 survival_time_mean 4.199999999999993 survival_time_min 4.199999999999993
No reset possible 65908
13505
AndrΓ‘s Kalapos Β ππΊreal-v1.0-3091-310 aido-LF-sim-validation
sim-3of4 success no gpu-production-spot-1-04
2021-04-09 13:14:31+00:00 2021-04-09 13:26:38+00:00 0:12:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 28.462350299394725 survival_time_median 59.99999999999873 deviation-center-line_median 2.430244505290306 in-drivable-lane_median 0.0
other stats agent_compute-ego0_max 0.01520986163943733 agent_compute-ego0_mean 0.01520986163943733 agent_compute-ego0_median 0.01520986163943733 agent_compute-ego0_min 0.01520986163943733 complete-iteration_max 0.30173815557303574 complete-iteration_mean 0.30173815557303574 complete-iteration_median 0.30173815557303574 complete-iteration_min 0.30173815557303574 deviation-center-line_max 2.430244505290306 deviation-center-line_mean 2.430244505290306 deviation-center-line_min 2.430244505290306 deviation-heading_max 7.82755915012718 deviation-heading_mean 7.82755915012718 deviation-heading_median 7.82755915012718 deviation-heading_min 7.82755915012718 driven_any_max 28.81745199296233 driven_any_mean 28.81745199296233 driven_any_median 28.81745199296233 driven_any_min 28.81745199296233 driven_lanedir_consec_max 28.462350299394725 driven_lanedir_consec_mean 28.462350299394725 driven_lanedir_consec_min 28.462350299394725 driven_lanedir_max 28.462350299394725 driven_lanedir_mean 28.462350299394725 driven_lanedir_median 28.462350299394725 driven_lanedir_min 28.462350299394725 get_duckie_state_max 1.4031161674353405e-06 get_duckie_state_mean 1.4031161674353405e-06 get_duckie_state_median 1.4031161674353405e-06 get_duckie_state_min 1.4031161674353405e-06 get_robot_state_max 0.004291338884860252 get_robot_state_mean 0.004291338884860252 get_robot_state_median 0.004291338884860252 get_robot_state_min 0.004291338884860252 get_state_dump_max 0.005256690947241231 get_state_dump_mean 0.005256690947241231 get_state_dump_median 0.005256690947241231 get_state_dump_min 0.005256690947241231 get_ui_image_max 0.041003935144505434 get_ui_image_mean 0.041003935144505434 get_ui_image_median 0.041003935144505434 get_ui_image_min 0.041003935144505434 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LF-norm-zigzag-000-ego0": {"driven_any": 28.81745199296233, "get_ui_image": 0.041003935144505434, "step_physics": 0.21103723460093424, "survival_time": 59.99999999999873, "driven_lanedir": 28.462350299394725, "get_state_dump": 0.005256690947241231, "get_robot_state": 0.004291338884860252, "sim_render-ego0": 0.004361230467479493, "get_duckie_state": 1.4031161674353405e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.82755915012718, "agent_compute-ego0": 0.01520986163943733, "complete-iteration": 0.30173815557303574, "set_robot_commands": 0.00264332812592747, "deviation-center-line": 2.430244505290306, "driven_lanedir_consec": 28.462350299394725, "sim_compute_sim_state": 0.015439204034162103, "sim_compute_performance-ego0": 0.0023973734551524244}}set_robot_commands_max 0.00264332812592747 set_robot_commands_mean 0.00264332812592747 set_robot_commands_median 0.00264332812592747 set_robot_commands_min 0.00264332812592747 sim_compute_performance-ego0_max 0.0023973734551524244 sim_compute_performance-ego0_mean 0.0023973734551524244 sim_compute_performance-ego0_median 0.0023973734551524244 sim_compute_performance-ego0_min 0.0023973734551524244 sim_compute_sim_state_max 0.015439204034162103 sim_compute_sim_state_mean 0.015439204034162103 sim_compute_sim_state_median 0.015439204034162103 sim_compute_sim_state_min 0.015439204034162103 sim_render-ego0_max 0.004361230467479493 sim_render-ego0_mean 0.004361230467479493 sim_render-ego0_median 0.004361230467479493 sim_render-ego0_min 0.004361230467479493 simulation-passed 1 step_physics_max 0.21103723460093424 step_physics_mean 0.21103723460093424 step_physics_median 0.21103723460093424 step_physics_min 0.21103723460093424 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 65890
13586
Andras Beres 202-1 aido-LFP-sim-validation
sim-0of4 success no gpu-production-spot-1-04
2021-04-09 13:09:51+00:00 2021-04-09 13:13:58+00:00 0:04:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.25 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.5200018956535978 deviation-center-line_median 0.17619617324846062
other stats agent_compute-ego0_max 0.019278256789497707 agent_compute-ego0_mean 0.019278256789497707 agent_compute-ego0_median 0.019278256789497707 agent_compute-ego0_min 0.019278256789497707 complete-iteration_max 0.2988210087237151 complete-iteration_mean 0.2988210087237151 complete-iteration_median 0.2988210087237151 complete-iteration_min 0.2988210087237151 deviation-center-line_max 0.17619617324846062 deviation-center-line_mean 0.17619617324846062 deviation-center-line_min 0.17619617324846062 deviation-heading_max 0.33754457039018876 deviation-heading_mean 0.33754457039018876 deviation-heading_median 0.33754457039018876 deviation-heading_min 0.33754457039018876 driven_any_max 0.5285332345080778 driven_any_mean 0.5285332345080778 driven_any_median 0.5285332345080778 driven_any_min 0.5285332345080778 driven_lanedir_consec_max 0.5200018956535978 driven_lanedir_consec_mean 0.5200018956535978 driven_lanedir_consec_min 0.5200018956535978 driven_lanedir_max 0.5200018956535978 driven_lanedir_mean 0.5200018956535978 driven_lanedir_median 0.5200018956535978 driven_lanedir_min 0.5200018956535978 get_duckie_state_max 0.02360160972761071 get_duckie_state_mean 0.02360160972761071 get_duckie_state_median 0.02360160972761071 get_duckie_state_min 0.02360160972761071 get_robot_state_max 0.004420560339222784 get_robot_state_mean 0.004420560339222784 get_robot_state_median 0.004420560339222784 get_robot_state_min 0.004420560339222784 get_state_dump_max 0.008839088937510614 get_state_dump_mean 0.008839088937510614 get_state_dump_median 0.008839088937510614 get_state_dump_min 0.008839088937510614 get_ui_image_max 0.04436541121938954 get_ui_image_mean 0.04436541121938954 get_ui_image_median 0.04436541121938954 get_ui_image_min 0.04436541121938954 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LFP-norm-zigzag-000-ego0": {"driven_any": 0.5285332345080778, "get_ui_image": 0.04436541121938954, "step_physics": 0.17934441566467285, "survival_time": 2.25, "driven_lanedir": 0.5200018956535978, "get_state_dump": 0.008839088937510614, "get_robot_state": 0.004420560339222784, "sim_render-ego0": 0.004137630048005477, "get_duckie_state": 0.02360160972761071, "in-drivable-lane": 0.0, "deviation-heading": 0.33754457039018876, "agent_compute-ego0": 0.019278256789497707, "complete-iteration": 0.2988210087237151, "set_robot_commands": 0.002621220505755881, "deviation-center-line": 0.17619617324846062, "driven_lanedir_consec": 0.5200018956535978, "sim_compute_sim_state": 0.009894733843596085, "sim_compute_performance-ego0": 0.002211296040078868}}set_robot_commands_max 0.002621220505755881 set_robot_commands_mean 0.002621220505755881 set_robot_commands_median 0.002621220505755881 set_robot_commands_min 0.002621220505755881 sim_compute_performance-ego0_max 0.002211296040078868 sim_compute_performance-ego0_mean 0.002211296040078868 sim_compute_performance-ego0_median 0.002211296040078868 sim_compute_performance-ego0_min 0.002211296040078868 sim_compute_sim_state_max 0.009894733843596085 sim_compute_sim_state_mean 0.009894733843596085 sim_compute_sim_state_median 0.009894733843596085 sim_compute_sim_state_min 0.009894733843596085 sim_render-ego0_max 0.004137630048005477 sim_render-ego0_mean 0.004137630048005477 sim_render-ego0_median 0.004137630048005477 sim_render-ego0_min 0.004137630048005477 simulation-passed 1 step_physics_max 0.17934441566467285 step_physics_mean 0.17934441566467285 step_physics_median 0.17934441566467285 step_physics_min 0.17934441566467285 survival_time_max 2.25 survival_time_mean 2.25 survival_time_min 2.25
No reset possible