Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 66284
13686
Anthony Courchesne Β π¨π¦Real100FH aido-LF-sim-validation
sim-2of4 success no gpu-production-spot-1-02
2021-04-09 14:47:16+00:00 2021-04-09 14:55:45+00:00 0:08:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 7.355805663483838 survival_time_median 59.99999999999873 deviation-center-line_median 3.1766387784051706 in-drivable-lane_median 22.69999999999952
other stats agent_compute-ego0_max 0.03851025031071519 agent_compute-ego0_mean 0.03851025031071519 agent_compute-ego0_median 0.03851025031071519 agent_compute-ego0_min 0.03851025031071519 complete-iteration_max 0.19087058777217564 complete-iteration_mean 0.19087058777217564 complete-iteration_median 0.19087058777217564 complete-iteration_min 0.19087058777217564 deviation-center-line_max 3.1766387784051706 deviation-center-line_mean 3.1766387784051706 deviation-center-line_min 3.1766387784051706 deviation-heading_max 12.008215956979042 deviation-heading_mean 12.008215956979042 deviation-heading_median 12.008215956979042 deviation-heading_min 12.008215956979042 driven_any_max 12.536618181312257 driven_any_mean 12.536618181312257 driven_any_median 12.536618181312257 driven_any_min 12.536618181312257 driven_lanedir_consec_max 7.355805663483838 driven_lanedir_consec_mean 7.355805663483838 driven_lanedir_consec_min 7.355805663483838 driven_lanedir_max 7.355805663483838 driven_lanedir_mean 7.355805663483838 driven_lanedir_median 7.355805663483838 driven_lanedir_min 7.355805663483838 get_duckie_state_max 1.5909129832805344e-06 get_duckie_state_mean 1.5909129832805344e-06 get_duckie_state_median 1.5909129832805344e-06 get_duckie_state_min 1.5909129832805344e-06 get_robot_state_max 0.003669111059666871 get_robot_state_mean 0.003669111059666871 get_robot_state_median 0.003669111059666871 get_robot_state_min 0.003669111059666871 get_state_dump_max 0.004476602230342004 get_state_dump_mean 0.004476602230342004 get_state_dump_median 0.004476602230342004 get_state_dump_min 0.004476602230342004 get_ui_image_max 0.02639124395448302 get_ui_image_mean 0.02639124395448302 get_ui_image_median 0.02639124395448302 get_ui_image_min 0.02639124395448302 in-drivable-lane_max 22.69999999999952 in-drivable-lane_mean 22.69999999999952 in-drivable-lane_min 22.69999999999952 per-episodes details {"LF-norm-small_loop-000-ego0": {"driven_any": 12.536618181312257, "get_ui_image": 0.02639124395448302, "step_physics": 0.10380923996162256, "survival_time": 59.99999999999873, "driven_lanedir": 7.355805663483838, "get_state_dump": 0.004476602230342004, "get_robot_state": 0.003669111059666871, "sim_render-ego0": 0.003705694316130296, "get_duckie_state": 1.5909129832805344e-06, "in-drivable-lane": 22.69999999999952, "deviation-heading": 12.008215956979042, "agent_compute-ego0": 0.03851025031071519, "complete-iteration": 0.19087058777217564, "set_robot_commands": 0.0022286632277387862, "deviation-center-line": 3.1766387784051706, "driven_lanedir_consec": 7.355805663483838, "sim_compute_sim_state": 0.006073824273458032, "sim_compute_performance-ego0": 0.001929645633618103}}set_robot_commands_max 0.0022286632277387862 set_robot_commands_mean 0.0022286632277387862 set_robot_commands_median 0.0022286632277387862 set_robot_commands_min 0.0022286632277387862 sim_compute_performance-ego0_max 0.001929645633618103 sim_compute_performance-ego0_mean 0.001929645633618103 sim_compute_performance-ego0_median 0.001929645633618103 sim_compute_performance-ego0_min 0.001929645633618103 sim_compute_sim_state_max 0.006073824273458032 sim_compute_sim_state_mean 0.006073824273458032 sim_compute_sim_state_median 0.006073824273458032 sim_compute_sim_state_min 0.006073824273458032 sim_render-ego0_max 0.003705694316130296 sim_render-ego0_mean 0.003705694316130296 sim_render-ego0_median 0.003705694316130296 sim_render-ego0_min 0.003705694316130296 simulation-passed 1 step_physics_max 0.10380923996162256 step_physics_mean 0.10380923996162256 step_physics_median 0.10380923996162256 step_physics_min 0.10380923996162256 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 66282
13798
Nicholas Kostelnik template-random aido-hello-sim-validation
370 aborted no gpu-production-spot-1-02
2021-04-09 14:46:40+00:00 2021-04-09 14:47:02+00:00 0:00:22 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
raise create_api_error_from_http_exception(e)
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691 tag None
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 66277
13798
Nicholas Kostelnik template-random aido-hello-sim-validation
370 aborted no gpu-production-spot-1-02
2021-04-09 14:45:40+00:00 2021-04-09 14:46:27+00:00 0:00:47 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
raise create_api_error_from_http_exception(e)
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691 tag None
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 66234
13909
YU CHEN CBC Net v2 - test aido-LF-sim-validation
sim-3of4 success no gpu-production-spot-1-02
2021-04-09 14:32:41+00:00 2021-04-09 14:45:35+00:00 0:12:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 13.11855266360694 survival_time_median 59.99999999999873 deviation-center-line_median 2.6998220824103885 in-drivable-lane_median 22.449999999999577
other stats agent_compute-ego0_max 0.0938351797521561 agent_compute-ego0_mean 0.0938351797521561 agent_compute-ego0_median 0.0938351797521561 agent_compute-ego0_min 0.0938351797521561 complete-iteration_max 0.3525015116730499 complete-iteration_mean 0.3525015116730499 complete-iteration_median 0.3525015116730499 complete-iteration_min 0.3525015116730499 deviation-center-line_max 2.6998220824103885 deviation-center-line_mean 2.6998220824103885 deviation-center-line_min 2.6998220824103885 deviation-heading_max 14.250602068947932 deviation-heading_mean 14.250602068947932 deviation-heading_median 14.250602068947932 deviation-heading_min 14.250602068947932 driven_any_max 23.949632005019197 driven_any_mean 23.949632005019197 driven_any_median 23.949632005019197 driven_any_min 23.949632005019197 driven_lanedir_consec_max 13.11855266360694 driven_lanedir_consec_mean 13.11855266360694 driven_lanedir_consec_min 13.11855266360694 driven_lanedir_max 13.11855266360694 driven_lanedir_mean 13.11855266360694 driven_lanedir_median 13.11855266360694 driven_lanedir_min 13.11855266360694 get_duckie_state_max 1.2959171393630309e-06 get_duckie_state_mean 1.2959171393630309e-06 get_duckie_state_median 1.2959171393630309e-06 get_duckie_state_min 1.2959171393630309e-06 get_robot_state_max 0.004070280592804844 get_robot_state_mean 0.004070280592804844 get_robot_state_median 0.004070280592804844 get_robot_state_min 0.004070280592804844 get_state_dump_max 0.005136562723799808 get_state_dump_mean 0.005136562723799808 get_state_dump_median 0.005136562723799808 get_state_dump_min 0.005136562723799808 get_ui_image_max 0.03921401570182756 get_ui_image_mean 0.03921401570182756 get_ui_image_median 0.03921401570182756 get_ui_image_min 0.03921401570182756 in-drivable-lane_max 22.449999999999577 in-drivable-lane_mean 22.449999999999577 in-drivable-lane_min 22.449999999999577 per-episodes details {"LF-norm-zigzag-000-ego0": {"driven_any": 23.949632005019197, "get_ui_image": 0.03921401570182756, "step_physics": 0.18629216453018632, "survival_time": 59.99999999999873, "driven_lanedir": 13.11855266360694, "get_state_dump": 0.005136562723799808, "get_robot_state": 0.004070280592804844, "sim_render-ego0": 0.004161004122846033, "get_duckie_state": 1.2959171393630309e-06, "in-drivable-lane": 22.449999999999577, "deviation-heading": 14.250602068947932, "agent_compute-ego0": 0.0938351797521561, "complete-iteration": 0.3525015116730499, "set_robot_commands": 0.0026586323753185416, "deviation-center-line": 2.6998220824103885, "driven_lanedir_consec": 13.11855266360694, "sim_compute_sim_state": 0.014789683931971668, "sim_compute_performance-ego0": 0.0022513366162429543}}set_robot_commands_max 0.0026586323753185416 set_robot_commands_mean 0.0026586323753185416 set_robot_commands_median 0.0026586323753185416 set_robot_commands_min 0.0026586323753185416 sim_compute_performance-ego0_max 0.0022513366162429543 sim_compute_performance-ego0_mean 0.0022513366162429543 sim_compute_performance-ego0_median 0.0022513366162429543 sim_compute_performance-ego0_min 0.0022513366162429543 sim_compute_sim_state_max 0.014789683931971668 sim_compute_sim_state_mean 0.014789683931971668 sim_compute_sim_state_median 0.014789683931971668 sim_compute_sim_state_min 0.014789683931971668 sim_render-ego0_max 0.004161004122846033 sim_render-ego0_mean 0.004161004122846033 sim_render-ego0_median 0.004161004122846033 sim_render-ego0_min 0.004161004122846033 simulation-passed 1 step_physics_max 0.18629216453018632 step_physics_mean 0.18629216453018632 step_physics_median 0.18629216453018632 step_physics_min 0.18629216453018632 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 66230
13540
AndrΓ‘s Kalapos Β ππΊ3090 aido-LFP-sim-testing
sim-2of4 success no gpu-production-spot-1-02
2021-04-09 14:31:06+00:00 2021-04-09 14:32:22+00:00 0:01:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 1.7000000000000008 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.35296912830735283 deviation-center-line_median 0.07758282854933857
other stats agent_compute-ego0_max 0.017392090388706753 agent_compute-ego0_mean 0.017392090388706753 agent_compute-ego0_median 0.017392090388706753 agent_compute-ego0_min 0.017392090388706753 complete-iteration_max 0.2165571008409773 complete-iteration_mean 0.2165571008409773 complete-iteration_median 0.2165571008409773 complete-iteration_min 0.2165571008409773 deviation-center-line_max 0.07758282854933857 deviation-center-line_mean 0.07758282854933857 deviation-center-line_min 0.07758282854933857 deviation-heading_max 0.20950925697284384 deviation-heading_mean 0.20950925697284384 deviation-heading_median 0.20950925697284384 deviation-heading_min 0.20950925697284384 driven_any_max 0.35625075510618204 driven_any_mean 0.35625075510618204 driven_any_median 0.35625075510618204 driven_any_min 0.35625075510618204 driven_lanedir_consec_max 0.35296912830735283 driven_lanedir_consec_mean 0.35296912830735283 driven_lanedir_consec_min 0.35296912830735283 driven_lanedir_max 0.35296912830735283 driven_lanedir_mean 0.35296912830735283 driven_lanedir_median 0.35296912830735283 driven_lanedir_min 0.35296912830735283 get_duckie_state_max 0.02870511327471052 get_duckie_state_mean 0.02870511327471052 get_duckie_state_median 0.02870511327471052 get_duckie_state_min 0.02870511327471052 get_robot_state_max 0.004358536856515067 get_robot_state_mean 0.004358536856515067 get_robot_state_median 0.004358536856515067 get_robot_state_min 0.004358536856515067 get_state_dump_max 0.010388857977730887 get_state_dump_mean 0.010388857977730887 get_state_dump_median 0.010388857977730887 get_state_dump_min 0.010388857977730887 get_ui_image_max 0.03628466469900948 get_ui_image_mean 0.03628466469900948 get_ui_image_median 0.03628466469900948 get_ui_image_min 0.03628466469900948 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LFP-norm-loop-000-ego0": {"driven_any": 0.35625075510618204, "get_ui_image": 0.03628466469900948, "step_physics": 0.10338655199323382, "survival_time": 1.7000000000000008, "driven_lanedir": 0.35296912830735283, "get_state_dump": 0.010388857977730887, "get_robot_state": 0.004358536856515067, "sim_render-ego0": 0.004592316491263253, "get_duckie_state": 0.02870511327471052, "in-drivable-lane": 0.0, "deviation-heading": 0.20950925697284384, "agent_compute-ego0": 0.017392090388706753, "complete-iteration": 0.2165571008409773, "set_robot_commands": 0.0027479512350899833, "deviation-center-line": 0.07758282854933857, "driven_lanedir_consec": 0.35296912830735283, "sim_compute_sim_state": 0.006110307148524693, "sim_compute_performance-ego0": 0.002468960625784738}}set_robot_commands_max 0.0027479512350899833 set_robot_commands_mean 0.0027479512350899833 set_robot_commands_median 0.0027479512350899833 set_robot_commands_min 0.0027479512350899833 sim_compute_performance-ego0_max 0.002468960625784738 sim_compute_performance-ego0_mean 0.002468960625784738 sim_compute_performance-ego0_median 0.002468960625784738 sim_compute_performance-ego0_min 0.002468960625784738 sim_compute_sim_state_max 0.006110307148524693 sim_compute_sim_state_mean 0.006110307148524693 sim_compute_sim_state_median 0.006110307148524693 sim_compute_sim_state_min 0.006110307148524693 sim_render-ego0_max 0.004592316491263253 sim_render-ego0_mean 0.004592316491263253 sim_render-ego0_median 0.004592316491263253 sim_render-ego0_min 0.004592316491263253 simulation-passed 1 step_physics_max 0.10338655199323382 step_physics_mean 0.10338655199323382 step_physics_median 0.10338655199323382 step_physics_min 0.10338655199323382 survival_time_max 1.7000000000000008 survival_time_mean 1.7000000000000008 survival_time_min 1.7000000000000008
No reset possible 66227
13540
AndrΓ‘s Kalapos Β ππΊ3090 aido-LFP-sim-testing
sim-2of4 success no gpu-production-spot-1-02
2021-04-09 14:29:43+00:00 2021-04-09 14:30:59+00:00 0:01:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 1.7000000000000008 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.3522771319289384 deviation-center-line_median 0.07523452261896645
other stats agent_compute-ego0_max 0.018014138085501535 agent_compute-ego0_mean 0.018014138085501535 agent_compute-ego0_median 0.018014138085501535 agent_compute-ego0_min 0.018014138085501535 complete-iteration_max 0.21872844014848983 complete-iteration_mean 0.21872844014848983 complete-iteration_median 0.21872844014848983 complete-iteration_min 0.21872844014848983 deviation-center-line_max 0.07523452261896645 deviation-center-line_mean 0.07523452261896645 deviation-center-line_min 0.07523452261896645 deviation-heading_max 0.2004805037569577 deviation-heading_mean 0.2004805037569577 deviation-heading_median 0.2004805037569577 deviation-heading_min 0.2004805037569577 driven_any_max 0.3553917915431748 driven_any_mean 0.3553917915431748 driven_any_median 0.3553917915431748 driven_any_min 0.3553917915431748 driven_lanedir_consec_max 0.3522771319289384 driven_lanedir_consec_mean 0.3522771319289384 driven_lanedir_consec_min 0.3522771319289384 driven_lanedir_max 0.3522771319289384 driven_lanedir_mean 0.3522771319289384 driven_lanedir_median 0.3522771319289384 driven_lanedir_min 0.3522771319289384 get_duckie_state_max 0.02837306431361607 get_duckie_state_mean 0.02837306431361607 get_duckie_state_median 0.02837306431361607 get_duckie_state_min 0.02837306431361607 get_robot_state_max 0.004279157093593052 get_robot_state_mean 0.004279157093593052 get_robot_state_median 0.004279157093593052 get_robot_state_min 0.004279157093593052 get_state_dump_max 0.010222182955060688 get_state_dump_mean 0.010222182955060688 get_state_dump_median 0.010222182955060688 get_state_dump_min 0.010222182955060688 get_ui_image_max 0.037303529466901506 get_ui_image_mean 0.037303529466901506 get_ui_image_median 0.037303529466901506 get_ui_image_min 0.037303529466901506 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LFP-norm-loop-000-ego0": {"driven_any": 0.3553917915431748, "get_ui_image": 0.037303529466901506, "step_physics": 0.10527276992797852, "survival_time": 1.7000000000000008, "driven_lanedir": 0.3522771319289384, "get_state_dump": 0.010222182955060688, "get_robot_state": 0.004279157093593052, "sim_render-ego0": 0.004216017041887556, "get_duckie_state": 0.02837306431361607, "in-drivable-lane": 0.0, "deviation-heading": 0.2004805037569577, "agent_compute-ego0": 0.018014138085501535, "complete-iteration": 0.21872844014848983, "set_robot_commands": 0.002665805816650391, "deviation-center-line": 0.07523452261896645, "driven_lanedir_consec": 0.3522771319289384, "sim_compute_sim_state": 0.0059951509748186384, "sim_compute_performance-ego0": 0.0022690159933907647}}set_robot_commands_max 0.002665805816650391 set_robot_commands_mean 0.002665805816650391 set_robot_commands_median 0.002665805816650391 set_robot_commands_min 0.002665805816650391 sim_compute_performance-ego0_max 0.0022690159933907647 sim_compute_performance-ego0_mean 0.0022690159933907647 sim_compute_performance-ego0_median 0.0022690159933907647 sim_compute_performance-ego0_min 0.0022690159933907647 sim_compute_sim_state_max 0.0059951509748186384 sim_compute_sim_state_mean 0.0059951509748186384 sim_compute_sim_state_median 0.0059951509748186384 sim_compute_sim_state_min 0.0059951509748186384 sim_render-ego0_max 0.004216017041887556 sim_render-ego0_mean 0.004216017041887556 sim_render-ego0_median 0.004216017041887556 sim_render-ego0_min 0.004216017041887556 simulation-passed 1 step_physics_max 0.10527276992797852 step_physics_mean 0.10527276992797852 step_physics_median 0.10527276992797852 step_physics_min 0.10527276992797852 survival_time_max 1.7000000000000008 survival_time_mean 1.7000000000000008 survival_time_min 1.7000000000000008
No reset possible 66206
13944
YU CHEN CBC Net v2 test - added mar 31 anomaly + mar 28 bc_v1 aido-LFP-sim-validation
sim-3of4 success no gpu-production-spot-1-02
2021-04-09 14:23:35+00:00 2021-04-09 14:29:09+00:00 0:05:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 23.7000000000002 in-drivable-lane_median 7.950000000000074 driven_lanedir_consec_median 6.137112539000098 deviation-center-line_median 1.1652307156500996
other stats agent_compute-ego0_max 0.0959400749206543 agent_compute-ego0_mean 0.0959400749206543 agent_compute-ego0_median 0.0959400749206543 agent_compute-ego0_min 0.0959400749206543 complete-iteration_max 0.3574443641461824 complete-iteration_mean 0.3574443641461824 complete-iteration_median 0.3574443641461824 complete-iteration_min 0.3574443641461824 deviation-center-line_max 1.1652307156500996 deviation-center-line_mean 1.1652307156500996 deviation-center-line_min 1.1652307156500996 deviation-heading_max 4.381090385260154 deviation-heading_mean 4.381090385260154 deviation-heading_median 4.381090385260154 deviation-heading_min 4.381090385260154 driven_any_max 9.911005485825156 driven_any_mean 9.911005485825156 driven_any_median 9.911005485825156 driven_any_min 9.911005485825156 driven_lanedir_consec_max 6.137112539000098 driven_lanedir_consec_mean 6.137112539000098 driven_lanedir_consec_min 6.137112539000098 driven_lanedir_max 6.137112539000098 driven_lanedir_mean 6.137112539000098 driven_lanedir_median 6.137112539000098 driven_lanedir_min 6.137112539000098 get_duckie_state_max 0.02271660152234529 get_duckie_state_mean 0.02271660152234529 get_duckie_state_median 0.02271660152234529 get_duckie_state_min 0.02271660152234529 get_robot_state_max 0.00409389947590075 get_robot_state_mean 0.00409389947590075 get_robot_state_median 0.00409389947590075 get_robot_state_min 0.00409389947590075 get_state_dump_max 0.008673487211528576 get_state_dump_mean 0.008673487211528576 get_state_dump_median 0.008673487211528576 get_state_dump_min 0.008673487211528576 get_ui_image_max 0.03924234340065404 get_ui_image_mean 0.03924234340065404 get_ui_image_median 0.03924234340065404 get_ui_image_min 0.03924234340065404 in-drivable-lane_max 7.950000000000074 in-drivable-lane_mean 7.950000000000074 in-drivable-lane_min 7.950000000000074 per-episodes details {"LFP-norm-techtrack-000-ego0": {"driven_any": 9.911005485825156, "get_ui_image": 0.03924234340065404, "step_physics": 0.1648240526098954, "survival_time": 23.7000000000002, "driven_lanedir": 6.137112539000098, "get_state_dump": 0.008673487211528576, "get_robot_state": 0.00409389947590075, "sim_render-ego0": 0.0040809340226022825, "get_duckie_state": 0.02271660152234529, "in-drivable-lane": 7.950000000000074, "deviation-heading": 4.381090385260154, "agent_compute-ego0": 0.0959400749206543, "complete-iteration": 0.3574443641461824, "set_robot_commands": 0.002518882249530993, "deviation-center-line": 1.1652307156500996, "driven_lanedir_consec": 6.137112539000098, "sim_compute_sim_state": 0.013081939596878854, "sim_compute_performance-ego0": 0.002158537412944593}}set_robot_commands_max 0.002518882249530993 set_robot_commands_mean 0.002518882249530993 set_robot_commands_median 0.002518882249530993 set_robot_commands_min 0.002518882249530993 sim_compute_performance-ego0_max 0.002158537412944593 sim_compute_performance-ego0_mean 0.002158537412944593 sim_compute_performance-ego0_median 0.002158537412944593 sim_compute_performance-ego0_min 0.002158537412944593 sim_compute_sim_state_max 0.013081939596878854 sim_compute_sim_state_mean 0.013081939596878854 sim_compute_sim_state_median 0.013081939596878854 sim_compute_sim_state_min 0.013081939596878854 sim_render-ego0_max 0.0040809340226022825 sim_render-ego0_mean 0.0040809340226022825 sim_render-ego0_median 0.0040809340226022825 sim_render-ego0_min 0.0040809340226022825 simulation-passed 1 step_physics_max 0.1648240526098954 step_physics_mean 0.1648240526098954 step_physics_median 0.1648240526098954 step_physics_min 0.1648240526098954 survival_time_max 23.7000000000002 survival_time_mean 23.7000000000002 survival_time_min 23.7000000000002
No reset possible 66192
13944
YU CHEN CBC Net v2 test - added mar 31 anomaly + mar 28 bc_v1 aido-LFP-sim-validation
sim-2of4 success no gpu-production-spot-1-02
2021-04-09 14:20:46+00:00 2021-04-09 14:23:02+00:00 0:02:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.199999999999982 in-drivable-lane_median 2.7999999999999914 driven_lanedir_consec_median 1.37721786065758 deviation-center-line_median 0.341375392549285
other stats agent_compute-ego0_max 0.09506594723668592 agent_compute-ego0_mean 0.09506594723668592 agent_compute-ego0_median 0.09506594723668592 agent_compute-ego0_min 0.09506594723668592 complete-iteration_max 0.32978567583807583 complete-iteration_mean 0.32978567583807583 complete-iteration_median 0.32978567583807583 complete-iteration_min 0.32978567583807583 deviation-center-line_max 0.341375392549285 deviation-center-line_mean 0.341375392549285 deviation-center-line_min 0.341375392549285 deviation-heading_max 1.744177526027668 deviation-heading_mean 1.744177526027668 deviation-heading_median 1.744177526027668 deviation-heading_min 1.744177526027668 driven_any_max 2.4992082852085105 driven_any_mean 2.4992082852085105 driven_any_median 2.4992082852085105 driven_any_min 2.4992082852085105 driven_lanedir_consec_max 1.37721786065758 driven_lanedir_consec_mean 1.37721786065758 driven_lanedir_consec_min 1.37721786065758 driven_lanedir_max 1.37721786065758 driven_lanedir_mean 1.37721786065758 driven_lanedir_median 1.37721786065758 driven_lanedir_min 1.37721786065758 get_duckie_state_max 0.027163628874153925 get_duckie_state_mean 0.027163628874153925 get_duckie_state_median 0.027163628874153925 get_duckie_state_min 0.027163628874153925 get_robot_state_max 0.004092255954084725 get_robot_state_mean 0.004092255954084725 get_robot_state_median 0.004092255954084725 get_robot_state_min 0.004092255954084725 get_state_dump_max 0.009551760246013771 get_state_dump_mean 0.009551760246013771 get_state_dump_median 0.009551760246013771 get_state_dump_min 0.009551760246013771 get_ui_image_max 0.034746508762754244 get_ui_image_mean 0.034746508762754244 get_ui_image_median 0.034746508762754244 get_ui_image_min 0.034746508762754244 in-drivable-lane_max 2.7999999999999914 in-drivable-lane_mean 2.7999999999999914 in-drivable-lane_min 2.7999999999999914 per-episodes details {"LFP-norm-loop-000-ego0": {"driven_any": 2.4992082852085105, "get_ui_image": 0.034746508762754244, "step_physics": 0.14200214024247795, "survival_time": 7.199999999999982, "driven_lanedir": 1.37721786065758, "get_state_dump": 0.009551760246013771, "get_robot_state": 0.004092255954084725, "sim_render-ego0": 0.00407075388678189, "get_duckie_state": 0.027163628874153925, "in-drivable-lane": 2.7999999999999914, "deviation-heading": 1.744177526027668, "agent_compute-ego0": 0.09506594723668592, "complete-iteration": 0.32978567583807583, "set_robot_commands": 0.0025016324273471175, "deviation-center-line": 0.341375392549285, "driven_lanedir_consec": 1.37721786065758, "sim_compute_sim_state": 0.00832395389162261, "sim_compute_performance-ego0": 0.0021482418323385305}}set_robot_commands_max 0.0025016324273471175 set_robot_commands_mean 0.0025016324273471175 set_robot_commands_median 0.0025016324273471175 set_robot_commands_min 0.0025016324273471175 sim_compute_performance-ego0_max 0.0021482418323385305 sim_compute_performance-ego0_mean 0.0021482418323385305 sim_compute_performance-ego0_median 0.0021482418323385305 sim_compute_performance-ego0_min 0.0021482418323385305 sim_compute_sim_state_max 0.00832395389162261 sim_compute_sim_state_mean 0.00832395389162261 sim_compute_sim_state_median 0.00832395389162261 sim_compute_sim_state_min 0.00832395389162261 sim_render-ego0_max 0.00407075388678189 sim_render-ego0_mean 0.00407075388678189 sim_render-ego0_median 0.00407075388678189 sim_render-ego0_min 0.00407075388678189 simulation-passed 1 step_physics_max 0.14200214024247795 step_physics_mean 0.14200214024247795 step_physics_median 0.14200214024247795 step_physics_min 0.14200214024247795 survival_time_max 7.199999999999982 survival_time_mean 7.199999999999982 survival_time_min 7.199999999999982
No reset possible 66177
13996
Frank (Chude) Qian Β π¨π¦baseline-behavior-cloning aido-LFP-sim-validation
sim-0of4 success no gpu-production-spot-1-02
2021-04-09 14:18:54+00:00 2021-04-09 14:20:26+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.1999999999999966 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.4935451414543148 deviation-center-line_median 0.26735476180902273
other stats agent_compute-ego0_max 0.06573464687053975 agent_compute-ego0_mean 0.06573464687053975 agent_compute-ego0_median 0.06573464687053975 agent_compute-ego0_min 0.06573464687053975 complete-iteration_max 0.30689279849712664 complete-iteration_mean 0.30689279849712664 complete-iteration_median 0.30689279849712664 complete-iteration_min 0.30689279849712664 deviation-center-line_max 0.26735476180902273 deviation-center-line_mean 0.26735476180902273 deviation-center-line_min 0.26735476180902273 deviation-heading_max 1.23931602848654 deviation-heading_mean 1.23931602848654 deviation-heading_median 1.23931602848654 deviation-heading_min 1.23931602848654 driven_any_max 0.5282309334804229 driven_any_mean 0.5282309334804229 driven_any_median 0.5282309334804229 driven_any_min 0.5282309334804229 driven_lanedir_consec_max 0.4935451414543148 driven_lanedir_consec_mean 0.4935451414543148 driven_lanedir_consec_min 0.4935451414543148 driven_lanedir_max 0.4935451414543148 driven_lanedir_mean 0.4935451414543148 driven_lanedir_median 0.4935451414543148 driven_lanedir_min 0.4935451414543148 get_duckie_state_max 0.023000034919151893 get_duckie_state_mean 0.023000034919151893 get_duckie_state_median 0.023000034919151893 get_duckie_state_min 0.023000034919151893 get_robot_state_max 0.00434409655057467 get_robot_state_mean 0.00434409655057467 get_robot_state_median 0.00434409655057467 get_robot_state_min 0.00434409655057467 get_state_dump_max 0.009081323330218976 get_state_dump_mean 0.009081323330218976 get_state_dump_median 0.009081323330218976 get_state_dump_min 0.009081323330218976 get_ui_image_max 0.04330404354975774 get_ui_image_mean 0.04330404354975774 get_ui_image_median 0.04330404354975774 get_ui_image_min 0.04330404354975774 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LFP-norm-zigzag-000-ego0": {"driven_any": 0.5282309334804229, "get_ui_image": 0.04330404354975774, "step_physics": 0.14198752183180588, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4935451414543148, "get_state_dump": 0.009081323330218976, "get_robot_state": 0.00434409655057467, "sim_render-ego0": 0.0041941642761230465, "get_duckie_state": 0.023000034919151893, "in-drivable-lane": 0.0, "deviation-heading": 1.23931602848654, "agent_compute-ego0": 0.06573464687053975, "complete-iteration": 0.30689279849712664, "set_robot_commands": 0.0025411202357365536, "deviation-center-line": 0.26735476180902273, "driven_lanedir_consec": 0.4935451414543148, "sim_compute_sim_state": 0.010365834602942834, "sim_compute_performance-ego0": 0.002233402545635517}}set_robot_commands_max 0.0025411202357365536 set_robot_commands_mean 0.0025411202357365536 set_robot_commands_median 0.0025411202357365536 set_robot_commands_min 0.0025411202357365536 sim_compute_performance-ego0_max 0.002233402545635517 sim_compute_performance-ego0_mean 0.002233402545635517 sim_compute_performance-ego0_median 0.002233402545635517 sim_compute_performance-ego0_min 0.002233402545635517 sim_compute_sim_state_max 0.010365834602942834 sim_compute_sim_state_mean 0.010365834602942834 sim_compute_sim_state_median 0.010365834602942834 sim_compute_sim_state_min 0.010365834602942834 sim_render-ego0_max 0.0041941642761230465 sim_render-ego0_mean 0.0041941642761230465 sim_render-ego0_median 0.0041941642761230465 sim_render-ego0_min 0.0041941642761230465 simulation-passed 1 step_physics_max 0.14198752183180588 step_physics_mean 0.14198752183180588 step_physics_median 0.14198752183180588 step_physics_min 0.14198752183180588 survival_time_max 3.1999999999999966 survival_time_mean 3.1999999999999966 survival_time_min 3.1999999999999966
No reset possible 66166
13992
Frank (Chude) Qian Β π¨π¦CBC Net - MixTraining - Expert LF Human LFP aido-LFP-sim-validation
sim-3of4 success no gpu-production-spot-1-02
2021-04-09 14:16:49+00:00 2021-04-09 14:18:47+00:00 0:01:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.2499999999999964 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.142798743710388 deviation-center-line_median 0.17628683601342768
other stats agent_compute-ego0_max 0.05743658903873328 agent_compute-ego0_mean 0.05743658903873328 agent_compute-ego0_median 0.05743658903873328 agent_compute-ego0_min 0.05743658903873328 complete-iteration_max 0.28821321328481037 complete-iteration_mean 0.28821321328481037 complete-iteration_median 0.28821321328481037 complete-iteration_min 0.28821321328481037 deviation-center-line_max 0.17628683601342768 deviation-center-line_mean 0.17628683601342768 deviation-center-line_min 0.17628683601342768 deviation-heading_max 0.8164738265365391 deviation-heading_mean 0.8164738265365391 deviation-heading_median 0.8164738265365391 deviation-heading_min 0.8164738265365391 driven_any_max 1.1635244246332228 driven_any_mean 1.1635244246332228 driven_any_median 1.1635244246332228 driven_any_min 1.1635244246332228 driven_lanedir_consec_max 1.142798743710388 driven_lanedir_consec_mean 1.142798743710388 driven_lanedir_consec_min 1.142798743710388 driven_lanedir_max 1.142798743710388 driven_lanedir_mean 1.142798743710388 driven_lanedir_median 1.142798743710388 driven_lanedir_min 1.142798743710388 get_duckie_state_max 0.022518591447310013 get_duckie_state_mean 0.022518591447310013 get_duckie_state_median 0.022518591447310013 get_duckie_state_min 0.022518591447310013 get_robot_state_max 0.004197575829245828 get_robot_state_mean 0.004197575829245828 get_robot_state_median 0.004197575829245828 get_robot_state_min 0.004197575829245828 get_state_dump_max 0.00898441762635202 get_state_dump_mean 0.00898441762635202 get_state_dump_median 0.00898441762635202 get_state_dump_min 0.00898441762635202 get_ui_image_max 0.03620420802723278 get_ui_image_mean 0.03620420802723278 get_ui_image_median 0.03620420802723278 get_ui_image_min 0.03620420802723278 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LFP-norm-techtrack-000-ego0": {"driven_any": 1.1635244246332228, "get_ui_image": 0.03620420802723278, "step_physics": 0.1370229215332956, "survival_time": 3.2499999999999964, "driven_lanedir": 1.142798743710388, "get_state_dump": 0.00898441762635202, "get_robot_state": 0.004197575829245828, "sim_render-ego0": 0.0042724681623054275, "get_duckie_state": 0.022518591447310013, "in-drivable-lane": 0.0, "deviation-heading": 0.8164738265365391, "agent_compute-ego0": 0.05743658903873328, "complete-iteration": 0.28821321328481037, "set_robot_commands": 0.0026436719027432528, "deviation-center-line": 0.17628683601342768, "driven_lanedir_consec": 1.142798743710388, "sim_compute_sim_state": 0.012496113777160645, "sim_compute_performance-ego0": 0.0023335037809429746}}set_robot_commands_max 0.0026436719027432528 set_robot_commands_mean 0.0026436719027432528 set_robot_commands_median 0.0026436719027432528 set_robot_commands_min 0.0026436719027432528 sim_compute_performance-ego0_max 0.0023335037809429746 sim_compute_performance-ego0_mean 0.0023335037809429746 sim_compute_performance-ego0_median 0.0023335037809429746 sim_compute_performance-ego0_min 0.0023335037809429746 sim_compute_sim_state_max 0.012496113777160645 sim_compute_sim_state_mean 0.012496113777160645 sim_compute_sim_state_median 0.012496113777160645 sim_compute_sim_state_min 0.012496113777160645 sim_render-ego0_max 0.0042724681623054275 sim_render-ego0_mean 0.0042724681623054275 sim_render-ego0_median 0.0042724681623054275 sim_render-ego0_min 0.0042724681623054275 simulation-passed 1 step_physics_max 0.1370229215332956 step_physics_mean 0.1370229215332956 step_physics_median 0.1370229215332956 step_physics_min 0.1370229215332956 survival_time_max 3.2499999999999964 survival_time_mean 3.2499999999999964 survival_time_min 3.2499999999999964
No reset possible 66143
14014
YU CHEN CBC Net v2 test - APR 6 anomaly + mar 28 bc aido-LFP-sim-validation
sim-2of4 success no gpu-production-spot-1-02
2021-04-09 14:12:17+00:00 2021-04-09 14:15:56+00:00 0:03:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 13.600000000000058 in-drivable-lane_median 3.700000000000019 driven_lanedir_consec_median 3.544999109589921 deviation-center-line_median 0.6374406194829157
other stats agent_compute-ego0_max 0.1000439098903111 agent_compute-ego0_mean 0.1000439098903111 agent_compute-ego0_median 0.1000439098903111 agent_compute-ego0_min 0.1000439098903111 complete-iteration_max 0.3657910911154834 complete-iteration_mean 0.3657910911154834 complete-iteration_median 0.3657910911154834 complete-iteration_min 0.3657910911154834 deviation-center-line_max 0.6374406194829157 deviation-center-line_mean 0.6374406194829157 deviation-center-line_min 0.6374406194829157 deviation-heading_max 2.739105791596955 deviation-heading_mean 2.739105791596955 deviation-heading_median 2.739105791596955 deviation-heading_min 2.739105791596955 driven_any_max 5.36095017695179 driven_any_mean 5.36095017695179 driven_any_median 5.36095017695179 driven_any_min 5.36095017695179 driven_lanedir_consec_max 3.544999109589921 driven_lanedir_consec_mean 3.544999109589921 driven_lanedir_consec_min 3.544999109589921 driven_lanedir_max 3.544999109589921 driven_lanedir_mean 3.544999109589921 driven_lanedir_median 3.544999109589921 driven_lanedir_min 3.544999109589921 get_duckie_state_max 0.028190590959765536 get_duckie_state_mean 0.028190590959765536 get_duckie_state_median 0.028190590959765536 get_duckie_state_min 0.028190590959765536 get_robot_state_max 0.004348353151873354 get_robot_state_mean 0.004348353151873354 get_robot_state_median 0.004348353151873354 get_robot_state_min 0.004348353151873354 get_state_dump_max 0.009915048822815164 get_state_dump_mean 0.009915048822815164 get_state_dump_median 0.009915048822815164 get_state_dump_min 0.009915048822815164 get_ui_image_max 0.03668222409901602 get_ui_image_mean 0.03668222409901602 get_ui_image_median 0.03668222409901602 get_ui_image_min 0.03668222409901602 in-drivable-lane_max 3.700000000000019 in-drivable-lane_mean 3.700000000000019 in-drivable-lane_min 3.700000000000019 per-episodes details {"LFP-norm-loop-000-ego0": {"driven_any": 5.36095017695179, "get_ui_image": 0.03668222409901602, "step_physics": 0.1680433296021961, "survival_time": 13.600000000000058, "driven_lanedir": 3.544999109589921, "get_state_dump": 0.009915048822815164, "get_robot_state": 0.004348353151873354, "sim_render-ego0": 0.00427187144101321, "get_duckie_state": 0.028190590959765536, "in-drivable-lane": 3.700000000000019, "deviation-heading": 2.739105791596955, "agent_compute-ego0": 0.1000439098903111, "complete-iteration": 0.3657910911154834, "set_robot_commands": 0.0025734980027754227, "deviation-center-line": 0.6374406194829157, "driven_lanedir_consec": 3.544999109589921, "sim_compute_sim_state": 0.009348226554227837, "sim_compute_performance-ego0": 0.002254684329469562}}set_robot_commands_max 0.0025734980027754227 set_robot_commands_mean 0.0025734980027754227 set_robot_commands_median 0.0025734980027754227 set_robot_commands_min 0.0025734980027754227 sim_compute_performance-ego0_max 0.002254684329469562 sim_compute_performance-ego0_mean 0.002254684329469562 sim_compute_performance-ego0_median 0.002254684329469562 sim_compute_performance-ego0_min 0.002254684329469562 sim_compute_sim_state_max 0.009348226554227837 sim_compute_sim_state_mean 0.009348226554227837 sim_compute_sim_state_median 0.009348226554227837 sim_compute_sim_state_min 0.009348226554227837 sim_render-ego0_max 0.00427187144101321 sim_render-ego0_mean 0.00427187144101321 sim_render-ego0_median 0.00427187144101321 sim_render-ego0_min 0.00427187144101321 simulation-passed 1 step_physics_max 0.1680433296021961 step_physics_mean 0.1680433296021961 step_physics_median 0.1680433296021961 step_physics_min 0.1680433296021961 survival_time_max 13.600000000000058 survival_time_mean 13.600000000000058 survival_time_min 13.600000000000058
No reset possible 66128
14032
YU CHEN CBC V2, mar28 bc, mar31_apr6 anomaly aido-LFP-sim-validation
sim-3of4 success no gpu-production-spot-1-02
2021-04-09 14:08:59+00:00 2021-04-09 14:11:56+00:00 0:02:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.850000000000003 in-drivable-lane_median 1.149999999999996 driven_lanedir_consec_median 2.822418662877072 deviation-center-line_median 0.3903797841630981
other stats agent_compute-ego0_max 0.09650754446935172 agent_compute-ego0_mean 0.09650754446935172 agent_compute-ego0_median 0.09650754446935172 agent_compute-ego0_min 0.09650754446935172 complete-iteration_max 0.3611706651822485 complete-iteration_mean 0.3611706651822485 complete-iteration_median 0.3611706651822485 complete-iteration_min 0.3611706651822485 deviation-center-line_max 0.3903797841630981 deviation-center-line_mean 0.3903797841630981 deviation-center-line_min 0.3903797841630981 deviation-heading_max 1.9459160015359072 deviation-heading_mean 1.9459160015359072 deviation-heading_median 1.9459160015359072 deviation-heading_min 1.9459160015359072 driven_any_max 3.495141838164526 driven_any_mean 3.495141838164526 driven_any_median 3.495141838164526 driven_any_min 3.495141838164526 driven_lanedir_consec_max 2.822418662877072 driven_lanedir_consec_mean 2.822418662877072 driven_lanedir_consec_min 2.822418662877072 driven_lanedir_max 2.822418662877072 driven_lanedir_mean 2.822418662877072 driven_lanedir_median 2.822418662877072 driven_lanedir_min 2.822418662877072 get_duckie_state_max 0.02134928558811997 get_duckie_state_mean 0.02134928558811997 get_duckie_state_median 0.02134928558811997 get_duckie_state_min 0.02134928558811997 get_robot_state_max 0.0037730595078131167 get_robot_state_mean 0.0037730595078131167 get_robot_state_median 0.0037730595078131167 get_robot_state_min 0.0037730595078131167 get_state_dump_max 0.008161826567216353 get_state_dump_mean 0.008161826567216353 get_state_dump_median 0.008161826567216353 get_state_dump_min 0.008161826567216353 get_ui_image_max 0.03802625458649914 get_ui_image_mean 0.03802625458649914 get_ui_image_median 0.03802625458649914 get_ui_image_min 0.03802625458649914 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 1.149999999999996 in-drivable-lane_min 1.149999999999996 per-episodes details {"LFP-norm-techtrack-000-ego0": {"driven_any": 3.495141838164526, "get_ui_image": 0.03802625458649914, "step_physics": 0.1718314705473004, "survival_time": 9.850000000000003, "driven_lanedir": 2.822418662877072, "get_state_dump": 0.008161826567216353, "get_robot_state": 0.0037730595078131167, "sim_render-ego0": 0.004040651851230198, "get_duckie_state": 0.02134928558811997, "in-drivable-lane": 1.149999999999996, "deviation-heading": 1.9459160015359072, "agent_compute-ego0": 0.09650754446935172, "complete-iteration": 0.3611706651822485, "set_robot_commands": 0.0024418674334131104, "deviation-center-line": 0.3903797841630981, "driven_lanedir_consec": 2.822418662877072, "sim_compute_sim_state": 0.01284794012705485, "sim_compute_performance-ego0": 0.0020893667683456883}}set_robot_commands_max 0.0024418674334131104 set_robot_commands_mean 0.0024418674334131104 set_robot_commands_median 0.0024418674334131104 set_robot_commands_min 0.0024418674334131104 sim_compute_performance-ego0_max 0.0020893667683456883 sim_compute_performance-ego0_mean 0.0020893667683456883 sim_compute_performance-ego0_median 0.0020893667683456883 sim_compute_performance-ego0_min 0.0020893667683456883 sim_compute_sim_state_max 0.01284794012705485 sim_compute_sim_state_mean 0.01284794012705485 sim_compute_sim_state_median 0.01284794012705485 sim_compute_sim_state_min 0.01284794012705485 sim_render-ego0_max 0.004040651851230198 sim_render-ego0_mean 0.004040651851230198 sim_render-ego0_median 0.004040651851230198 sim_render-ego0_min 0.004040651851230198 simulation-passed 1 step_physics_max 0.1718314705473004 step_physics_mean 0.1718314705473004 step_physics_median 0.1718314705473004 step_physics_min 0.1718314705473004 survival_time_max 9.850000000000003 survival_time_mean 9.850000000000003 survival_time_min 9.850000000000003
No reset possible 66088
13513
AndrΓ‘s Kalapos Β ππΊreal-v1.0-3091-310 aido-LFV-sim-validation
sim-1of4 host-error no gpu-production-spot-1-02
2021-04-09 13:58:10+00:00 2021-04-09 14:08:28+00:00 0:10:18 Uncaught exception w [...] Uncaught exception while running Docker Compose:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
six.raise_from(e, None)
File "<string>", line 3, in raise_from
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
httplib_response = conn.getresponse()
File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
response.begin()
File "/usr/lib/python3.8/http/client.py", line 307, in begin
version, status, reason = self._read_status()
File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/lib/python3.8/socket.py", line 669, in readinto
return self._sock.recv_into(b)
socket.timeout: timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
retries = retries.increment(
File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
raise six.reraise(type(error), error, _stacktrace)
File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
raise value
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
httplib_response = self._make_request(
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1146, in run_one
stats = container.stats(stream=False)
File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
return self.client.api.stats(self.id, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
return f(self, resource_id, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
return self._result(self._get(url, params={'stream': False}),
File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
return f(self, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
return self.get(url, **self._set_request_timeout(kwargs))
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
return self.request('GET', url, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 65897
13593
Andras Beres 202-1 aido-LFV_multi-sim-validation
402 success no gpu-production-spot-1-02
2021-04-09 13:09:53+00:00 2021-04-09 13:57:57+00:00 0:48:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 41.99999999999975 in-drivable-lane_median 0.5500000000000043 driven_lanedir_consec_median 12.593708356652003 deviation-center-line_median 3.17688221834753
other stats agent_compute-ego0_max 0.027368413462183785 agent_compute-ego0_mean 0.02630675889484556 agent_compute-ego0_median 0.02630675889484556 agent_compute-ego0_min 0.025245104327507335 agent_compute-ego1_max 0.02325963940793093 agent_compute-ego1_mean 0.021361117127696217 agent_compute-ego1_median 0.021361117127696217 agent_compute-ego1_min 0.019462594847461493 agent_compute-ego2_max 0.022118828754903213 agent_compute-ego2_mean 0.020646384842268828 agent_compute-ego2_median 0.020646384842268828 agent_compute-ego2_min 0.019173940929634443 agent_compute-ego3_max 0.020340878933791797 agent_compute-ego3_mean 0.019357355001348373 agent_compute-ego3_median 0.019357355001348373 agent_compute-ego3_min 0.01837383106890495 complete-iteration_max 0.9311465796593312 complete-iteration_mean 0.8285011882207092 complete-iteration_median 0.8285011882207092 complete-iteration_min 0.7258557967820871 deviation-center-line_max 4.36426391100485 deviation-center-line_mean 3.22735939084556 deviation-center-line_min 2.300471697029999 deviation-heading_max 11.24195297238657 deviation-heading_mean 6.3085036813801 deviation-heading_median 5.86399088311939 deviation-heading_min 3.3710689067607893 driven_any_max 22.505112897383498 driven_any_mean 14.393412240237208 driven_any_median 13.148016157425744 driven_any_min 10.857545182725268 driven_lanedir_consec_max 21.23246817162177 driven_lanedir_consec_mean 13.868149980024302 driven_lanedir_consec_min 10.64994298166031 driven_lanedir_max 21.23246817162177 driven_lanedir_mean 13.868149980024302 driven_lanedir_median 12.593708356652003 driven_lanedir_min 10.64994298166031 get_duckie_state_max 3.3033259399754092e-06 get_duckie_state_mean 3.1691081899852533e-06 get_duckie_state_median 3.1691081899852533e-06 get_duckie_state_min 3.034890439995097e-06 get_robot_state_max 0.016313316430222026 get_robot_state_mean 0.015999533088339603 get_robot_state_median 0.015999533088339603 get_robot_state_min 0.015685749746457176 get_state_dump_max 0.010736210764616646 get_state_dump_mean 0.010661013172338016 get_state_dump_median 0.010661013172338016 get_state_dump_min 0.010585815580059384 get_ui_image_max 0.05411938710826066 get_ui_image_mean 0.050877602185192106 get_ui_image_median 0.050877602185192106 get_ui_image_min 0.04763581726212355 in-drivable-lane_max 2.2999999999999865 in-drivable-lane_mean 0.8062500000000015 in-drivable-lane_min 0.0 per-episodes details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 17.965589558795916, "get_ui_image": 0.04763581726212355, "step_physics": 0.4985884773365966, "survival_time": 35.8500000000001, "driven_lanedir": 17.573629289655322, "get_state_dump": 0.010736210764616646, "get_robot_state": 0.016313316430222026, "sim_render-ego0": 0.004321186987470451, "sim_render-ego1": 0.004143127491879264, "sim_render-ego2": 0.00412072079427395, "sim_render-ego3": 0.0041115473239866805, "get_duckie_state": 3.3033259399754092e-06, "in-drivable-lane": 0.4500000000000029, "deviation-heading": 4.5992298488982035, "agent_compute-ego0": 0.025245104327507335, "agent_compute-ego1": 0.02325963940793093, "agent_compute-ego2": 0.022118828754903213, "agent_compute-ego3": 0.01837383106890495, "complete-iteration": 0.7258557967820871, "set_robot_commands": 0.002542113527282035, "deviation-center-line": 2.300471697029999, "driven_lanedir_consec": 17.573629289655322, "sim_compute_sim_state": 0.02686701544812131, "sim_compute_performance-ego0": 0.002414611720773171, "sim_compute_performance-ego1": 0.0023202627150129143, "sim_compute_performance-ego2": 0.0022977085830773484, "sim_compute_performance-ego3": 0.0022906798838240854}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 11.220895235839588, "get_ui_image": 0.04763581726212355, "step_physics": 0.4985884773365966, "survival_time": 35.8500000000001, "driven_lanedir": 11.081393940726109, "get_state_dump": 0.010736210764616646, "get_robot_state": 0.016313316430222026, "sim_render-ego0": 0.004321186987470451, "sim_render-ego1": 0.004143127491879264, "sim_render-ego2": 0.00412072079427395, "sim_render-ego3": 0.0041115473239866805, "get_duckie_state": 3.3033259399754092e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.3710689067607893, "agent_compute-ego0": 0.025245104327507335, "agent_compute-ego1": 0.02325963940793093, "agent_compute-ego2": 0.022118828754903213, "agent_compute-ego3": 0.01837383106890495, "complete-iteration": 0.7258557967820871, "set_robot_commands": 0.002542113527282035, "deviation-center-line": 3.1983738649826936, "driven_lanedir_consec": 11.081393940726109, "sim_compute_sim_state": 0.02686701544812131, "sim_compute_performance-ego0": 0.002414611720773171, "sim_compute_performance-ego1": 0.0023202627150129143, "sim_compute_performance-ego2": 0.0022977085830773484, "sim_compute_performance-ego3": 0.0022906798838240854}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 10.857545182725268, "get_ui_image": 0.04763581726212355, "step_physics": 0.4985884773365966, "survival_time": 35.8500000000001, "driven_lanedir": 10.64994298166031, "get_state_dump": 0.010736210764616646, "get_robot_state": 0.016313316430222026, "sim_render-ego0": 0.004321186987470451, "sim_render-ego1": 0.004143127491879264, "sim_render-ego2": 0.00412072079427395, "sim_render-ego3": 0.0041115473239866805, "get_duckie_state": 3.3033259399754092e-06, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 3.610357908114036, "agent_compute-ego0": 0.025245104327507335, "agent_compute-ego1": 0.02325963940793093, "agent_compute-ego2": 0.022118828754903213, "agent_compute-ego3": 0.01837383106890495, "complete-iteration": 0.7258557967820871, "set_robot_commands": 0.002542113527282035, "deviation-center-line": 2.462117451170284, "driven_lanedir_consec": 10.64994298166031, "sim_compute_sim_state": 0.02686701544812131, "sim_compute_performance-ego0": 0.002414611720773171, "sim_compute_performance-ego1": 0.0023202627150129143, "sim_compute_performance-ego2": 0.0022977085830773484, "sim_compute_performance-ego3": 0.0022906798838240854}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 14.709919736822012, "get_ui_image": 0.04763581726212355, "step_physics": 0.4985884773365966, "survival_time": 35.8500000000001, "driven_lanedir": 14.45320891348207, "get_state_dump": 0.010736210764616646, "get_robot_state": 0.016313316430222026, "sim_render-ego0": 0.004321186987470451, "sim_render-ego1": 0.004143127491879264, "sim_render-ego2": 0.00412072079427395, "sim_render-ego3": 0.0041115473239866805, "get_duckie_state": 3.3033259399754092e-06, "in-drivable-lane": 0.20000000000000284, "deviation-heading": 4.3397854135411205, "agent_compute-ego0": 0.025245104327507335, "agent_compute-ego1": 0.02325963940793093, "agent_compute-ego2": 0.022118828754903213, "agent_compute-ego3": 0.01837383106890495, "complete-iteration": 0.7258557967820871, "set_robot_commands": 0.002542113527282035, "deviation-center-line": 2.6612846070622944, "driven_lanedir_consec": 14.45320891348207, "sim_compute_sim_state": 0.02686701544812131, "sim_compute_performance-ego0": 0.002414611720773171, "sim_compute_performance-ego1": 0.0023202627150129143, "sim_compute_performance-ego2": 0.0022977085830773484, "sim_compute_performance-ego3": 0.0022906798838240854}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 22.505112897383498, "get_ui_image": 0.05411938710826066, "step_physics": 0.6922467773880702, "survival_time": 48.1499999999994, "driven_lanedir": 21.23246817162177, "get_state_dump": 0.010585815580059384, "get_robot_state": 0.015685749746457176, "sim_render-ego0": 0.004146445588946837, "sim_render-ego1": 0.004119389779340182, "sim_render-ego2": 0.004107974376915896, "sim_render-ego3": 0.00407834369611938, "get_duckie_state": 3.034890439995097e-06, "in-drivable-lane": 2.2999999999999865, "deviation-heading": 7.7640754021523986, "agent_compute-ego0": 0.027368413462183785, "agent_compute-ego1": 0.019462594847461493, "agent_compute-ego2": 0.019173940929634443, "agent_compute-ego3": 0.020340878933791797, "complete-iteration": 0.9311465796593312, "set_robot_commands": 0.002527799596430355, "deviation-center-line": 3.4963581838987436, "driven_lanedir_consec": 21.23246817162177, "sim_compute_sim_state": 0.03634548879757956, "sim_compute_performance-ego0": 0.002304686550282838, "sim_compute_performance-ego1": 0.0022368144197582704, "sim_compute_performance-ego2": 0.002272171845574597, "sim_compute_performance-ego3": 0.002213444699884945}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.586112578029471, "get_ui_image": 0.05411938710826066, "step_physics": 0.6922467773880702, "survival_time": 48.1499999999994, "driven_lanedir": 10.953939461462518, "get_state_dump": 0.010585815580059384, "get_robot_state": 0.015685749746457176, "sim_render-ego0": 0.004146445588946837, "sim_render-ego1": 0.004119389779340182, "sim_render-ego2": 0.004107974376915896, "sim_render-ego3": 0.00407834369611938, "get_duckie_state": 3.034890439995097e-06, "in-drivable-lane": 1.150000000000002, "deviation-heading": 11.24195297238657, "agent_compute-ego0": 0.027368413462183785, "agent_compute-ego1": 0.019462594847461493, "agent_compute-ego2": 0.019173940929634443, "agent_compute-ego3": 0.020340878933791797, "complete-iteration": 0.9311465796593312, "set_robot_commands": 0.002527799596430355, "deviation-center-line": 4.180614839903248, "driven_lanedir_consec": 10.953939461462518, "sim_compute_sim_state": 0.03634548879757956, "sim_compute_performance-ego0": 0.002304686550282838, "sim_compute_performance-ego1": 0.0022368144197582704, "sim_compute_performance-ego2": 0.002272171845574597, "sim_compute_performance-ego3": 0.002213444699884945}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.954890892498108, "get_ui_image": 0.05411938710826066, "step_physics": 0.6922467773880702, "survival_time": 48.1499999999994, "driven_lanedir": 14.106022772577898, "get_state_dump": 0.010585815580059384, "get_robot_state": 0.015685749746457176, "sim_render-ego0": 0.004146445588946837, "sim_render-ego1": 0.004119389779340182, "sim_render-ego2": 0.004107974376915896, "sim_render-ego3": 0.00407834369611938, "get_duckie_state": 3.034890439995097e-06, "in-drivable-lane": 1.5000000000000124, "deviation-heading": 7.128751917340577, "agent_compute-ego0": 0.027368413462183785, "agent_compute-ego1": 0.019462594847461493, "agent_compute-ego2": 0.019173940929634443, "agent_compute-ego3": 0.020340878933791797, "complete-iteration": 0.9311465796593312, "set_robot_commands": 0.002527799596430355, "deviation-center-line": 3.155390571712366, "driven_lanedir_consec": 14.106022772577898, "sim_compute_sim_state": 0.03634548879757956, "sim_compute_performance-ego0": 0.002304686550282838, "sim_compute_performance-ego1": 0.0022368144197582704, "sim_compute_performance-ego2": 0.002272171845574597, "sim_compute_performance-ego3": 0.002213444699884945}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 11.347231839803808, "get_ui_image": 0.05411938710826066, "step_physics": 0.6922467773880702, "survival_time": 48.1499999999994, "driven_lanedir": 10.89459430900842, "get_state_dump": 0.010585815580059384, "get_robot_state": 0.015685749746457176, "sim_render-ego0": 0.004146445588946837, "sim_render-ego1": 0.004119389779340182, "sim_render-ego2": 0.004107974376915896, "sim_render-ego3": 0.00407834369611938, "get_duckie_state": 3.034890439995097e-06, "in-drivable-lane": 0.6500000000000057, "deviation-heading": 8.4128070818471, "agent_compute-ego0": 0.027368413462183785, "agent_compute-ego1": 0.019462594847461493, "agent_compute-ego2": 0.019173940929634443, "agent_compute-ego3": 0.020340878933791797, "complete-iteration": 0.9311465796593312, "set_robot_commands": 0.002527799596430355, "deviation-center-line": 4.36426391100485, "driven_lanedir_consec": 10.89459430900842, "sim_compute_sim_state": 0.03634548879757956, "sim_compute_performance-ego0": 0.002304686550282838, "sim_compute_performance-ego1": 0.0022368144197582704, "sim_compute_performance-ego2": 0.002272171845574597, "sim_compute_performance-ego3": 0.002213444699884945}}set_robot_commands_max 0.002542113527282035 set_robot_commands_mean 0.002534956561856195 set_robot_commands_median 0.002534956561856195 set_robot_commands_min 0.002527799596430355 sim_compute_performance-ego0_max 0.002414611720773171 sim_compute_performance-ego0_mean 0.0023596491355280047 sim_compute_performance-ego0_median 0.0023596491355280047 sim_compute_performance-ego0_min 0.002304686550282838 sim_compute_performance-ego1_max 0.0023202627150129143 sim_compute_performance-ego1_mean 0.0022785385673855926 sim_compute_performance-ego1_median 0.0022785385673855926 sim_compute_performance-ego1_min 0.0022368144197582704 sim_compute_performance-ego2_max 0.0022977085830773484 sim_compute_performance-ego2_mean 0.002284940214325973 sim_compute_performance-ego2_median 0.002284940214325973 sim_compute_performance-ego2_min 0.002272171845574597 sim_compute_performance-ego3_max 0.0022906798838240854 sim_compute_performance-ego3_mean 0.0022520622918545154 sim_compute_performance-ego3_median 0.0022520622918545154 sim_compute_performance-ego3_min 0.002213444699884945 sim_compute_sim_state_max 0.03634548879757956 sim_compute_sim_state_mean 0.03160625212285043 sim_compute_sim_state_median 0.03160625212285043 sim_compute_sim_state_min 0.02686701544812131 sim_render-ego0_max 0.004321186987470451 sim_render-ego0_mean 0.004233816288208644 sim_render-ego0_median 0.004233816288208644 sim_render-ego0_min 0.004146445588946837 sim_render-ego1_max 0.004143127491879264 sim_render-ego1_mean 0.004131258635609723 sim_render-ego1_median 0.004131258635609723 sim_render-ego1_min 0.004119389779340182 sim_render-ego2_max 0.00412072079427395 sim_render-ego2_mean 0.004114347585594923 sim_render-ego2_median 0.004114347585594923 sim_render-ego2_min 0.004107974376915896 sim_render-ego3_max 0.0041115473239866805 sim_render-ego3_mean 0.00409494551005303 sim_render-ego3_median 0.00409494551005303 sim_render-ego3_min 0.00407834369611938 simulation-passed 1 step_physics_max 0.6922467773880702 step_physics_mean 0.5954176273623334 step_physics_median 0.5954176273623334 step_physics_min 0.4985884773365966 survival_time_max 48.1499999999994 survival_time_mean 41.99999999999975 survival_time_min 35.8500000000001
No reset possible