Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 66319
13798
Nicholas Kostelnik template-random aido-hello-sim-validation
370 aborted no gpu-production-spot-1-03
2021-04-09 14:55:41+00:00 2021-04-09 14:56:04+00:00 0:00:23 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
raise create_api_error_from_http_exception(e)
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691 tag None
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 66310
13939
YU CHEN CBC Net v2 test - added mar 31 dataset aido-LFP-sim-validation
sim-0of4 success no gpu-production-spot-1-03
2021-04-09 14:53:55+00:00 2021-04-09 14:55:14+00:00 0:01:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.499999999999999 in-drivable-lane_median 0.0 driven_lanedir_consec_median 0.4892829262516568 deviation-center-line_median 0.19277303603280177
other stats agent_compute-ego0_max 0.09149227422826432 agent_compute-ego0_mean 0.09149227422826432 agent_compute-ego0_median 0.09149227422826432 agent_compute-ego0_min 0.09149227422826432 complete-iteration_max 0.32567581475949753 complete-iteration_mean 0.32567581475949753 complete-iteration_median 0.32567581475949753 complete-iteration_min 0.32567581475949753 deviation-center-line_max 0.19277303603280177 deviation-center-line_mean 0.19277303603280177 deviation-center-line_min 0.19277303603280177 deviation-heading_max 0.892285281949834 deviation-heading_mean 0.892285281949834 deviation-heading_median 0.892285281949834 deviation-heading_min 0.892285281949834 driven_any_max 0.5155629812243301 driven_any_mean 0.5155629812243301 driven_any_median 0.5155629812243301 driven_any_min 0.5155629812243301 driven_lanedir_consec_max 0.4892829262516568 driven_lanedir_consec_mean 0.4892829262516568 driven_lanedir_consec_min 0.4892829262516568 driven_lanedir_max 0.4892829262516568 driven_lanedir_mean 0.4892829262516568 driven_lanedir_median 0.4892829262516568 driven_lanedir_min 0.4892829262516568 get_duckie_state_max 0.020550601622637586 get_duckie_state_mean 0.020550601622637586 get_duckie_state_median 0.020550601622637586 get_duckie_state_min 0.020550601622637586 get_robot_state_max 0.0037148232553519457 get_robot_state_mean 0.0037148232553519457 get_robot_state_median 0.0037148232553519457 get_robot_state_min 0.0037148232553519457 get_state_dump_max 0.008094287386127547 get_state_dump_mean 0.008094287386127547 get_state_dump_median 0.008094287386127547 get_state_dump_min 0.008094287386127547 get_ui_image_max 0.039146072724286246 get_ui_image_mean 0.039146072724286246 get_ui_image_median 0.039146072724286246 get_ui_image_min 0.039146072724286246 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LFP-norm-zigzag-000-ego0": {"driven_any": 0.5155629812243301, "get_ui_image": 0.039146072724286246, "step_physics": 0.14539631675271428, "survival_time": 2.499999999999999, "driven_lanedir": 0.4892829262516568, "get_state_dump": 0.008094287386127547, "get_robot_state": 0.0037148232553519457, "sim_render-ego0": 0.003773207757987228, "get_duckie_state": 0.020550601622637586, "in-drivable-lane": 0.0, "deviation-heading": 0.892285281949834, "agent_compute-ego0": 0.09149227422826432, "complete-iteration": 0.32567581475949753, "set_robot_commands": 0.0023778092627431834, "deviation-center-line": 0.19277303603280177, "driven_lanedir_consec": 0.4892829262516568, "sim_compute_sim_state": 0.009067871991325829, "sim_compute_performance-ego0": 0.0019686596066344018}}set_robot_commands_max 0.0023778092627431834 set_robot_commands_mean 0.0023778092627431834 set_robot_commands_median 0.0023778092627431834 set_robot_commands_min 0.0023778092627431834 sim_compute_performance-ego0_max 0.0019686596066344018 sim_compute_performance-ego0_mean 0.0019686596066344018 sim_compute_performance-ego0_median 0.0019686596066344018 sim_compute_performance-ego0_min 0.0019686596066344018 sim_compute_sim_state_max 0.009067871991325829 sim_compute_sim_state_mean 0.009067871991325829 sim_compute_sim_state_median 0.009067871991325829 sim_compute_sim_state_min 0.009067871991325829 sim_render-ego0_max 0.003773207757987228 sim_render-ego0_mean 0.003773207757987228 sim_render-ego0_median 0.003773207757987228 sim_render-ego0_min 0.003773207757987228 simulation-passed 1 step_physics_max 0.14539631675271428 step_physics_mean 0.14539631675271428 step_physics_median 0.14539631675271428 step_physics_min 0.14539631675271428 survival_time_max 2.499999999999999 survival_time_mean 2.499999999999999 survival_time_min 2.499999999999999
No reset possible 66300
13912
YU CHEN CBC Net v2 - test aido-LFP-sim-validation
sim-0of4 success no gpu-production-spot-1-03
2021-04-09 14:52:11+00:00 2021-04-09 14:53:36+00:00 0:01:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.4499999999999993 in-drivable-lane_median 0.4500000000000003 driven_lanedir_consec_median 0.33683028089042233 deviation-center-line_median 0.18316877432201983
other stats agent_compute-ego0_max 0.1031407117843628 agent_compute-ego0_mean 0.1031407117843628 agent_compute-ego0_median 0.1031407117843628 agent_compute-ego0_min 0.1031407117843628 complete-iteration_max 0.3606362295150757 complete-iteration_mean 0.3606362295150757 complete-iteration_median 0.3606362295150757 complete-iteration_min 0.3606362295150757 deviation-center-line_max 0.18316877432201983 deviation-center-line_mean 0.18316877432201983 deviation-center-line_min 0.18316877432201983 deviation-heading_max 0.7851823650333535 deviation-heading_mean 0.7851823650333535 deviation-heading_median 0.7851823650333535 deviation-heading_min 0.7851823650333535 driven_any_max 0.5406210426888415 driven_any_mean 0.5406210426888415 driven_any_median 0.5406210426888415 driven_any_min 0.5406210426888415 driven_lanedir_consec_max 0.33683028089042233 driven_lanedir_consec_mean 0.33683028089042233 driven_lanedir_consec_min 0.33683028089042233 driven_lanedir_max 0.33683028089042233 driven_lanedir_mean 0.33683028089042233 driven_lanedir_median 0.33683028089042233 driven_lanedir_min 0.33683028089042233 get_duckie_state_max 0.022992892265319823 get_duckie_state_mean 0.022992892265319823 get_duckie_state_median 0.022992892265319823 get_duckie_state_min 0.022992892265319823 get_robot_state_max 0.004267172813415527 get_robot_state_mean 0.004267172813415527 get_robot_state_median 0.004267172813415527 get_robot_state_min 0.004267172813415527 get_state_dump_max 0.00926609992980957 get_state_dump_mean 0.00926609992980957 get_state_dump_median 0.00926609992980957 get_state_dump_min 0.00926609992980957 get_ui_image_max 0.041932377815246585 get_ui_image_mean 0.041932377815246585 get_ui_image_median 0.041932377815246585 get_ui_image_min 0.041932377815246585 in-drivable-lane_max 0.4500000000000003 in-drivable-lane_mean 0.4500000000000003 in-drivable-lane_min 0.4500000000000003 per-episodes details {"LFP-norm-zigzag-000-ego0": {"driven_any": 0.5406210426888415, "get_ui_image": 0.041932377815246585, "step_physics": 0.15966870307922362, "survival_time": 2.4499999999999993, "driven_lanedir": 0.33683028089042233, "get_state_dump": 0.00926609992980957, "get_robot_state": 0.004267172813415527, "sim_render-ego0": 0.004217853546142578, "get_duckie_state": 0.022992892265319823, "in-drivable-lane": 0.4500000000000003, "deviation-heading": 0.7851823650333535, "agent_compute-ego0": 0.1031407117843628, "complete-iteration": 0.3606362295150757, "set_robot_commands": 0.0026291847229003907, "deviation-center-line": 0.18316877432201983, "driven_lanedir_consec": 0.33683028089042233, "sim_compute_sim_state": 0.01008732795715332, "sim_compute_performance-ego0": 0.002304658889770508}}set_robot_commands_max 0.0026291847229003907 set_robot_commands_mean 0.0026291847229003907 set_robot_commands_median 0.0026291847229003907 set_robot_commands_min 0.0026291847229003907 sim_compute_performance-ego0_max 0.002304658889770508 sim_compute_performance-ego0_mean 0.002304658889770508 sim_compute_performance-ego0_median 0.002304658889770508 sim_compute_performance-ego0_min 0.002304658889770508 sim_compute_sim_state_max 0.01008732795715332 sim_compute_sim_state_mean 0.01008732795715332 sim_compute_sim_state_median 0.01008732795715332 sim_compute_sim_state_min 0.01008732795715332 sim_render-ego0_max 0.004217853546142578 sim_render-ego0_mean 0.004217853546142578 sim_render-ego0_median 0.004217853546142578 sim_render-ego0_min 0.004217853546142578 simulation-passed 1 step_physics_max 0.15966870307922362 step_physics_mean 0.15966870307922362 step_physics_median 0.15966870307922362 step_physics_min 0.15966870307922362 survival_time_max 2.4499999999999993 survival_time_mean 2.4499999999999993 survival_time_min 2.4499999999999993
No reset possible 66251
13697
Samuel Alexander template-pytorch aido-LF-sim-validation
sim-2of4 success no gpu-production-spot-1-03
2021-04-09 14:39:14+00:00 2021-04-09 14:50:24+00:00 0:11:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.283298420165983 survival_time_median 59.99999999999873 deviation-center-line_median 1.933673962505924 in-drivable-lane_median 38.34999999999907
other stats agent_compute-ego0_max 0.016035740024144207 agent_compute-ego0_mean 0.016035740024144207 agent_compute-ego0_median 0.016035740024144207 agent_compute-ego0_min 0.016035740024144207 complete-iteration_max 0.238956021428803 complete-iteration_mean 0.238956021428803 complete-iteration_median 0.238956021428803 complete-iteration_min 0.238956021428803 deviation-center-line_max 1.933673962505924 deviation-center-line_mean 1.933673962505924 deviation-center-line_min 1.933673962505924 deviation-heading_max 14.21613375207371 deviation-heading_mean 14.21613375207371 deviation-heading_median 14.21613375207371 deviation-heading_min 14.21613375207371 driven_any_max 8.665485278782231 driven_any_mean 8.665485278782231 driven_any_median 8.665485278782231 driven_any_min 8.665485278782231 driven_lanedir_consec_max 2.283298420165983 driven_lanedir_consec_mean 2.283298420165983 driven_lanedir_consec_min 2.283298420165983 driven_lanedir_max 2.283298420165983 driven_lanedir_mean 2.283298420165983 driven_lanedir_median 2.283298420165983 driven_lanedir_min 2.283298420165983 get_duckie_state_max 1.870027489705844e-06 get_duckie_state_mean 1.870027489705844e-06 get_duckie_state_median 1.870027489705844e-06 get_duckie_state_min 1.870027489705844e-06 get_robot_state_max 0.003966527814968341 get_robot_state_mean 0.003966527814968341 get_robot_state_median 0.003966527814968341 get_robot_state_min 0.003966527814968341 get_state_dump_max 0.005296504864784005 get_state_dump_mean 0.005296504864784005 get_state_dump_median 0.005296504864784005 get_state_dump_min 0.005296504864784005 get_ui_image_max 0.027644673156103028 get_ui_image_mean 0.027644673156103028 get_ui_image_median 0.027644673156103028 get_ui_image_min 0.027644673156103028 in-drivable-lane_max 38.34999999999907 in-drivable-lane_mean 38.34999999999907 in-drivable-lane_min 38.34999999999907 per-episodes details {"LF-norm-small_loop-000-ego0": {"driven_any": 8.665485278782231, "get_ui_image": 0.027644673156103028, "step_physics": 0.1709444701522713, "survival_time": 59.99999999999873, "driven_lanedir": 2.283298420165983, "get_state_dump": 0.005296504864784005, "get_robot_state": 0.003966527814968341, "sim_render-ego0": 0.004025205386667625, "get_duckie_state": 1.870027489705844e-06, "in-drivable-lane": 38.34999999999907, "deviation-heading": 14.21613375207371, "agent_compute-ego0": 0.016035740024144207, "complete-iteration": 0.238956021428803, "set_robot_commands": 0.002348505190071913, "deviation-center-line": 1.933673962505924, "driven_lanedir_consec": 2.283298420165983, "sim_compute_sim_state": 0.006516901678487125, "sim_compute_performance-ego0": 0.0020923973817213886}}set_robot_commands_max 0.002348505190071913 set_robot_commands_mean 0.002348505190071913 set_robot_commands_median 0.002348505190071913 set_robot_commands_min 0.002348505190071913 sim_compute_performance-ego0_max 0.0020923973817213886 sim_compute_performance-ego0_mean 0.0020923973817213886 sim_compute_performance-ego0_median 0.0020923973817213886 sim_compute_performance-ego0_min 0.0020923973817213886 sim_compute_sim_state_max 0.006516901678487125 sim_compute_sim_state_mean 0.006516901678487125 sim_compute_sim_state_median 0.006516901678487125 sim_compute_sim_state_min 0.006516901678487125 sim_render-ego0_max 0.004025205386667625 sim_render-ego0_mean 0.004025205386667625 sim_render-ego0_median 0.004025205386667625 sim_render-ego0_min 0.004025205386667625 simulation-passed 1 step_physics_max 0.1709444701522713 step_physics_mean 0.1709444701522713 step_physics_median 0.1709444701522713 step_physics_min 0.1709444701522713 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 66217
13911
YU CHEN CBC Net v2 - test aido-LF-sim-validation
sim-3of4 success no gpu-production-spot-1-03
2021-04-09 14:25:26+00:00 2021-04-09 14:38:55+00:00 0:13:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 17.67138341175619 survival_time_median 59.99999999999873 deviation-center-line_median 3.733799504574528 in-drivable-lane_median 8.849999999999834
other stats agent_compute-ego0_max 0.09301333621975584 agent_compute-ego0_mean 0.09301333621975584 agent_compute-ego0_median 0.09301333621975584 agent_compute-ego0_min 0.09301333621975584 complete-iteration_max 0.3640832480145534 complete-iteration_mean 0.3640832480145534 complete-iteration_median 0.3640832480145534 complete-iteration_min 0.3640832480145534 deviation-center-line_max 3.733799504574528 deviation-center-line_mean 3.733799504574528 deviation-center-line_min 3.733799504574528 deviation-heading_max 16.154796149665884 deviation-heading_mean 16.154796149665884 deviation-heading_median 16.154796149665884 deviation-heading_min 16.154796149665884 driven_any_max 22.450804762447632 driven_any_mean 22.450804762447632 driven_any_median 22.450804762447632 driven_any_min 22.450804762447632 driven_lanedir_consec_max 17.67138341175619 driven_lanedir_consec_mean 17.67138341175619 driven_lanedir_consec_min 17.67138341175619 driven_lanedir_max 17.67138341175619 driven_lanedir_mean 17.67138341175619 driven_lanedir_median 17.67138341175619 driven_lanedir_min 17.67138341175619 get_duckie_state_max 1.7122066983771662e-06 get_duckie_state_mean 1.7122066983771662e-06 get_duckie_state_median 1.7122066983771662e-06 get_duckie_state_min 1.7122066983771662e-06 get_robot_state_max 0.004066658456756312 get_robot_state_mean 0.004066658456756312 get_robot_state_median 0.004066658456756312 get_robot_state_min 0.004066658456756312 get_state_dump_max 0.0050469395719301095 get_state_dump_mean 0.0050469395719301095 get_state_dump_median 0.0050469395719301095 get_state_dump_min 0.0050469395719301095 get_ui_image_max 0.03961415274951182 get_ui_image_mean 0.03961415274951182 get_ui_image_median 0.03961415274951182 get_ui_image_min 0.03961415274951182 in-drivable-lane_max 8.849999999999834 in-drivable-lane_mean 8.849999999999834 in-drivable-lane_min 8.849999999999834 per-episodes details {"LF-norm-zigzag-000-ego0": {"driven_any": 22.450804762447632, "get_ui_image": 0.03961415274951182, "step_physics": 0.19889755927950617, "survival_time": 59.99999999999873, "driven_lanedir": 17.67138341175619, "get_state_dump": 0.0050469395719301095, "get_robot_state": 0.004066658456756312, "sim_render-ego0": 0.004172534966448959, "get_duckie_state": 1.7122066983771662e-06, "in-drivable-lane": 8.849999999999834, "deviation-heading": 16.154796149665884, "agent_compute-ego0": 0.09301333621975584, "complete-iteration": 0.3640832480145534, "set_robot_commands": 0.002580719526165431, "deviation-center-line": 3.733799504574528, "driven_lanedir_consec": 17.67138341175619, "sim_compute_sim_state": 0.014385192817097202, "sim_compute_performance-ego0": 0.0022090735979421647}}set_robot_commands_max 0.002580719526165431 set_robot_commands_mean 0.002580719526165431 set_robot_commands_median 0.002580719526165431 set_robot_commands_min 0.002580719526165431 sim_compute_performance-ego0_max 0.0022090735979421647 sim_compute_performance-ego0_mean 0.0022090735979421647 sim_compute_performance-ego0_median 0.0022090735979421647 sim_compute_performance-ego0_min 0.0022090735979421647 sim_compute_sim_state_max 0.014385192817097202 sim_compute_sim_state_mean 0.014385192817097202 sim_compute_sim_state_median 0.014385192817097202 sim_compute_sim_state_min 0.014385192817097202 sim_render-ego0_max 0.004172534966448959 sim_render-ego0_mean 0.004172534966448959 sim_render-ego0_median 0.004172534966448959 sim_render-ego0_min 0.004172534966448959 simulation-passed 1 step_physics_max 0.19889755927950617 step_physics_mean 0.19889755927950617 step_physics_median 0.19889755927950617 step_physics_min 0.19889755927950617 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 66197
13946
YU CHEN CBC Net v2 test - added APR 1 2 times anomaly + mar 28 bc_v1 aido-LFP-sim-validation
sim-1of4 success no gpu-production-spot-1-03
2021-04-09 14:23:01+00:00 2021-04-09 14:25:05+00:00 0:02:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.099999999999983 in-drivable-lane_median 3.699999999999988 driven_lanedir_consec_median 1.2175071304085108 deviation-center-line_median 0.2419230167925999
other stats agent_compute-ego0_max 0.1016193820046378 agent_compute-ego0_mean 0.1016193820046378 agent_compute-ego0_median 0.1016193820046378 agent_compute-ego0_min 0.1016193820046378 complete-iteration_max 0.2860103787242116 complete-iteration_mean 0.2860103787242116 complete-iteration_median 0.2860103787242116 complete-iteration_min 0.2860103787242116 deviation-center-line_max 0.2419230167925999 deviation-center-line_mean 0.2419230167925999 deviation-center-line_min 0.2419230167925999 deviation-heading_max 1.4360117713024034 deviation-heading_mean 1.4360117713024034 deviation-heading_median 1.4360117713024034 deviation-heading_min 1.4360117713024034 driven_any_max 2.1486472689125113 driven_any_mean 2.1486472689125113 driven_any_median 2.1486472689125113 driven_any_min 2.1486472689125113 driven_lanedir_consec_max 1.2175071304085108 driven_lanedir_consec_mean 1.2175071304085108 driven_lanedir_consec_min 1.2175071304085108 driven_lanedir_max 1.2175071304085108 driven_lanedir_mean 1.2175071304085108 driven_lanedir_median 1.2175071304085108 driven_lanedir_min 1.2175071304085108 get_duckie_state_max 0.004872068658575312 get_duckie_state_mean 0.004872068658575312 get_duckie_state_median 0.004872068658575312 get_duckie_state_min 0.004872068658575312 get_robot_state_max 0.004284283497950414 get_robot_state_mean 0.004284283497950414 get_robot_state_median 0.004284283497950414 get_robot_state_min 0.004284283497950414 get_state_dump_max 0.00614891018900838 get_state_dump_mean 0.00614891018900838 get_state_dump_median 0.00614891018900838 get_state_dump_min 0.00614891018900838 get_ui_image_max 0.029668914688217057 get_ui_image_mean 0.029668914688217057 get_ui_image_median 0.029668914688217057 get_ui_image_min 0.029668914688217057 in-drivable-lane_max 3.699999999999988 in-drivable-lane_mean 3.699999999999988 in-drivable-lane_min 3.699999999999988 per-episodes details {"LFP-norm-small_loop-000-ego0": {"driven_any": 2.1486472689125113, "get_ui_image": 0.029668914688217057, "step_physics": 0.1235214930314284, "survival_time": 7.099999999999983, "driven_lanedir": 1.2175071304085108, "get_state_dump": 0.00614891018900838, "get_robot_state": 0.004284283497950414, "sim_render-ego0": 0.004196327049415428, "get_duckie_state": 0.004872068658575312, "in-drivable-lane": 3.699999999999988, "deviation-heading": 1.4360117713024034, "agent_compute-ego0": 0.1016193820046378, "complete-iteration": 0.2860103787242116, "set_robot_commands": 0.002679943204759718, "deviation-center-line": 0.2419230167925999, "driven_lanedir_consec": 1.2175071304085108, "sim_compute_sim_state": 0.006655769748287601, "sim_compute_performance-ego0": 0.002256068316372958}}set_robot_commands_max 0.002679943204759718 set_robot_commands_mean 0.002679943204759718 set_robot_commands_median 0.002679943204759718 set_robot_commands_min 0.002679943204759718 sim_compute_performance-ego0_max 0.002256068316372958 sim_compute_performance-ego0_mean 0.002256068316372958 sim_compute_performance-ego0_median 0.002256068316372958 sim_compute_performance-ego0_min 0.002256068316372958 sim_compute_sim_state_max 0.006655769748287601 sim_compute_sim_state_mean 0.006655769748287601 sim_compute_sim_state_median 0.006655769748287601 sim_compute_sim_state_min 0.006655769748287601 sim_render-ego0_max 0.004196327049415428 sim_render-ego0_mean 0.004196327049415428 sim_render-ego0_median 0.004196327049415428 sim_render-ego0_min 0.004196327049415428 simulation-passed 1 step_physics_max 0.1235214930314284 step_physics_mean 0.1235214930314284 step_physics_median 0.1235214930314284 step_physics_min 0.1235214930314284 survival_time_max 7.099999999999983 survival_time_mean 7.099999999999983 survival_time_min 7.099999999999983
No reset possible 66188
13992
Frank (Chude) Qian Β π¨π¦CBC Net - MixTraining - Expert LF Human LFP aido-LFP-sim-validation
sim-1of4 success no gpu-production-spot-1-03
2021-04-09 14:20:42+00:00 2021-04-09 14:22:30+00:00 0:01:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.149999999999986 in-drivable-lane_median 1.6999999999999948 driven_lanedir_consec_median 1.6372643474784363 deviation-center-line_median 0.39010489094708134
other stats agent_compute-ego0_max 0.0653651722015873 agent_compute-ego0_mean 0.0653651722015873 agent_compute-ego0_median 0.0653651722015873 agent_compute-ego0_min 0.0653651722015873 complete-iteration_max 0.2615527299142653 complete-iteration_mean 0.2615527299142653 complete-iteration_median 0.2615527299142653 complete-iteration_min 0.2615527299142653 deviation-center-line_max 0.39010489094708134 deviation-center-line_mean 0.39010489094708134 deviation-center-line_min 0.39010489094708134 deviation-heading_max 1.4884544891321891 deviation-heading_mean 1.4884544891321891 deviation-heading_median 1.4884544891321891 deviation-heading_min 1.4884544891321891 driven_any_max 2.5868159185985085 driven_any_mean 2.5868159185985085 driven_any_median 2.5868159185985085 driven_any_min 2.5868159185985085 driven_lanedir_consec_max 1.6372643474784363 driven_lanedir_consec_mean 1.6372643474784363 driven_lanedir_consec_min 1.6372643474784363 driven_lanedir_max 1.6372643474784363 driven_lanedir_mean 1.6372643474784363 driven_lanedir_median 1.6372643474784363 driven_lanedir_min 1.6372643474784363 get_duckie_state_max 0.0049428689864373975 get_duckie_state_mean 0.0049428689864373975 get_duckie_state_median 0.0049428689864373975 get_duckie_state_min 0.0049428689864373975 get_robot_state_max 0.004370289464150706 get_robot_state_mean 0.004370289464150706 get_robot_state_median 0.004370289464150706 get_robot_state_min 0.004370289464150706 get_state_dump_max 0.006568035771769862 get_state_dump_mean 0.006568035771769862 get_state_dump_median 0.006568035771769862 get_state_dump_min 0.006568035771769862 get_ui_image_max 0.02963396426170103 get_ui_image_mean 0.02963396426170103 get_ui_image_median 0.02963396426170103 get_ui_image_min 0.02963396426170103 in-drivable-lane_max 1.6999999999999948 in-drivable-lane_mean 1.6999999999999948 in-drivable-lane_min 1.6999999999999948 per-episodes details {"LFP-norm-small_loop-000-ego0": {"driven_any": 2.5868159185985085, "get_ui_image": 0.02963396426170103, "step_physics": 0.13442578238825645, "survival_time": 6.149999999999986, "driven_lanedir": 1.6372643474784363, "get_state_dump": 0.006568035771769862, "get_robot_state": 0.004370289464150706, "sim_render-ego0": 0.004404489071138443, "get_duckie_state": 0.0049428689864373975, "in-drivable-lane": 1.6999999999999948, "deviation-heading": 1.4884544891321891, "agent_compute-ego0": 0.0653651722015873, "complete-iteration": 0.2615527299142653, "set_robot_commands": 0.002681074603911369, "deviation-center-line": 0.39010489094708134, "driven_lanedir_consec": 1.6372643474784363, "sim_compute_sim_state": 0.006685005080315375, "sim_compute_performance-ego0": 0.0023702344586772305}}set_robot_commands_max 0.002681074603911369 set_robot_commands_mean 0.002681074603911369 set_robot_commands_median 0.002681074603911369 set_robot_commands_min 0.002681074603911369 sim_compute_performance-ego0_max 0.0023702344586772305 sim_compute_performance-ego0_mean 0.0023702344586772305 sim_compute_performance-ego0_median 0.0023702344586772305 sim_compute_performance-ego0_min 0.0023702344586772305 sim_compute_sim_state_max 0.006685005080315375 sim_compute_sim_state_mean 0.006685005080315375 sim_compute_sim_state_median 0.006685005080315375 sim_compute_sim_state_min 0.006685005080315375 sim_render-ego0_max 0.004404489071138443 sim_render-ego0_mean 0.004404489071138443 sim_render-ego0_median 0.004404489071138443 sim_render-ego0_min 0.004404489071138443 simulation-passed 1 step_physics_max 0.13442578238825645 step_physics_mean 0.13442578238825645 step_physics_median 0.13442578238825645 step_physics_min 0.13442578238825645 survival_time_max 6.149999999999986 survival_time_mean 6.149999999999986 survival_time_min 6.149999999999986
No reset possible 66181
13992
Frank (Chude) Qian Β π¨π¦CBC Net - MixTraining - Expert LF Human LFP aido-LFP-sim-validation
sim-3of4 success no gpu-production-spot-1-03
2021-04-09 14:18:58+00:00 2021-04-09 14:20:29+00:00 0:01:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.1999999999999966 in-drivable-lane_median 0.0 driven_lanedir_consec_median 1.1081929058436897 deviation-center-line_median 0.20450604089572008
other stats agent_compute-ego0_max 0.05877131682175856 agent_compute-ego0_mean 0.05877131682175856 agent_compute-ego0_median 0.05877131682175856 agent_compute-ego0_min 0.05877131682175856 complete-iteration_max 0.290569334763747 complete-iteration_mean 0.290569334763747 complete-iteration_median 0.290569334763747 complete-iteration_min 0.290569334763747 deviation-center-line_max 0.20450604089572008 deviation-center-line_mean 0.20450604089572008 deviation-center-line_min 0.20450604089572008 deviation-heading_max 0.526746341930796 deviation-heading_mean 0.526746341930796 deviation-heading_median 0.526746341930796 deviation-heading_min 0.526746341930796 driven_any_max 1.1287336441969378 driven_any_mean 1.1287336441969378 driven_any_median 1.1287336441969378 driven_any_min 1.1287336441969378 driven_lanedir_consec_max 1.1081929058436897 driven_lanedir_consec_mean 1.1081929058436897 driven_lanedir_consec_min 1.1081929058436897 driven_lanedir_max 1.1081929058436897 driven_lanedir_mean 1.1081929058436897 driven_lanedir_median 1.1081929058436897 driven_lanedir_min 1.1081929058436897 get_duckie_state_max 0.02280290310199444 get_duckie_state_mean 0.02280290310199444 get_duckie_state_median 0.02280290310199444 get_duckie_state_min 0.02280290310199444 get_robot_state_max 0.004054718751173753 get_robot_state_mean 0.004054718751173753 get_robot_state_median 0.004054718751173753 get_robot_state_min 0.004054718751173753 get_state_dump_max 0.0089691712306096 get_state_dump_mean 0.0089691712306096 get_state_dump_median 0.0089691712306096 get_state_dump_min 0.0089691712306096 get_ui_image_max 0.03885557834918683 get_ui_image_mean 0.03885557834918683 get_ui_image_median 0.03885557834918683 get_ui_image_min 0.03885557834918683 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LFP-norm-techtrack-000-ego0": {"driven_any": 1.1287336441969378, "get_ui_image": 0.03885557834918683, "step_physics": 0.1350358119377723, "survival_time": 3.1999999999999966, "driven_lanedir": 1.1081929058436897, "get_state_dump": 0.0089691712306096, "get_robot_state": 0.004054718751173753, "sim_render-ego0": 0.004312603290264423, "get_duckie_state": 0.02280290310199444, "in-drivable-lane": 0.0, "deviation-heading": 0.526746341930796, "agent_compute-ego0": 0.05877131682175856, "complete-iteration": 0.290569334763747, "set_robot_commands": 0.002640665494478666, "deviation-center-line": 0.20450604089572008, "driven_lanedir_consec": 1.1081929058436897, "sim_compute_sim_state": 0.01275152059701773, "sim_compute_performance-ego0": 0.002254970257098858}}set_robot_commands_max 0.002640665494478666 set_robot_commands_mean 0.002640665494478666 set_robot_commands_median 0.002640665494478666 set_robot_commands_min 0.002640665494478666 sim_compute_performance-ego0_max 0.002254970257098858 sim_compute_performance-ego0_mean 0.002254970257098858 sim_compute_performance-ego0_median 0.002254970257098858 sim_compute_performance-ego0_min 0.002254970257098858 sim_compute_sim_state_max 0.01275152059701773 sim_compute_sim_state_mean 0.01275152059701773 sim_compute_sim_state_median 0.01275152059701773 sim_compute_sim_state_min 0.01275152059701773 sim_render-ego0_max 0.004312603290264423 sim_render-ego0_mean 0.004312603290264423 sim_render-ego0_median 0.004312603290264423 sim_render-ego0_min 0.004312603290264423 simulation-passed 1 step_physics_max 0.1350358119377723 step_physics_mean 0.1350358119377723 step_physics_median 0.1350358119377723 step_physics_min 0.1350358119377723 survival_time_max 3.1999999999999966 survival_time_mean 3.1999999999999966 survival_time_min 3.1999999999999966
No reset possible 66151
13996
Frank (Chude) Qian Β π¨π¦baseline-behavior-cloning aido-LFP-sim-validation
sim-1of4 success no gpu-production-spot-1-03
2021-04-09 14:14:06+00:00 2021-04-09 14:18:34+00:00 0:04:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 24.750000000000217 in-drivable-lane_median 4.5500000000000504 driven_lanedir_consec_median 4.496694134904974 deviation-center-line_median 1.3794442412069925
other stats agent_compute-ego0_max 0.040684482743663174 agent_compute-ego0_mean 0.040684482743663174 agent_compute-ego0_median 0.040684482743663174 agent_compute-ego0_min 0.040684482743663174 complete-iteration_max 0.21425207343793684 complete-iteration_mean 0.21425207343793684 complete-iteration_median 0.21425207343793684 complete-iteration_min 0.21425207343793684 deviation-center-line_max 1.3794442412069925 deviation-center-line_mean 1.3794442412069925 deviation-center-line_min 1.3794442412069925 deviation-heading_max 6.773061816016197 deviation-heading_mean 6.773061816016197 deviation-heading_median 6.773061816016197 deviation-heading_min 6.773061816016197 driven_any_max 5.798291685615088 driven_any_mean 5.798291685615088 driven_any_median 5.798291685615088 driven_any_min 5.798291685615088 driven_lanedir_consec_max 4.496694134904974 driven_lanedir_consec_mean 4.496694134904974 driven_lanedir_consec_min 4.496694134904974 driven_lanedir_max 4.496694134904974 driven_lanedir_mean 4.496694134904974 driven_lanedir_median 4.496694134904974 driven_lanedir_min 4.496694134904974 get_duckie_state_max 0.004542437291914417 get_duckie_state_mean 0.004542437291914417 get_duckie_state_median 0.004542437291914417 get_duckie_state_min 0.004542437291914417 get_robot_state_max 0.003984340736942906 get_robot_state_mean 0.003984340736942906 get_robot_state_median 0.003984340736942906 get_robot_state_min 0.003984340736942906 get_state_dump_max 0.005965188626320132 get_state_dump_mean 0.005965188626320132 get_state_dump_median 0.005965188626320132 get_state_dump_min 0.005965188626320132 get_ui_image_max 0.02905339387155348 get_ui_image_mean 0.02905339387155348 get_ui_image_median 0.02905339387155348 get_ui_image_min 0.02905339387155348 in-drivable-lane_max 4.5500000000000504 in-drivable-lane_mean 4.5500000000000504 in-drivable-lane_min 4.5500000000000504 per-episodes details {"LFP-norm-small_loop-000-ego0": {"driven_any": 5.798291685615088, "get_ui_image": 0.02905339387155348, "step_physics": 0.11487049969934648, "survival_time": 24.750000000000217, "driven_lanedir": 4.496694134904974, "get_state_dump": 0.005965188626320132, "get_robot_state": 0.003984340736942906, "sim_render-ego0": 0.0040069039790861065, "get_duckie_state": 0.004542437291914417, "in-drivable-lane": 4.5500000000000504, "deviation-heading": 6.773061816016197, "agent_compute-ego0": 0.040684482743663174, "complete-iteration": 0.21425207343793684, "set_robot_commands": 0.002409425473982288, "deviation-center-line": 1.3794442412069925, "driven_lanedir_consec": 4.496694134904974, "sim_compute_sim_state": 0.006531822585290478, "sim_compute_performance-ego0": 0.0021158548132065805}}set_robot_commands_max 0.002409425473982288 set_robot_commands_mean 0.002409425473982288 set_robot_commands_median 0.002409425473982288 set_robot_commands_min 0.002409425473982288 sim_compute_performance-ego0_max 0.0021158548132065805 sim_compute_performance-ego0_mean 0.0021158548132065805 sim_compute_performance-ego0_median 0.0021158548132065805 sim_compute_performance-ego0_min 0.0021158548132065805 sim_compute_sim_state_max 0.006531822585290478 sim_compute_sim_state_mean 0.006531822585290478 sim_compute_sim_state_median 0.006531822585290478 sim_compute_sim_state_min 0.006531822585290478 sim_render-ego0_max 0.0040069039790861065 sim_render-ego0_mean 0.0040069039790861065 sim_render-ego0_median 0.0040069039790861065 sim_render-ego0_min 0.0040069039790861065 simulation-passed 1 step_physics_max 0.11487049969934648 step_physics_mean 0.11487049969934648 step_physics_median 0.11487049969934648 step_physics_min 0.11487049969934648 survival_time_max 24.750000000000217 survival_time_mean 24.750000000000217 survival_time_min 24.750000000000217
No reset possible 66140
14032
YU CHEN CBC V2, mar28 bc, mar31_apr6 anomaly aido-LFP-sim-validation
sim-0of4 success no gpu-production-spot-1-03
2021-04-09 14:11:56+00:00 2021-04-09 14:13:24+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.499999999999999 in-drivable-lane_median 0.20000000000000015 driven_lanedir_consec_median 0.4444774667224096 deviation-center-line_median 0.2341197363357758
other stats agent_compute-ego0_max 0.10732439920014028 agent_compute-ego0_mean 0.10732439920014028 agent_compute-ego0_median 0.10732439920014028 agent_compute-ego0_min 0.10732439920014028 complete-iteration_max 0.38072503781786154 complete-iteration_mean 0.38072503781786154 complete-iteration_median 0.38072503781786154 complete-iteration_min 0.38072503781786154 deviation-center-line_max 0.2341197363357758 deviation-center-line_mean 0.2341197363357758 deviation-center-line_min 0.2341197363357758 deviation-heading_max 0.6748260988584457 deviation-heading_mean 0.6748260988584457 deviation-heading_median 0.6748260988584457 deviation-heading_min 0.6748260988584457 driven_any_max 0.5465902205378907 driven_any_mean 0.5465902205378907 driven_any_median 0.5465902205378907 driven_any_min 0.5465902205378907 driven_lanedir_consec_max 0.4444774667224096 driven_lanedir_consec_mean 0.4444774667224096 driven_lanedir_consec_min 0.4444774667224096 driven_lanedir_max 0.4444774667224096 driven_lanedir_mean 0.4444774667224096 driven_lanedir_median 0.4444774667224096 driven_lanedir_min 0.4444774667224096 get_duckie_state_max 0.02390444512460746 get_duckie_state_mean 0.02390444512460746 get_duckie_state_median 0.02390444512460746 get_duckie_state_min 0.02390444512460746 get_robot_state_max 0.0043200418060901115 get_robot_state_mean 0.0043200418060901115 get_robot_state_median 0.0043200418060901115 get_robot_state_min 0.0043200418060901115 get_state_dump_max 0.009158821666941925 get_state_dump_mean 0.009158821666941925 get_state_dump_median 0.009158821666941925 get_state_dump_min 0.009158821666941925 get_ui_image_max 0.0440824873307172 get_ui_image_mean 0.0440824873307172 get_ui_image_median 0.0440824873307172 get_ui_image_min 0.0440824873307172 in-drivable-lane_max 0.20000000000000015 in-drivable-lane_mean 0.20000000000000015 in-drivable-lane_min 0.20000000000000015 per-episodes details {"LFP-norm-zigzag-000-ego0": {"driven_any": 0.5465902205378907, "get_ui_image": 0.0440824873307172, "step_physics": 0.171586742588118, "survival_time": 2.499999999999999, "driven_lanedir": 0.4444774667224096, "get_state_dump": 0.009158821666941925, "get_robot_state": 0.0043200418060901115, "sim_render-ego0": 0.004522122588812136, "get_duckie_state": 0.02390444512460746, "in-drivable-lane": 0.20000000000000015, "deviation-heading": 0.6748260988584457, "agent_compute-ego0": 0.10732439920014028, "complete-iteration": 0.38072503781786154, "set_robot_commands": 0.0027340393440396177, "deviation-center-line": 0.2341197363357758, "driven_lanedir_consec": 0.4444774667224096, "sim_compute_sim_state": 0.010544561872295305, "sim_compute_performance-ego0": 0.002427059061387006}}set_robot_commands_max 0.0027340393440396177 set_robot_commands_mean 0.0027340393440396177 set_robot_commands_median 0.0027340393440396177 set_robot_commands_min 0.0027340393440396177 sim_compute_performance-ego0_max 0.002427059061387006 sim_compute_performance-ego0_mean 0.002427059061387006 sim_compute_performance-ego0_median 0.002427059061387006 sim_compute_performance-ego0_min 0.002427059061387006 sim_compute_sim_state_max 0.010544561872295305 sim_compute_sim_state_mean 0.010544561872295305 sim_compute_sim_state_median 0.010544561872295305 sim_compute_sim_state_min 0.010544561872295305 sim_render-ego0_max 0.004522122588812136 sim_render-ego0_mean 0.004522122588812136 sim_render-ego0_median 0.004522122588812136 sim_render-ego0_min 0.004522122588812136 simulation-passed 1 step_physics_max 0.171586742588118 step_physics_mean 0.171586742588118 step_physics_median 0.171586742588118 step_physics_min 0.171586742588118 survival_time_max 2.499999999999999 survival_time_mean 2.499999999999999 survival_time_min 2.499999999999999
No reset possible 66129
14032
YU CHEN CBC V2, mar28 bc, mar31_apr6 anomaly aido-LFP-sim-validation
sim-2of4 success no gpu-production-spot-1-03
2021-04-09 14:09:31+00:00 2021-04-09 14:11:24+00:00 0:01:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.849999999999987 in-drivable-lane_median 0.0 driven_lanedir_consec_median 2.163990316265352 deviation-center-line_median 0.5186014384134997
other stats agent_compute-ego0_max 0.09467797158128125 agent_compute-ego0_mean 0.09467797158128125 agent_compute-ego0_median 0.09467797158128125 agent_compute-ego0_min 0.09467797158128125 complete-iteration_max 0.3147408719790184 complete-iteration_mean 0.3147408719790184 complete-iteration_median 0.3147408719790184 complete-iteration_min 0.3147408719790184 deviation-center-line_max 0.5186014384134997 deviation-center-line_mean 0.5186014384134997 deviation-center-line_min 0.5186014384134997 deviation-heading_max 1.22785187640114 deviation-heading_mean 1.22785187640114 deviation-heading_median 1.22785187640114 deviation-heading_min 1.22785187640114 driven_any_max 2.2149453889767527 driven_any_mean 2.2149453889767527 driven_any_median 2.2149453889767527 driven_any_min 2.2149453889767527 driven_lanedir_consec_max 2.163990316265352 driven_lanedir_consec_mean 2.163990316265352 driven_lanedir_consec_min 2.163990316265352 driven_lanedir_max 2.163990316265352 driven_lanedir_mean 2.163990316265352 driven_lanedir_median 2.163990316265352 driven_lanedir_min 2.163990316265352 get_duckie_state_max 0.025250966266050175 get_duckie_state_mean 0.025250966266050175 get_duckie_state_median 0.025250966266050175 get_duckie_state_min 0.025250966266050175 get_robot_state_max 0.0039174354682534425 get_robot_state_mean 0.0039174354682534425 get_robot_state_median 0.0039174354682534425 get_robot_state_min 0.0039174354682534425 get_state_dump_max 0.008992964938535528 get_state_dump_mean 0.008992964938535528 get_state_dump_median 0.008992964938535528 get_state_dump_min 0.008992964938535528 get_ui_image_max 0.03364233041213731 get_ui_image_mean 0.03364233041213731 get_ui_image_median 0.03364233041213731 get_ui_image_min 0.03364233041213731 in-drivable-lane_max 0.0 in-drivable-lane_mean 0.0 in-drivable-lane_min 0.0 per-episodes details {"LFP-norm-loop-000-ego0": {"driven_any": 2.2149453889767527, "get_ui_image": 0.03364233041213731, "step_physics": 0.13188978777093402, "survival_time": 5.849999999999987, "driven_lanedir": 2.163990316265352, "get_state_dump": 0.008992964938535528, "get_robot_state": 0.0039174354682534425, "sim_render-ego0": 0.003904954861786406, "get_duckie_state": 0.025250966266050175, "in-drivable-lane": 0.0, "deviation-heading": 1.22785187640114, "agent_compute-ego0": 0.09467797158128125, "complete-iteration": 0.3147408719790184, "set_robot_commands": 0.0024426488553063344, "deviation-center-line": 0.5186014384134997, "driven_lanedir_consec": 2.163990316265352, "sim_compute_sim_state": 0.007865992643065372, "sim_compute_performance-ego0": 0.0020569502297094313}}set_robot_commands_max 0.0024426488553063344 set_robot_commands_mean 0.0024426488553063344 set_robot_commands_median 0.0024426488553063344 set_robot_commands_min 0.0024426488553063344 sim_compute_performance-ego0_max 0.0020569502297094313 sim_compute_performance-ego0_mean 0.0020569502297094313 sim_compute_performance-ego0_median 0.0020569502297094313 sim_compute_performance-ego0_min 0.0020569502297094313 sim_compute_sim_state_max 0.007865992643065372 sim_compute_sim_state_mean 0.007865992643065372 sim_compute_sim_state_median 0.007865992643065372 sim_compute_sim_state_min 0.007865992643065372 sim_render-ego0_max 0.003904954861786406 sim_render-ego0_mean 0.003904954861786406 sim_render-ego0_median 0.003904954861786406 sim_render-ego0_min 0.003904954861786406 simulation-passed 1 step_physics_max 0.13188978777093402 step_physics_mean 0.13188978777093402 step_physics_median 0.13188978777093402 step_physics_min 0.13188978777093402 survival_time_max 5.849999999999987 survival_time_mean 5.849999999999987 survival_time_min 5.849999999999987
No reset possible 66047
13578
MΓ‘rton Tim Β ππΊ3626 aido-LFV_multi-sim-validation
402 host-error no gpu-production-spot-1-03
2021-04-09 13:48:08+00:00 2021-04-09 14:09:19+00:00 0:21:11 Uncaught exception w [...] Uncaught exception while running Docker Compose:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
six.raise_from(e, None)
File "<string>", line 3, in raise_from
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
httplib_response = conn.getresponse()
File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
response.begin()
File "/usr/lib/python3.8/http/client.py", line 307, in begin
version, status, reason = self._read_status()
File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
File "/usr/lib/python3.8/socket.py", line 669, in readinto
return self._sock.recv_into(b)
socket.timeout: timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
retries = retries.increment(
File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
raise six.reraise(type(error), error, _stacktrace)
File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
raise value
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
httplib_response = self._make_request(
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1146, in run_one
stats = container.stats(stream=False)
File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
return self.client.api.stats(self.id, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
return f(self, resource_id, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
return self._result(self._get(url, params={'stream': False}),
File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
return f(self, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
return self.get(url, **self._set_request_timeout(kwargs))
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
return self.request('GET', url, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 66025
13945
YU CHEN CBC Net v2 test - added APR 1 2 times anomaly + mar 28 bc_v1 aido-LF-sim-validation
sim-2of4 success no gpu-production-spot-1-03
2021-04-09 13:37:06+00:00 2021-04-09 13:47:55+00:00 0:10:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 14.219990291977169 survival_time_median 59.99999999999873 deviation-center-line_median 3.2043384787677076 in-drivable-lane_median 19.049999999999716
other stats agent_compute-ego0_max 0.09722801648409142 agent_compute-ego0_mean 0.09722801648409142 agent_compute-ego0_median 0.09722801648409142 agent_compute-ego0_min 0.09722801648409142 complete-iteration_max 0.2988754382836233 complete-iteration_mean 0.2988754382836233 complete-iteration_median 0.2988754382836233 complete-iteration_min 0.2988754382836233 deviation-center-line_max 3.2043384787677076 deviation-center-line_mean 3.2043384787677076 deviation-center-line_min 3.2043384787677076 deviation-heading_max 18.310466176596144 deviation-heading_mean 18.310466176596144 deviation-heading_median 18.310466176596144 deviation-heading_min 18.310466176596144 driven_any_max 23.01441289575472 driven_any_mean 23.01441289575472 driven_any_median 23.01441289575472 driven_any_min 23.01441289575472 driven_lanedir_consec_max 14.219990291977169 driven_lanedir_consec_mean 14.219990291977169 driven_lanedir_consec_min 14.219990291977169 driven_lanedir_max 14.219990291977169 driven_lanedir_mean 14.219990291977169 driven_lanedir_median 14.219990291977169 driven_lanedir_min 14.219990291977169 get_duckie_state_max 1.6060002538981187e-06 get_duckie_state_mean 1.6060002538981187e-06 get_duckie_state_median 1.6060002538981187e-06 get_duckie_state_min 1.6060002538981187e-06 get_robot_state_max 0.004347946324217429 get_robot_state_mean 0.004347946324217429 get_robot_state_median 0.004347946324217429 get_robot_state_min 0.004347946324217429 get_state_dump_max 0.005271305549551704 get_state_dump_mean 0.005271305549551704 get_state_dump_median 0.005271305549551704 get_state_dump_min 0.005271305549551704 get_ui_image_max 0.02953078466887081 get_ui_image_mean 0.02953078466887081 get_ui_image_median 0.02953078466887081 get_ui_image_min 0.02953078466887081 in-drivable-lane_max 19.049999999999716 in-drivable-lane_mean 19.049999999999716 in-drivable-lane_min 19.049999999999716 per-episodes details {"LF-norm-small_loop-000-ego0": {"driven_any": 23.01441289575472, "get_ui_image": 0.02953078466887081, "step_physics": 0.14576760219793136, "survival_time": 59.99999999999873, "driven_lanedir": 14.219990291977169, "get_state_dump": 0.005271305549551704, "get_robot_state": 0.004347946324217429, "sim_render-ego0": 0.004390444187796384, "get_duckie_state": 1.6060002538981187e-06, "in-drivable-lane": 19.049999999999716, "deviation-heading": 18.310466176596144, "agent_compute-ego0": 0.09722801648409142, "complete-iteration": 0.2988754382836233, "set_robot_commands": 0.002750400500333279, "deviation-center-line": 3.2043384787677076, "driven_lanedir_consec": 14.219990291977169, "sim_compute_sim_state": 0.007105452929011591, "sim_compute_performance-ego0": 0.002383002035822301}}set_robot_commands_max 0.002750400500333279 set_robot_commands_mean 0.002750400500333279 set_robot_commands_median 0.002750400500333279 set_robot_commands_min 0.002750400500333279 sim_compute_performance-ego0_max 0.002383002035822301 sim_compute_performance-ego0_mean 0.002383002035822301 sim_compute_performance-ego0_median 0.002383002035822301 sim_compute_performance-ego0_min 0.002383002035822301 sim_compute_sim_state_max 0.007105452929011591 sim_compute_sim_state_mean 0.007105452929011591 sim_compute_sim_state_median 0.007105452929011591 sim_compute_sim_state_min 0.007105452929011591 sim_render-ego0_max 0.004390444187796384 sim_render-ego0_mean 0.004390444187796384 sim_render-ego0_median 0.004390444187796384 sim_render-ego0_min 0.004390444187796384 simulation-passed 1 step_physics_max 0.14576760219793136 step_physics_mean 0.14576760219793136 step_physics_median 0.14576760219793136 step_physics_min 0.14576760219793136 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 65958
14031
YU CHEN CBC V2, mar28 bc, mar31_apr6 anomaly aido-LF-sim-validation
sim-1of4 success no gpu-production-spot-1-03
2021-04-09 13:23:50+00:00 2021-04-09 13:36:34+00:00 0:12:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 16.04583389521964 survival_time_median 59.99999999999873 deviation-center-line_median 3.4703236301652756 in-drivable-lane_median 19.349999999999625
other stats agent_compute-ego0_max 0.08779039490133599 agent_compute-ego0_mean 0.08779039490133599 agent_compute-ego0_median 0.08779039490133599 agent_compute-ego0_min 0.08779039490133599 complete-iteration_max 0.3197635881708226 complete-iteration_mean 0.3197635881708226 complete-iteration_median 0.3197635881708226 complete-iteration_min 0.3197635881708226 deviation-center-line_max 3.4703236301652756 deviation-center-line_mean 3.4703236301652756 deviation-center-line_min 3.4703236301652756 deviation-heading_max 12.618845824011114 deviation-heading_mean 12.618845824011114 deviation-heading_median 12.618845824011114 deviation-heading_min 12.618845824011114 driven_any_max 25.00964385587135 driven_any_mean 25.00964385587135 driven_any_median 25.00964385587135 driven_any_min 25.00964385587135 driven_lanedir_consec_max 16.04583389521964 driven_lanedir_consec_mean 16.04583389521964 driven_lanedir_consec_min 16.04583389521964 driven_lanedir_max 16.04583389521964 driven_lanedir_mean 16.04583389521964 driven_lanedir_median 16.04583389521964 driven_lanedir_min 16.04583389521964 get_duckie_state_max 1.219885236119152e-06 get_duckie_state_mean 1.219885236119152e-06 get_duckie_state_median 1.219885236119152e-06 get_duckie_state_min 1.219885236119152e-06 get_robot_state_max 0.003852026349400402 get_robot_state_mean 0.003852026349400402 get_robot_state_median 0.003852026349400402 get_robot_state_min 0.003852026349400402 get_state_dump_max 0.004739570379455719 get_state_dump_mean 0.004739570379455719 get_state_dump_median 0.004739570379455719 get_state_dump_min 0.004739570379455719 get_ui_image_max 0.035018055564060895 get_ui_image_mean 0.035018055564060895 get_ui_image_median 0.035018055564060895 get_ui_image_min 0.035018055564060895 in-drivable-lane_max 19.349999999999625 in-drivable-lane_mean 19.349999999999625 in-drivable-lane_min 19.349999999999625 per-episodes details {"LF-norm-techtrack-000-ego0": {"driven_any": 25.00964385587135, "get_ui_image": 0.035018055564060895, "step_physics": 0.16697528261030645, "survival_time": 59.99999999999873, "driven_lanedir": 16.04583389521964, "get_state_dump": 0.004739570379455719, "get_robot_state": 0.003852026349400402, "sim_render-ego0": 0.004037491387868305, "get_duckie_state": 1.219885236119152e-06, "in-drivable-lane": 19.349999999999625, "deviation-heading": 12.618845824011114, "agent_compute-ego0": 0.08779039490133599, "complete-iteration": 0.3197635881708226, "set_robot_commands": 0.002514328587362907, "deviation-center-line": 3.4703236301652756, "driven_lanedir_consec": 16.04583389521964, "sim_compute_sim_state": 0.012611495763634168, "sim_compute_performance-ego0": 0.0021402152948435103}}set_robot_commands_max 0.002514328587362907 set_robot_commands_mean 0.002514328587362907 set_robot_commands_median 0.002514328587362907 set_robot_commands_min 0.002514328587362907 sim_compute_performance-ego0_max 0.0021402152948435103 sim_compute_performance-ego0_mean 0.0021402152948435103 sim_compute_performance-ego0_median 0.0021402152948435103 sim_compute_performance-ego0_min 0.0021402152948435103 sim_compute_sim_state_max 0.012611495763634168 sim_compute_sim_state_mean 0.012611495763634168 sim_compute_sim_state_median 0.012611495763634168 sim_compute_sim_state_min 0.012611495763634168 sim_render-ego0_max 0.004037491387868305 sim_render-ego0_mean 0.004037491387868305 sim_render-ego0_median 0.004037491387868305 sim_render-ego0_min 0.004037491387868305 simulation-passed 1 step_physics_max 0.16697528261030645 step_physics_mean 0.16697528261030645 step_physics_median 0.16697528261030645 step_physics_min 0.16697528261030645 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible 65887
13579
Andras Beres 202-1 aido-LF-sim-testing
sim-1of4 success no gpu-production-spot-1-03
2021-04-09 13:09:50+00:00 2021-04-09 13:23:24+00:00 0:13:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 28.146669698972723 survival_time_median 59.99999999999873 deviation-center-line_median 3.9801925841448487 in-drivable-lane_median 2.5499999999999403
other stats agent_compute-ego0_max 0.020203859780253616 agent_compute-ego0_mean 0.020203859780253616 agent_compute-ego0_median 0.020203859780253616 agent_compute-ego0_min 0.020203859780253616 complete-iteration_max 0.2685320200669974 complete-iteration_mean 0.2685320200669974 complete-iteration_median 0.2685320200669974 complete-iteration_min 0.2685320200669974 deviation-center-line_max 3.9801925841448487 deviation-center-line_mean 3.9801925841448487 deviation-center-line_min 3.9801925841448487 deviation-heading_max 8.907389062688784 deviation-heading_mean 8.907389062688784 deviation-heading_median 8.907389062688784 deviation-heading_min 8.907389062688784 driven_any_max 29.59858964229844 driven_any_mean 29.59858964229844 driven_any_median 29.59858964229844 driven_any_min 29.59858964229844 driven_lanedir_consec_max 28.146669698972723 driven_lanedir_consec_mean 28.146669698972723 driven_lanedir_consec_min 28.146669698972723 driven_lanedir_max 28.146669698972723 driven_lanedir_mean 28.146669698972723 driven_lanedir_median 28.146669698972723 driven_lanedir_min 28.146669698972723 get_duckie_state_max 1.4392462102300815e-06 get_duckie_state_mean 1.4392462102300815e-06 get_duckie_state_median 1.4392462102300815e-06 get_duckie_state_min 1.4392462102300815e-06 get_robot_state_max 0.004237372114894591 get_robot_state_mean 0.004237372114894591 get_robot_state_median 0.004237372114894591 get_robot_state_min 0.004237372114894591 get_state_dump_max 0.005327421262996779 get_state_dump_mean 0.005327421262996779 get_state_dump_median 0.005327421262996779 get_state_dump_min 0.005327421262996779 get_ui_image_max 0.0368727738414577 get_ui_image_mean 0.0368727738414577 get_ui_image_median 0.0368727738414577 get_ui_image_min 0.0368727738414577 in-drivable-lane_max 2.5499999999999403 in-drivable-lane_mean 2.5499999999999403 in-drivable-lane_min 2.5499999999999403 per-episodes details {"LF-norm-techtrack-000-ego0": {"driven_any": 29.59858964229844, "get_ui_image": 0.0368727738414577, "step_physics": 0.1776922249377121, "survival_time": 59.99999999999873, "driven_lanedir": 28.146669698972723, "get_state_dump": 0.005327421262996779, "get_robot_state": 0.004237372114894591, "sim_render-ego0": 0.004345103167772889, "get_duckie_state": 1.4392462102300815e-06, "in-drivable-lane": 2.5499999999999403, "deviation-heading": 8.907389062688784, "agent_compute-ego0": 0.020203859780253616, "complete-iteration": 0.2685320200669974, "set_robot_commands": 0.002675816181001814, "deviation-center-line": 3.9801925841448487, "driven_lanedir_consec": 28.146669698972723, "sim_compute_sim_state": 0.014718923640191605, "sim_compute_performance-ego0": 0.0023540876787171375}}set_robot_commands_max 0.002675816181001814 set_robot_commands_mean 0.002675816181001814 set_robot_commands_median 0.002675816181001814 set_robot_commands_min 0.002675816181001814 sim_compute_performance-ego0_max 0.0023540876787171375 sim_compute_performance-ego0_mean 0.0023540876787171375 sim_compute_performance-ego0_median 0.0023540876787171375 sim_compute_performance-ego0_min 0.0023540876787171375 sim_compute_sim_state_max 0.014718923640191605 sim_compute_sim_state_mean 0.014718923640191605 sim_compute_sim_state_median 0.014718923640191605 sim_compute_sim_state_min 0.014718923640191605 sim_render-ego0_max 0.004345103167772889 sim_render-ego0_mean 0.004345103167772889 sim_render-ego0_median 0.004345103167772889 sim_render-ego0_min 0.004345103167772889 simulation-passed 1 step_physics_max 0.1776922249377121 step_physics_mean 0.1776922249377121 step_physics_median 0.1776922249377121 step_physics_min 0.1776922249377121 survival_time_max 59.99999999999873 survival_time_mean 59.99999999999873 survival_time_min 59.99999999999873
No reset possible