Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 7910915921Tanmay Samak exercises_braitenberg mooc-BV1sim-3of5 success no nogpu-production-b-spot-0-022021-06-17 18:38:59+00:00 2021-06-17 18:46:08+00:00 0:07:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 5.922391584725719
other stats agent_compute-ego0_max 0.010793208304346573 agent_compute-ego0_mean 0.010793208304346573 agent_compute-ego0_median 0.010793208304346573 agent_compute-ego0_min 0.010793208304346573 complete-iteration_max 0.2171571658524366 complete-iteration_mean 0.2171571658524366 complete-iteration_median 0.2171571658524366 complete-iteration_min 0.2171571658524366 deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 5.922391584725719 distance-from-start_median 5.922391584725719 distance-from-start_min 5.922391584725719 driven_any_max 6.018983864376781 driven_any_mean 6.018983864376781 driven_any_median 6.018983864376781 driven_any_min 6.018983864376781 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 get_duckie_state_max 0.056881791179619945 get_duckie_state_mean 0.056881791179619945 get_duckie_state_median 0.056881791179619945 get_duckie_state_min 0.056881791179619945 get_robot_state_max 0.0035484492971673367 get_robot_state_mean 0.0035484492971673367 get_robot_state_median 0.0035484492971673367 get_robot_state_min 0.0035484492971673367 get_state_dump_max 0.012845577159745792 get_state_dump_mean 0.012845577159745792 get_state_dump_median 0.012845577159745792 get_state_dump_min 0.012845577159745792 get_ui_image_max 0.03776192407906377 get_ui_image_mean 0.03776192407906377 get_ui_image_median 0.03776192407906377 get_ui_image_min 0.03776192407906377 in-drivable-lane_max 46.29999999999951 in-drivable-lane_mean 46.29999999999951 in-drivable-lane_median 46.29999999999951 in-drivable-lane_min 46.29999999999951 per-episodes details {"d30-ego0": {"driven_any": 6.018983864376781, "get_ui_image": 0.03776192407906377, "step_physics": 0.08060645259828372, "survival_time": 46.29999999999951, "driven_lanedir": 0.0, "get_state_dump": 0.012845577159745792, "get_robot_state": 0.0035484492971673367, "sim_render-ego0": 0.0033572427406022977, "get_duckie_state": 0.056881791179619945, "in-drivable-lane": 46.29999999999951, "deviation-heading": 0.0, "agent_compute-ego0": 0.010793208304346573, "complete-iteration": 0.2171571658524366, "set_robot_commands": 0.002048612798301919, "distance-from-start": 5.922391584725719, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007449628722963467, "sim_compute_performance-ego0": 0.001771519485029202}}set_robot_commands_max 0.002048612798301919 set_robot_commands_mean 0.002048612798301919 set_robot_commands_median 0.002048612798301919 set_robot_commands_min 0.002048612798301919 sim_compute_performance-ego0_max 0.001771519485029202 sim_compute_performance-ego0_mean 0.001771519485029202 sim_compute_performance-ego0_median 0.001771519485029202 sim_compute_performance-ego0_min 0.001771519485029202 sim_compute_sim_state_max 0.007449628722963467 sim_compute_sim_state_mean 0.007449628722963467 sim_compute_sim_state_median 0.007449628722963467 sim_compute_sim_state_min 0.007449628722963467 sim_render-ego0_max 0.0033572427406022977 sim_render-ego0_mean 0.0033572427406022977 sim_render-ego0_median 0.0033572427406022977 sim_render-ego0_min 0.0033572427406022977 simulation-passed 1 step_physics_max 0.08060645259828372 step_physics_mean 0.08060645259828372 step_physics_median 0.08060645259828372 step_physics_min 0.08060645259828372 survival_time_max 46.29999999999951 survival_time_mean 46.29999999999951 survival_time_median 46.29999999999951 survival_time_min 46.29999999999951
No reset possible 7897915883Owen Wijaya exercises_braitenberg mooc-BV1sim-4of5 success no nogpu-production-b-spot-0-022021-06-14 07:17:29+00:00 2021-06-14 07:22:19+00:00 0:04:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 1.057075976342651
other stats agent_compute-ego0_max 0.010702771655583783 agent_compute-ego0_mean 0.010702771655583783 agent_compute-ego0_median 0.010702771655583783 agent_compute-ego0_min 0.010702771655583783 complete-iteration_max 0.29740036948252535 complete-iteration_mean 0.29740036948252535 complete-iteration_median 0.29740036948252535 complete-iteration_min 0.29740036948252535 deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 1.057075976342651 distance-from-start_median 1.057075976342651 distance-from-start_min 1.057075976342651 driven_any_max 1.0573488337824664 driven_any_mean 1.0573488337824664 driven_any_median 1.0573488337824664 driven_any_min 1.0573488337824664 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 get_duckie_state_max 0.1130840899580616 get_duckie_state_mean 0.1130840899580616 get_duckie_state_median 0.1130840899580616 get_duckie_state_min 0.1130840899580616 get_robot_state_max 0.003598545365414377 get_robot_state_mean 0.003598545365414377 get_robot_state_median 0.003598545365414377 get_robot_state_min 0.003598545365414377 get_state_dump_max 0.021414716364973684 get_state_dump_mean 0.021414716364973684 get_state_dump_median 0.021414716364973684 get_state_dump_min 0.021414716364973684 get_ui_image_max 0.04596151820683884 get_ui_image_mean 0.04596151820683884 get_ui_image_median 0.04596151820683884 get_ui_image_min 0.04596151820683884 in-drivable-lane_max 14.700000000000074 in-drivable-lane_mean 14.700000000000074 in-drivable-lane_median 14.700000000000074 in-drivable-lane_min 14.700000000000074 per-episodes details {"d60-ego0": {"driven_any": 1.0573488337824664, "get_ui_image": 0.04596151820683884, "step_physics": 0.08544026956719868, "survival_time": 14.700000000000074, "driven_lanedir": 0.0, "get_state_dump": 0.021414716364973684, "get_robot_state": 0.003598545365414377, "sim_render-ego0": 0.0034237974781101033, "get_duckie_state": 0.1130840899580616, "in-drivable-lane": 14.700000000000074, "deviation-heading": 0.0, "agent_compute-ego0": 0.010702771655583783, "complete-iteration": 0.29740036948252535, "set_robot_commands": 0.00207026934219619, "distance-from-start": 1.057075976342651, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009791476847761767, "sim_compute_performance-ego0": 0.0018123311511540816}}set_robot_commands_max 0.00207026934219619 set_robot_commands_mean 0.00207026934219619 set_robot_commands_median 0.00207026934219619 set_robot_commands_min 0.00207026934219619 sim_compute_performance-ego0_max 0.0018123311511540816 sim_compute_performance-ego0_mean 0.0018123311511540816 sim_compute_performance-ego0_median 0.0018123311511540816 sim_compute_performance-ego0_min 0.0018123311511540816 sim_compute_sim_state_max 0.009791476847761767 sim_compute_sim_state_mean 0.009791476847761767 sim_compute_sim_state_median 0.009791476847761767 sim_compute_sim_state_min 0.009791476847761767 sim_render-ego0_max 0.0034237974781101033 sim_render-ego0_mean 0.0034237974781101033 sim_render-ego0_median 0.0034237974781101033 sim_render-ego0_min 0.0034237974781101033 simulation-passed 1 step_physics_max 0.08544026956719868 step_physics_mean 0.08544026956719868 step_physics_median 0.08544026956719868 step_physics_min 0.08544026956719868 survival_time_max 14.700000000000074 survival_time_mean 14.700000000000074 survival_time_median 14.700000000000074 survival_time_min 14.700000000000074
No reset possible 7882115864Bea Baselines dummy_collision_checker mooc-collision-check-teststep1 success no nogpu-production-b-spot-0-022021-06-13 17:40:48+00:00 2021-06-13 17:41:02+00:00 0:00:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 7876015852Dockie Fun exercises_braitenberg mooc-BV1sim-4of5 success no nogpu-production-b-spot-0-022021-06-11 03:35:30+00:00 2021-06-11 03:39:02+00:00 0:03:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 1.027615564619228
other stats agent_compute-ego0_max 0.011027491129588786 agent_compute-ego0_mean 0.011027491129588786 agent_compute-ego0_median 0.011027491129588786 agent_compute-ego0_min 0.011027491129588786 complete-iteration_max 0.2724843431183428 complete-iteration_mean 0.2724843431183428 complete-iteration_median 0.2724843431183428 complete-iteration_min 0.2724843431183428 deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 1.027615564619228 distance-from-start_median 1.027615564619228 distance-from-start_min 1.027615564619228 driven_any_max 1.050690841358919 driven_any_mean 1.050690841358919 driven_any_median 1.050690841358919 driven_any_min 1.050690841358919 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 get_duckie_state_max 0.1065762581840019 get_duckie_state_mean 0.1065762581840019 get_duckie_state_median 0.1065762581840019 get_duckie_state_min 0.1065762581840019 get_robot_state_max 0.003466366983419601 get_robot_state_mean 0.003466366983419601 get_robot_state_median 0.003466366983419601 get_robot_state_min 0.003466366983419601 get_state_dump_max 0.021130705027388345 get_state_dump_mean 0.021130705027388345 get_state_dump_median 0.021130705027388345 get_state_dump_min 0.021130705027388345 get_ui_image_max 0.04082123192471247 get_ui_image_mean 0.04082123192471247 get_ui_image_median 0.04082123192471247 get_ui_image_min 0.04082123192471247 in-drivable-lane_max 16.100000000000094 in-drivable-lane_mean 16.100000000000094 in-drivable-lane_median 16.100000000000094 in-drivable-lane_min 16.100000000000094 per-episodes details {"d60-ego0": {"driven_any": 1.050690841358919, "get_ui_image": 0.04082123192471247, "step_physics": 0.07302355618668784, "survival_time": 16.100000000000094, "driven_lanedir": 0.0, "get_state_dump": 0.021130705027388345, "get_robot_state": 0.003466366983419601, "sim_render-ego0": 0.003281395501765673, "get_duckie_state": 0.1065762581840019, "in-drivable-lane": 16.100000000000094, "deviation-heading": 0.0, "agent_compute-ego0": 0.011027491129588786, "complete-iteration": 0.2724843431183428, "set_robot_commands": 0.001937193767205111, "distance-from-start": 1.027615564619228, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009432350518902758, "sim_compute_performance-ego0": 0.0017003164202805275}}set_robot_commands_max 0.001937193767205111 set_robot_commands_mean 0.001937193767205111 set_robot_commands_median 0.001937193767205111 set_robot_commands_min 0.001937193767205111 sim_compute_performance-ego0_max 0.0017003164202805275 sim_compute_performance-ego0_mean 0.0017003164202805275 sim_compute_performance-ego0_median 0.0017003164202805275 sim_compute_performance-ego0_min 0.0017003164202805275 sim_compute_sim_state_max 0.009432350518902758 sim_compute_sim_state_mean 0.009432350518902758 sim_compute_sim_state_median 0.009432350518902758 sim_compute_sim_state_min 0.009432350518902758 sim_render-ego0_max 0.003281395501765673 sim_render-ego0_mean 0.003281395501765673 sim_render-ego0_median 0.003281395501765673 sim_render-ego0_min 0.003281395501765673 simulation-passed 1 step_physics_max 0.07302355618668784 step_physics_mean 0.07302355618668784 step_physics_median 0.07302355618668784 step_physics_min 0.07302355618668784 survival_time_max 16.100000000000094 survival_time_mean 16.100000000000094 survival_time_median 16.100000000000094 survival_time_min 16.100000000000094
No reset possible 7873915849Juan Ramirez exercises_braitenberg mooc-BV1sim-4of5 success no nogpu-production-b-spot-0-022021-06-11 03:10:31+00:00 2021-06-11 03:11:39+00:00 0:01:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean 0.5353031038945432
other stats agent_compute-ego0_max 0.009837578844141078 agent_compute-ego0_mean 0.009837578844141078 agent_compute-ego0_median 0.009837578844141078 agent_compute-ego0_min 0.009837578844141078 complete-iteration_max 0.2693126289932816 complete-iteration_mean 0.2693126289932816 complete-iteration_median 0.2693126289932816 complete-iteration_min 0.2693126289932816 deviation-center-line_max 0.0 deviation-center-line_mean 0.0 deviation-center-line_median 0.0 deviation-center-line_min 0.0 deviation-heading_max 0.0 deviation-heading_mean 0.0 deviation-heading_median 0.0 deviation-heading_min 0.0 distance-from-start_max 0.5353031038945432 distance-from-start_median 0.5353031038945432 distance-from-start_min 0.5353031038945432 driven_any_max 0.6823054053979594 driven_any_mean 0.6823054053979594 driven_any_median 0.6823054053979594 driven_any_min 0.6823054053979594 driven_lanedir_consec_max 0.0 driven_lanedir_consec_mean 0.0 driven_lanedir_consec_median 0.0 driven_lanedir_consec_min 0.0 driven_lanedir_max 0.0 driven_lanedir_mean 0.0 driven_lanedir_median 0.0 driven_lanedir_min 0.0 get_duckie_state_max 0.10885281916017886 get_duckie_state_mean 0.10885281916017886 get_duckie_state_median 0.10885281916017886 get_duckie_state_min 0.10885281916017886 get_robot_state_max 0.0033903033645064744 get_robot_state_mean 0.0033903033645064744 get_robot_state_median 0.0033903033645064744 get_robot_state_min 0.0033903033645064744 get_state_dump_max 0.02013305381492332 get_state_dump_mean 0.02013305381492332 get_state_dump_median 0.02013305381492332 get_state_dump_min 0.02013305381492332 get_ui_image_max 0.04096401179278338 get_ui_image_mean 0.04096401179278338 get_ui_image_median 0.04096401179278338 get_ui_image_min 0.04096401179278338 in-drivable-lane_max 2.6499999999999986 in-drivable-lane_mean 2.6499999999999986 in-drivable-lane_median 2.6499999999999986 in-drivable-lane_min 2.6499999999999986 per-episodes details {"d60-ego0": {"driven_any": 0.6823054053979594, "get_ui_image": 0.04096401179278338, "step_physics": 0.07109846009148492, "survival_time": 2.6499999999999986, "driven_lanedir": 0.0, "get_state_dump": 0.02013305381492332, "get_robot_state": 0.0033903033645064744, "sim_render-ego0": 0.003226408252009639, "get_duckie_state": 0.10885281916017886, "in-drivable-lane": 2.6499999999999986, "deviation-heading": 0.0, "agent_compute-ego0": 0.009837578844141078, "complete-iteration": 0.2693126289932816, "set_robot_commands": 0.002013047536214193, "distance-from-start": 0.5353031038945432, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007935921351114908, "sim_compute_performance-ego0": 0.0017705846715856482}}set_robot_commands_max 0.002013047536214193 set_robot_commands_mean 0.002013047536214193 set_robot_commands_median 0.002013047536214193 set_robot_commands_min 0.002013047536214193 sim_compute_performance-ego0_max 0.0017705846715856482 sim_compute_performance-ego0_mean 0.0017705846715856482 sim_compute_performance-ego0_median 0.0017705846715856482 sim_compute_performance-ego0_min 0.0017705846715856482 sim_compute_sim_state_max 0.007935921351114908 sim_compute_sim_state_mean 0.007935921351114908 sim_compute_sim_state_median 0.007935921351114908 sim_compute_sim_state_min 0.007935921351114908 sim_render-ego0_max 0.003226408252009639 sim_render-ego0_mean 0.003226408252009639 sim_render-ego0_median 0.003226408252009639 sim_render-ego0_min 0.003226408252009639 simulation-passed 1 step_physics_max 0.07109846009148492 step_physics_mean 0.07109846009148492 step_physics_median 0.07109846009148492 step_physics_min 0.07109846009148492 survival_time_max 2.6499999999999986 survival_time_mean 2.6499999999999986 survival_time_median 2.6499999999999986 survival_time_min 2.6499999999999986
No reset possible 7865013798Nicholas Kostelnik template-random aido-hello-sim-validation370 aborted no nogpu-production-b-spot-0-022021-06-10 14:31:51+00:00 2021-06-10 14:32:13+00:00 0:00:22 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
response.raise_for_status()
File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
self._raise_for_status(response)
File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
raise create_api_error_from_http_exception(e)
File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
return docker_pull(client, image_name, quiet=quiet)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691 tag None
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
cr = run_single(
File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
docker_pull_retry(client, image, ntimes=4, wait=5)
File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Tanmay Samak
Owen Wijaya
Bea Baselines 🐤
Dockie Fun
Juan Ramirez
Nicholas Kostelnik