Duckietown Challenges Home Challenges Submissions

Evaluator 5365

ID5365
evaluatornogpu-production-b-spot-0-01
ownerI don't have one 😀
machinenogpu-production-b-spot-0_6dde5e84f8c6
processnogpu-production-b-spot-0-01_6dde5e84f8c6
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success12 79758
# timeout
# failed
# error
# aborted3 79856
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors96
Processor frequency (MHz)0.0 GHz
Free % of processors100%
RAM total (MB)184.7 GB
RAM free (MB)181.8 GB
Disk (MB)969.3 GB
Disk available (MB)926.0 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7985813798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7985713798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7985613798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-010:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7982716111Ryan Arya Pratamacollision-check-exercisemooc-collision-check-teststep1successnonogpu-production-b-spot-0-010:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.04


other stats
nsamples200
No reset possible
7982416111Ryan Arya Pratamacollision-check-exercisemooc-collision-check-teststep1successnonogpu-production-b-spot-0-010:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.04


other stats
nsamples200
No reset possible
7982116111Ryan Arya Pratamacollision-check-exercisemooc-collision-check-teststep1successnonogpu-production-b-spot-0-010:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.04


other stats
nsamples200
No reset possible
7981516104Asoka Vardhan Stemplate-rosmooc-modconsimsuccessnonogpu-production-b-spot-0-010:06:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median15.77500000000009
deviation-center-line_median0.0
driven_lanedir_consec_median0.0
survival_time_median15.77500000000009


other stats
agent_compute-ego0_max0.016304040623602467
agent_compute-ego0_mean0.011112358736214866
agent_compute-ego0_median0.011112358736214866
agent_compute-ego0_min0.005920676848827264
complete-iteration_max0.21713827406505928
complete-iteration_mean0.207074311916959
complete-iteration_median0.207074311916959
complete-iteration_min0.1970103497688587
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.901061651429723
distance-from-start_mean1.8846624630807824
distance-from-start_median1.8846624630807824
distance-from-start_min1.868263274731842
driven_any_max2.0907575439096875
driven_any_mean2.0523356264250876
driven_any_median2.0523356264250876
driven_any_min2.0139137089404877
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.255225541064301e-06
get_duckie_state_mean1.1961493822358765e-06
get_duckie_state_median1.1961493822358765e-06
get_duckie_state_min1.137073223407452e-06
get_robot_state_max0.003380579369090428
get_robot_state_mean0.003321355123500472
get_robot_state_median0.003321355123500472
get_robot_state_min0.003262130877910516
get_state_dump_max0.004270527593071958
get_state_dump_mean0.00422159982847419
get_state_dump_median0.00422159982847419
get_state_dump_min0.004172672063876421
get_ui_image_max0.07051885462252894
get_ui_image_mean0.06931629638405633
get_ui_image_median0.06931629638405633
get_ui_image_min0.06811373814558372
in-drivable-lane_max16.000000000000092
in-drivable-lane_mean15.77500000000009
in-drivable-lane_min15.550000000000086
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.0907575439096875, "get_ui_image": 0.07051885462252894, "step_physics": 0.08874571063436823, "survival_time": 16.000000000000092, "driven_lanedir": 0.0, "get_state_dump": 0.004270527593071958, "get_robot_state": 0.003380579369090428, "sim_render-ego0": 0.0034525639542909428, "get_duckie_state": 1.255225541064301e-06, "in-drivable-lane": 16.000000000000092, "deviation-heading": 0.0, "agent_compute-ego0": 0.016304040623602467, "complete-iteration": 0.21713827406505928, "set_robot_commands": 0.0020479636028919636, "distance-from-start": 1.868263274731842, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.026453824800865673, "sim_compute_performance-ego0": 0.0018779303054571896}, "LF-full-loop-001-ego0": {"driven_any": 2.0139137089404877, "get_ui_image": 0.06811373814558372, "step_physics": 0.08363341444577926, "survival_time": 15.550000000000086, "driven_lanedir": 0.0, "get_state_dump": 0.004172672063876421, "get_robot_state": 0.003262130877910516, "sim_render-ego0": 0.003510652444301507, "get_duckie_state": 1.137073223407452e-06, "in-drivable-lane": 15.550000000000086, "deviation-heading": 0.0, "agent_compute-ego0": 0.005920676848827264, "complete-iteration": 0.1970103497688587, "set_robot_commands": 0.0019485820562411577, "distance-from-start": 1.901061651429723, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.024532080460817385, "sim_compute_performance-ego0": 0.0018333219564878023}}
set_robot_commands_max0.0020479636028919636
set_robot_commands_mean0.001998272829566561
set_robot_commands_median0.001998272829566561
set_robot_commands_min0.0019485820562411577
sim_compute_performance-ego0_max0.0018779303054571896
sim_compute_performance-ego0_mean0.001855626130972496
sim_compute_performance-ego0_median0.001855626130972496
sim_compute_performance-ego0_min0.0018333219564878023
sim_compute_sim_state_max0.026453824800865673
sim_compute_sim_state_mean0.02549295263084153
sim_compute_sim_state_median0.02549295263084153
sim_compute_sim_state_min0.024532080460817385
sim_render-ego0_max0.003510652444301507
sim_render-ego0_mean0.003481608199296225
sim_render-ego0_median0.003481608199296225
sim_render-ego0_min0.0034525639542909428
simulation-passed1
step_physics_max0.08874571063436823
step_physics_mean0.08618956254007375
step_physics_median0.08618956254007375
step_physics_min0.08363341444577926
survival_time_max16.000000000000092
survival_time_mean15.77500000000009
survival_time_min15.550000000000086
No reset possible
7980916110Ryan Arya Pratamacollision-check-exercisemooc-collision-check-valistep1successnonogpu-production-b-spot-0-010:00:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.025


other stats
nsamples400
No reset possible
7980516109Gabriel Vosstemplate-randomaido-hello-sim-validation370successnonogpu-production-b-spot-0-010:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.010947682640769264
agent_compute-ego0_mean0.010947682640769264
agent_compute-ego0_median0.010947682640769264
agent_compute-ego0_min0.010947682640769264
complete-iteration_max0.12993664091283624
complete-iteration_mean0.12993664091283624
complete-iteration_median0.12993664091283624
complete-iteration_min0.12993664091283624
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004289881749586625
get_duckie_state_mean0.004289881749586625
get_duckie_state_median0.004289881749586625
get_duckie_state_min0.004289881749586625
get_robot_state_max0.0036452791907570577
get_robot_state_mean0.0036452791907570577
get_robot_state_median0.0036452791907570577
get_robot_state_min0.0036452791907570577
get_state_dump_max0.005499335852536288
get_state_dump_mean0.005499335852536288
get_state_dump_median0.005499335852536288
get_state_dump_min0.005499335852536288
get_ui_image_max0.025196953253312546
get_ui_image_mean0.025196953253312546
get_ui_image_median0.025196953253312546
get_ui_image_min0.025196953253312546
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.025196953253312546, "step_physics": 0.06806976144964044, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.005499335852536288, "get_robot_state": 0.0036452791907570577, "sim_render-ego0": 0.003538646481253884, "get_duckie_state": 0.004289881749586625, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.010947682640769264, "complete-iteration": 0.12993664091283624, "set_robot_commands": 0.00213821909644387, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004678639498623935, "sim_compute_performance-ego0": 0.0018469962206753817}}
set_robot_commands_max0.00213821909644387
set_robot_commands_mean0.00213821909644387
set_robot_commands_median0.00213821909644387
set_robot_commands_min0.00213821909644387
sim_compute_performance-ego0_max0.0018469962206753817
sim_compute_performance-ego0_mean0.0018469962206753817
sim_compute_performance-ego0_median0.0018469962206753817
sim_compute_performance-ego0_min0.0018469962206753817
sim_compute_sim_state_max0.004678639498623935
sim_compute_sim_state_mean0.004678639498623935
sim_compute_sim_state_median0.004678639498623935
sim_compute_sim_state_min0.004678639498623935
sim_render-ego0_max0.003538646481253884
sim_render-ego0_mean0.003538646481253884
sim_render-ego0_median0.003538646481253884
sim_render-ego0_min0.003538646481253884
simulation-passed1
step_physics_max0.06806976144964044
step_physics_mean0.06806976144964044
step_physics_median0.06806976144964044
step_physics_min0.06806976144964044
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7980116109Gabriel Vosstemplate-randomaido-hello-sim-validation370successnonogpu-production-b-spot-0-010:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.010553565892306242
agent_compute-ego0_mean0.010553565892306242
agent_compute-ego0_median0.010553565892306242
agent_compute-ego0_min0.010553565892306242
complete-iteration_max0.13229889219457452
complete-iteration_mean0.13229889219457452
complete-iteration_median0.13229889219457452
complete-iteration_min0.13229889219457452
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004222642291675915
get_duckie_state_mean0.004222642291675915
get_duckie_state_median0.004222642291675915
get_duckie_state_min0.004222642291675915
get_robot_state_max0.0035914507779208097
get_robot_state_mean0.0035914507779208097
get_robot_state_median0.0035914507779208097
get_robot_state_min0.0035914507779208097
get_state_dump_max0.0053715976801785555
get_state_dump_mean0.0053715976801785555
get_state_dump_median0.0053715976801785555
get_state_dump_min0.0053715976801785555
get_ui_image_max0.02498161792755127
get_ui_image_mean0.02498161792755127
get_ui_image_median0.02498161792755127
get_ui_image_min0.02498161792755127
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.02498161792755127, "step_physics": 0.0711744644425132, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.0053715976801785555, "get_robot_state": 0.0035914507779208097, "sim_render-ego0": 0.003664347258481113, "get_duckie_state": 0.004222642291675915, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.010553565892306242, "complete-iteration": 0.13229889219457452, "set_robot_commands": 0.0019985870881514115, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.004747661677273837, "sim_compute_performance-ego0": 0.0019063353538513184}}
set_robot_commands_max0.0019985870881514115
set_robot_commands_mean0.0019985870881514115
set_robot_commands_median0.0019985870881514115
set_robot_commands_min0.0019985870881514115
sim_compute_performance-ego0_max0.0019063353538513184
sim_compute_performance-ego0_mean0.0019063353538513184
sim_compute_performance-ego0_median0.0019063353538513184
sim_compute_performance-ego0_min0.0019063353538513184
sim_compute_sim_state_max0.004747661677273837
sim_compute_sim_state_mean0.004747661677273837
sim_compute_sim_state_median0.004747661677273837
sim_compute_sim_state_min0.004747661677273837
sim_render-ego0_max0.003664347258481113
sim_render-ego0_mean0.003664347258481113
sim_render-ego0_median0.003664347258481113
sim_render-ego0_min0.003664347258481113
simulation-passed1
step_physics_max0.0711744644425132
step_physics_mean0.0711744644425132
step_physics_median0.0711744644425132
step_physics_min0.0711744644425132
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
7979816110Ryan Arya Pratamacollision-check-exercisemooc-collision-check-valistep1successnonogpu-production-b-spot-0-010:00:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.025


other stats
nsamples400
No reset possible
7979216116Carlos Gavidiaexercises_braitenbergmooc-BV1sim-0of5successnonogpu-production-b-spot-0-010:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.9136532453079484


other stats
agent_compute-ego0_max0.010414156160856548
agent_compute-ego0_mean0.010414156160856548
agent_compute-ego0_median0.010414156160856548
agent_compute-ego0_min0.010414156160856548
complete-iteration_max0.236028324093735
complete-iteration_mean0.236028324093735
complete-iteration_median0.236028324093735
complete-iteration_min0.236028324093735
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.9136532453079484
distance-from-start_median0.9136532453079484
distance-from-start_min0.9136532453079484
driven_any_max0.9395042729304848
driven_any_mean0.9395042729304848
driven_any_median0.9395042729304848
driven_any_min0.9395042729304848
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08020715713500977
get_duckie_state_mean0.08020715713500977
get_duckie_state_median0.08020715713500977
get_duckie_state_min0.08020715713500977
get_robot_state_max0.003370424739101477
get_robot_state_mean0.003370424739101477
get_robot_state_median0.003370424739101477
get_robot_state_min0.003370424739101477
get_state_dump_max0.016616101013986688
get_state_dump_mean0.016616101013986688
get_state_dump_median0.016616101013986688
get_state_dump_min0.016616101013986688
get_ui_image_max0.03837886693184836
get_ui_image_mean0.03837886693184836
get_ui_image_median0.03837886693184836
get_ui_image_min0.03837886693184836
in-drivable-lane_max14.200000000000069
in-drivable-lane_mean14.200000000000069
in-drivable-lane_median14.200000000000069
in-drivable-lane_min14.200000000000069
per-episodes
details{"d45-ego0": {"driven_any": 0.9395042729304848, "get_ui_image": 0.03837886693184836, "step_physics": 0.07104526235346209, "survival_time": 14.200000000000069, "driven_lanedir": 0.0, "get_state_dump": 0.016616101013986688, "get_robot_state": 0.003370424739101477, "sim_render-ego0": 0.003258274312604938, "get_duckie_state": 0.08020715713500977, "in-drivable-lane": 14.200000000000069, "deviation-heading": 0.0, "agent_compute-ego0": 0.010414156160856548, "complete-iteration": 0.236028324093735, "set_robot_commands": 0.001954122175250137, "distance-from-start": 0.9136532453079484, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00896407261229398, "sim_compute_performance-ego0": 0.0017333172915274637}}
set_robot_commands_max0.001954122175250137
set_robot_commands_mean0.001954122175250137
set_robot_commands_median0.001954122175250137
set_robot_commands_min0.001954122175250137
sim_compute_performance-ego0_max0.0017333172915274637
sim_compute_performance-ego0_mean0.0017333172915274637
sim_compute_performance-ego0_median0.0017333172915274637
sim_compute_performance-ego0_min0.0017333172915274637
sim_compute_sim_state_max0.00896407261229398
sim_compute_sim_state_mean0.00896407261229398
sim_compute_sim_state_median0.00896407261229398
sim_compute_sim_state_min0.00896407261229398
sim_render-ego0_max0.003258274312604938
sim_render-ego0_mean0.003258274312604938
sim_render-ego0_median0.003258274312604938
sim_render-ego0_min0.003258274312604938
simulation-passed1
step_physics_max0.07104526235346209
step_physics_mean0.07104526235346209
step_physics_median0.07104526235346209
step_physics_min0.07104526235346209
survival_time_max14.200000000000069
survival_time_mean14.200000000000069
survival_time_median14.200000000000069
survival_time_min14.200000000000069
No reset possible
7978316116Carlos Gavidiaexercises_braitenbergmooc-BV1sim-0of5successnonogpu-production-b-spot-0-010:03:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.8967508030741562


other stats
agent_compute-ego0_max0.010617825346933283
agent_compute-ego0_mean0.010617825346933283
agent_compute-ego0_median0.010617825346933283
agent_compute-ego0_min0.010617825346933283
complete-iteration_max0.25360744352072057
complete-iteration_mean0.25360744352072057
complete-iteration_median0.25360744352072057
complete-iteration_min0.25360744352072057
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.8967508030741562
distance-from-start_median0.8967508030741562
distance-from-start_min0.8967508030741562
driven_any_max0.9191505484710928
driven_any_mean0.9191505484710928
driven_any_median0.9191505484710928
driven_any_min0.9191505484710928
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0916669914420222
get_duckie_state_mean0.0916669914420222
get_duckie_state_median0.0916669914420222
get_duckie_state_min0.0916669914420222
get_robot_state_max0.003599881286352453
get_robot_state_mean0.003599881286352453
get_robot_state_median0.003599881286352453
get_robot_state_min0.003599881286352453
get_state_dump_max0.01694668430677602
get_state_dump_mean0.01694668430677602
get_state_dump_median0.01694668430677602
get_state_dump_min0.01694668430677602
get_ui_image_max0.03883794663657605
get_ui_image_mean0.03883794663657605
get_ui_image_median0.03883794663657605
get_ui_image_min0.03883794663657605
in-drivable-lane_max14.150000000000066
in-drivable-lane_mean14.150000000000066
in-drivable-lane_median14.150000000000066
in-drivable-lane_min14.150000000000066
per-episodes
details{"d45-ego0": {"driven_any": 0.9191505484710928, "get_ui_image": 0.03883794663657605, "step_physics": 0.07503816527380071, "survival_time": 14.150000000000066, "driven_lanedir": 0.0, "get_state_dump": 0.01694668430677602, "get_robot_state": 0.003599881286352453, "sim_render-ego0": 0.00345609725361139, "get_duckie_state": 0.0916669914420222, "in-drivable-lane": 14.150000000000066, "deviation-heading": 0.0, "agent_compute-ego0": 0.010617825346933283, "complete-iteration": 0.25360744352072057, "set_robot_commands": 0.002085025881377744, "distance-from-start": 0.8967508030741562, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009349999293475084, "sim_compute_performance-ego0": 0.0019102575073779468}}
set_robot_commands_max0.002085025881377744
set_robot_commands_mean0.002085025881377744
set_robot_commands_median0.002085025881377744
set_robot_commands_min0.002085025881377744
sim_compute_performance-ego0_max0.0019102575073779468
sim_compute_performance-ego0_mean0.0019102575073779468
sim_compute_performance-ego0_median0.0019102575073779468
sim_compute_performance-ego0_min0.0019102575073779468
sim_compute_sim_state_max0.009349999293475084
sim_compute_sim_state_mean0.009349999293475084
sim_compute_sim_state_median0.009349999293475084
sim_compute_sim_state_min0.009349999293475084
sim_render-ego0_max0.00345609725361139
sim_render-ego0_mean0.00345609725361139
sim_render-ego0_median0.00345609725361139
sim_render-ego0_min0.00345609725361139
simulation-passed1
step_physics_max0.07503816527380071
step_physics_mean0.07503816527380071
step_physics_median0.07503816527380071
step_physics_min0.07503816527380071
survival_time_max14.150000000000066
survival_time_mean14.150000000000066
survival_time_median14.150000000000066
survival_time_min14.150000000000066
No reset possible
7977116126Arwa Alabdulkarimexercises_braitenbergmooc-BV1sim-1of5successnonogpu-production-b-spot-0-010:09:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.527003721149868


other stats
agent_compute-ego0_max0.010255565534271267
agent_compute-ego0_mean0.010255565534271267
agent_compute-ego0_median0.010255565534271267
agent_compute-ego0_min0.010255565534271267
complete-iteration_max0.2511190560792975
complete-iteration_mean0.2511190560792975
complete-iteration_median0.2511190560792975
complete-iteration_min0.2511190560792975
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.527003721149868
distance-from-start_median4.527003721149868
distance-from-start_min4.527003721149868
driven_any_max5.094640243022885
driven_any_mean5.094640243022885
driven_any_median5.094640243022885
driven_any_min5.094640243022885
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0917242246441602
get_duckie_state_mean0.0917242246441602
get_duckie_state_median0.0917242246441602
get_duckie_state_min0.0917242246441602
get_robot_state_max0.0034923335388237276
get_robot_state_mean0.0034923335388237276
get_robot_state_median0.0034923335388237276
get_robot_state_min0.0034923335388237276
get_state_dump_max0.01823097776716596
get_state_dump_mean0.01823097776716596
get_state_dump_median0.01823097776716596
get_state_dump_min0.01823097776716596
get_ui_image_max0.04124629130568962
get_ui_image_mean0.04124629130568962
get_ui_image_median0.04124629130568962
get_ui_image_min0.04124629130568962
in-drivable-lane_max56.79999999999891
in-drivable-lane_mean56.79999999999891
in-drivable-lane_median56.79999999999891
in-drivable-lane_min56.79999999999891
per-episodes
details{"d50-ego0": {"driven_any": 5.094640243022885, "get_ui_image": 0.04124629130568962, "step_physics": 0.07182001354616781, "survival_time": 56.79999999999891, "driven_lanedir": 0.0, "get_state_dump": 0.01823097776716596, "get_robot_state": 0.0034923335388237276, "sim_render-ego0": 0.003257825066357615, "get_duckie_state": 0.0917242246441602, "in-drivable-lane": 56.79999999999891, "deviation-heading": 0.0, "agent_compute-ego0": 0.010255565534271267, "complete-iteration": 0.2511190560792975, "set_robot_commands": 0.001974012732191262, "distance-from-start": 4.527003721149868, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0073225244473446435, "sim_compute_performance-ego0": 0.001701163952038177}}
set_robot_commands_max0.001974012732191262
set_robot_commands_mean0.001974012732191262
set_robot_commands_median0.001974012732191262
set_robot_commands_min0.001974012732191262
sim_compute_performance-ego0_max0.001701163952038177
sim_compute_performance-ego0_mean0.001701163952038177
sim_compute_performance-ego0_median0.001701163952038177
sim_compute_performance-ego0_min0.001701163952038177
sim_compute_sim_state_max0.0073225244473446435
sim_compute_sim_state_mean0.0073225244473446435
sim_compute_sim_state_median0.0073225244473446435
sim_compute_sim_state_min0.0073225244473446435
sim_render-ego0_max0.003257825066357615
sim_render-ego0_mean0.003257825066357615
sim_render-ego0_median0.003257825066357615
sim_render-ego0_min0.003257825066357615
simulation-passed1
step_physics_max0.07182001354616781
step_physics_mean0.07182001354616781
step_physics_median0.07182001354616781
step_physics_min0.07182001354616781
survival_time_max56.79999999999891
survival_time_mean56.79999999999891
survival_time_median56.79999999999891
survival_time_min56.79999999999891
No reset possible
7975816102Denis Medvedevexercises_braitenbergmooc-BV1sim-3of5successnonogpu-production-b-spot-0-010:07:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.8333217086373415


other stats
agent_compute-ego0_max0.03440742862635646
agent_compute-ego0_mean0.03440742862635646
agent_compute-ego0_median0.03440742862635646
agent_compute-ego0_min0.03440742862635646
complete-iteration_max0.22766357077949348
complete-iteration_mean0.22766357077949348
complete-iteration_median0.22766357077949348
complete-iteration_min0.22766357077949348
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.8333217086373415
distance-from-start_median2.8333217086373415
distance-from-start_min2.8333217086373415
driven_any_max3.0308926594243113
driven_any_mean3.0308926594243113
driven_any_median3.0308926594243113
driven_any_min3.0308926594243113
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.05656868596186583
get_duckie_state_mean0.05656868596186583
get_duckie_state_median0.05656868596186583
get_duckie_state_min0.05656868596186583
get_robot_state_max0.0034476974229703003
get_robot_state_mean0.0034476974229703003
get_robot_state_median0.0034476974229703003
get_robot_state_min0.0034476974229703003
get_state_dump_max0.01327920987688262
get_state_dump_mean0.01327920987688262
get_state_dump_median0.01327920987688262
get_state_dump_min0.01327920987688262
get_ui_image_max0.033709464744589794
get_ui_image_mean0.033709464744589794
get_ui_image_median0.033709464744589794
get_ui_image_min0.033709464744589794
in-drivable-lane_max34.75000000000016
in-drivable-lane_mean34.75000000000016
in-drivable-lane_median34.75000000000016
in-drivable-lane_min34.75000000000016
per-episodes
details{"d30-ego0": {"driven_any": 3.0308926594243113, "get_ui_image": 0.033709464744589794, "step_physics": 0.06933135856157062, "survival_time": 34.75000000000016, "driven_lanedir": 0.0, "get_state_dump": 0.01327920987688262, "get_robot_state": 0.0034476974229703003, "sim_render-ego0": 0.00360489508201336, "get_duckie_state": 0.05656868596186583, "in-drivable-lane": 34.75000000000016, "deviation-heading": 0.0, "agent_compute-ego0": 0.03440742862635646, "complete-iteration": 0.22766357077949348, "set_robot_commands": 0.001972625995504445, "distance-from-start": 2.8333217086373415, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009422051838074609, "sim_compute_performance-ego0": 0.0018277281317217596}}
set_robot_commands_max0.001972625995504445
set_robot_commands_mean0.001972625995504445
set_robot_commands_median0.001972625995504445
set_robot_commands_min0.001972625995504445
sim_compute_performance-ego0_max0.0018277281317217596
sim_compute_performance-ego0_mean0.0018277281317217596
sim_compute_performance-ego0_median0.0018277281317217596
sim_compute_performance-ego0_min0.0018277281317217596
sim_compute_sim_state_max0.009422051838074609
sim_compute_sim_state_mean0.009422051838074609
sim_compute_sim_state_median0.009422051838074609
sim_compute_sim_state_min0.009422051838074609
sim_render-ego0_max0.00360489508201336
sim_render-ego0_mean0.00360489508201336
sim_render-ego0_median0.00360489508201336
sim_render-ego0_min0.00360489508201336
simulation-passed1
step_physics_max0.06933135856157062
step_physics_mean0.06933135856157062
step_physics_median0.06933135856157062
step_physics_min0.06933135856157062
survival_time_max34.75000000000016
survival_time_mean34.75000000000016
survival_time_median34.75000000000016
survival_time_min34.75000000000016
No reset possible