Duckietown Challenges Home Challenges Submissions

Evaluator 5104

ID5104
evaluatorgpu-production-spot-3-03
ownerI don't have one πŸ˜€
machinegpu-prod_a541a8ad29b0
processgpu-production-spot-3-03_a541a8ad29b0
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success7 65878
# timeout
# failed
# error
# aborted1 66327
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors99%
RAM total (MB)249.0 GB
RAM free (MB)238.9 GB
Disk (MB)969.3 GB
Disk available (MB)862.2 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6634614117Jacopo Taniexercises_braitenbergmooc-BV1420successyesgpu-production-spot-3-030:03:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
agent_compute-ego0_max0.012510420467359904
agent_compute-ego0_mean0.012510420467359904
agent_compute-ego0_median0.012510420467359904
agent_compute-ego0_min0.012510420467359904
complete-iteration_max0.23807706391758857
complete-iteration_mean0.23807706391758857
complete-iteration_median0.23807706391758857
complete-iteration_min0.23807706391758857
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
driven_any_max0.6156000000000084
driven_any_mean0.6156000000000084
driven_any_median0.6156000000000084
driven_any_min0.6156000000000084
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0811060136635398
get_duckie_state_mean0.0811060136635398
get_duckie_state_median0.0811060136635398
get_duckie_state_min0.0811060136635398
get_robot_state_max0.00363420179761979
get_robot_state_mean0.00363420179761979
get_robot_state_median0.00363420179761979
get_robot_state_min0.00363420179761979
get_state_dump_max0.017396285145293247
get_state_dump_mean0.017396285145293247
get_state_dump_median0.017396285145293247
get_state_dump_min0.017396285145293247
get_ui_image_max0.03048967369852612
get_ui_image_mean0.03048967369852612
get_ui_image_median0.03048967369852612
get_ui_image_min0.03048967369852612
in-drivable-lane_max11.300000000000026
in-drivable-lane_mean11.300000000000026
in-drivable-lane_median11.300000000000026
in-drivable-lane_min11.300000000000026
per-episodes
details{"t08d40-ego0": {"driven_any": 0.6156000000000084, "get_ui_image": 0.03048967369852612, "step_physics": 0.07491466337363625, "survival_time": 11.300000000000026, "driven_lanedir": 0.0, "get_state_dump": 0.017396285145293247, "get_robot_state": 0.00363420179761979, "sim_render-ego0": 0.0036964374491821822, "get_duckie_state": 0.0811060136635398, "in-drivable-lane": 11.300000000000026, "deviation-heading": 0.0, "agent_compute-ego0": 0.012510420467359904, "complete-iteration": 0.23807706391758857, "set_robot_commands": 0.0022079766059236905, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010129426544458331, "sim_compute_performance-ego0": 0.0019114973261492893}}
set_robot_commands_max0.0022079766059236905
set_robot_commands_mean0.0022079766059236905
set_robot_commands_median0.0022079766059236905
set_robot_commands_min0.0022079766059236905
sim_compute_performance-ego0_max0.0019114973261492893
sim_compute_performance-ego0_mean0.0019114973261492893
sim_compute_performance-ego0_median0.0019114973261492893
sim_compute_performance-ego0_min0.0019114973261492893
sim_compute_sim_state_max0.010129426544458331
sim_compute_sim_state_mean0.010129426544458331
sim_compute_sim_state_median0.010129426544458331
sim_compute_sim_state_min0.010129426544458331
sim_render-ego0_max0.0036964374491821822
sim_render-ego0_mean0.0036964374491821822
sim_render-ego0_median0.0036964374491821822
sim_render-ego0_min0.0036964374491821822
simulation-passed1
step_physics_max0.07491466337363625
step_physics_mean0.07491466337363625
step_physics_median0.07491466337363625
step_physics_min0.07491466337363625
survival_time_max11.300000000000026
survival_time_mean11.300000000000026
survival_time_median11.300000000000026
survival_time_min11.300000000000026
No reset possible
6632713798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-3-030:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6606113548AndrΓ‘s KalaposΒ πŸ‡­πŸ‡Ί3090aido-LFV_multi-sim-validation402successnogpu-production-spot-3-031:09:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median0.0
driven_lanedir_consec_median27.79011033694175
deviation-center-line_median2.473679399315615


other stats
agent_compute-ego0_max0.01450730025222359
agent_compute-ego0_mean0.01445781906677424
agent_compute-ego0_median0.01445781906677424
agent_compute-ego0_min0.014408337881324888
agent_compute-ego1_max0.0143500412632087
agent_compute-ego1_mean0.014316741076238348
agent_compute-ego1_median0.014316741076238348
agent_compute-ego1_min0.014283440889267996
agent_compute-ego2_max0.014134886461332576
agent_compute-ego2_mean0.014111055819617024
agent_compute-ego2_median0.014111055819617024
agent_compute-ego2_min0.014087225177901471
agent_compute-ego3_max0.014269518316238749
agent_compute-ego3_mean0.014189909340241473
agent_compute-ego3_median0.014189909340241473
agent_compute-ego3_min0.014110300364244191
complete-iteration_max1.1524708711733729
complete-iteration_mean1.023367039468465
complete-iteration_median1.023367039468465
complete-iteration_min0.8942632077635575
deviation-center-line_max2.7249031915184134
deviation-center-line_mean2.415758496863625
deviation-center-line_min2.021918641005624
deviation-heading_max11.536372194299735
deviation-heading_mean10.063866946474748
deviation-heading_median10.39042283652678
deviation-heading_min8.149281472097998
driven_any_max29.49548540650238
driven_any_mean28.17222001307816
driven_any_median28.303055216440256
driven_any_min27.103082311934827
driven_lanedir_consec_max29.121547568470955
driven_lanedir_consec_mean27.622219842722544
driven_lanedir_consec_min26.416257882607916
driven_lanedir_max29.121547568470955
driven_lanedir_mean27.622219842722544
driven_lanedir_median27.79011033694175
driven_lanedir_min26.416257882607916
get_duckie_state_max1.4882798397372306e-06
get_duckie_state_mean1.42068489703608e-06
get_duckie_state_median1.42068489703608e-06
get_duckie_state_min1.353089954334929e-06
get_robot_state_max0.01566514881524714
get_robot_state_mean0.015363082103586317
get_robot_state_median0.015363082103586317
get_robot_state_min0.01506101539192549
get_state_dump_max0.010536992480415388
get_state_dump_mean0.010222867366971818
get_state_dump_median0.010222867366971818
get_state_dump_min0.009908742253528249
get_ui_image_max0.052125212552644726
get_ui_image_mean0.049084984988197494
get_ui_image_median0.049084984988197494
get_ui_image_min0.04604475742375027
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 28.708554844523142, "get_ui_image": 0.04604475742375027, "step_physics": 0.6963414615834385, "survival_time": 59.99999999999873, "driven_lanedir": 28.061195560085807, "get_state_dump": 0.010536992480415388, "get_robot_state": 0.01566514881524714, "sim_render-ego0": 0.004107145941525474, "sim_render-ego1": 0.004026269237762883, "sim_render-ego2": 0.004153259985651402, "sim_render-ego3": 0.004063337669086694, "get_duckie_state": 1.4882798397372306e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.664234574938927, "agent_compute-ego0": 0.014408337881324888, "agent_compute-ego1": 0.014283440889267996, "agent_compute-ego2": 0.014087225177901471, "agent_compute-ego3": 0.014269518316238749, "complete-iteration": 0.8942632077635575, "set_robot_commands": 0.002467035353928184, "deviation-center-line": 2.483218091502122, "driven_lanedir_consec": 28.061195560085807, "sim_compute_sim_state": 0.03348482637778607, "sim_compute_performance-ego0": 0.00230494188726395, "sim_compute_performance-ego1": 0.002164307879369324, "sim_compute_performance-ego2": 0.002122927267882945, "sim_compute_performance-ego3": 0.0021383323637670917}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 28.58209576793818, "get_ui_image": 0.04604475742375027, "step_physics": 0.6963414615834385, "survival_time": 59.99999999999873, "driven_lanedir": 27.947749114507054, "get_state_dump": 0.010536992480415388, "get_robot_state": 0.01566514881524714, "sim_render-ego0": 0.004107145941525474, "sim_render-ego1": 0.004026269237762883, "sim_render-ego2": 0.004153259985651402, "sim_render-ego3": 0.004063337669086694, "get_duckie_state": 1.4882798397372306e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.836647731461271, "agent_compute-ego0": 0.014408337881324888, "agent_compute-ego1": 0.014283440889267996, "agent_compute-ego2": 0.014087225177901471, "agent_compute-ego3": 0.014269518316238749, "complete-iteration": 0.8942632077635575, "set_robot_commands": 0.002467035353928184, "deviation-center-line": 2.4641407071291095, "driven_lanedir_consec": 27.947749114507054, "sim_compute_sim_state": 0.03348482637778607, "sim_compute_performance-ego0": 0.00230494188726395, "sim_compute_performance-ego1": 0.002164307879369324, "sim_compute_performance-ego2": 0.002122927267882945, "sim_compute_performance-ego3": 0.0021383323637670917}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 29.49548540650238, "get_ui_image": 0.04604475742375027, "step_physics": 0.6963414615834385, "survival_time": 59.99999999999873, "driven_lanedir": 29.121547568470955, "get_state_dump": 0.010536992480415388, "get_robot_state": 0.01566514881524714, "sim_render-ego0": 0.004107145941525474, "sim_render-ego1": 0.004026269237762883, "sim_render-ego2": 0.004153259985651402, "sim_render-ego3": 0.004063337669086694, "get_duckie_state": 1.4882798397372306e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.463079564463865, "agent_compute-ego0": 0.014408337881324888, "agent_compute-ego1": 0.014283440889267996, "agent_compute-ego2": 0.014087225177901471, "agent_compute-ego3": 0.014269518316238749, "complete-iteration": 0.8942632077635575, "set_robot_commands": 0.002467035353928184, "deviation-center-line": 2.021918641005624, "driven_lanedir_consec": 29.121547568470955, "sim_compute_sim_state": 0.03348482637778607, "sim_compute_performance-ego0": 0.00230494188726395, "sim_compute_performance-ego1": 0.002164307879369324, "sim_compute_performance-ego2": 0.002122927267882945, "sim_compute_performance-ego3": 0.0021383323637670917}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 28.628970178723588, "get_ui_image": 0.04604475742375027, "step_physics": 0.6963414615834385, "survival_time": 59.99999999999873, "driven_lanedir": 28.088490810682245, "get_state_dump": 0.010536992480415388, "get_robot_state": 0.01566514881524714, "sim_render-ego0": 0.004107145941525474, "sim_render-ego1": 0.004026269237762883, "sim_render-ego2": 0.004153259985651402, "sim_render-ego3": 0.004063337669086694, "get_duckie_state": 1.4882798397372306e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.080474361482612, "agent_compute-ego0": 0.014408337881324888, "agent_compute-ego1": 0.014283440889267996, "agent_compute-ego2": 0.014087225177901471, "agent_compute-ego3": 0.014269518316238749, "complete-iteration": 0.8942632077635575, "set_robot_commands": 0.002467035353928184, "deviation-center-line": 2.2050537100439467, "driven_lanedir_consec": 28.088490810682245, "sim_compute_sim_state": 0.03348482637778607, "sim_compute_performance-ego0": 0.00230494188726395, "sim_compute_performance-ego1": 0.002164307879369324, "sim_compute_performance-ego2": 0.002122927267882945, "sim_compute_performance-ego3": 0.0021383323637670917}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 27.535002665632103, "get_ui_image": 0.052125212552644726, "step_physics": 0.9338675325458792, "survival_time": 59.99999999999873, "driven_lanedir": 26.95433570743388, "get_state_dump": 0.009908742253528249, "get_robot_state": 0.01506101539192549, "sim_render-ego0": 0.003983141480635644, "sim_render-ego1": 0.00394669222295731, "sim_render-ego2": 0.003922835277776536, "sim_render-ego3": 0.0039192101639772235, "get_duckie_state": 1.353089954334929e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.364051450554037, "agent_compute-ego0": 0.01450730025222359, "agent_compute-ego1": 0.0143500412632087, "agent_compute-ego2": 0.014134886461332576, "agent_compute-ego3": 0.014110300364244191, "complete-iteration": 1.1524708711733729, "set_robot_commands": 0.0023471949797288067, "deviation-center-line": 2.5518332722276544, "driven_lanedir_consec": 26.95433570743388, "sim_compute_sim_state": 0.0505277308496607, "sim_compute_performance-ego0": 0.002173218500802757, "sim_compute_performance-ego1": 0.0020764882518885834, "sim_compute_performance-ego2": 0.0020803480124493424, "sim_compute_performance-ego3": 0.002101155145281459}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 27.103082311934827, "get_ui_image": 0.052125212552644726, "step_physics": 0.9338675325458792, "survival_time": 59.99999999999873, "driven_lanedir": 26.416257882607916, "get_state_dump": 0.009908742253528249, "get_robot_state": 0.01506101539192549, "sim_render-ego0": 0.003983141480635644, "sim_render-ego1": 0.00394669222295731, "sim_render-ego2": 0.003922835277776536, "sim_render-ego3": 0.0039192101639772235, "get_duckie_state": 1.353089954334929e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.536372194299735, "agent_compute-ego0": 0.01450730025222359, "agent_compute-ego1": 0.0143500412632087, "agent_compute-ego2": 0.014134886461332576, "agent_compute-ego3": 0.014110300364244191, "complete-iteration": 1.1524708711733729, "set_robot_commands": 0.0023471949797288067, "deviation-center-line": 2.7249031915184134, "driven_lanedir_consec": 26.416257882607916, "sim_compute_sim_state": 0.0505277308496607, "sim_compute_performance-ego0": 0.002173218500802757, "sim_compute_performance-ego1": 0.0020764882518885834, "sim_compute_performance-ego2": 0.0020803480124493424, "sim_compute_performance-ego3": 0.002101155145281459}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 27.300554264428737, "get_ui_image": 0.052125212552644726, "step_physics": 0.9338675325458792, "survival_time": 59.99999999999873, "driven_lanedir": 26.755710538616015, "get_state_dump": 0.009908742253528249, "get_robot_state": 0.01506101539192549, "sim_render-ego0": 0.003983141480635644, "sim_render-ego1": 0.00394669222295731, "sim_render-ego2": 0.003922835277776536, "sim_render-ego3": 0.0039192101639772235, "get_duckie_state": 1.353089954334929e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.416794222499526, "agent_compute-ego0": 0.01450730025222359, "agent_compute-ego1": 0.0143500412632087, "agent_compute-ego2": 0.014134886461332576, "agent_compute-ego3": 0.014110300364244191, "complete-iteration": 1.1524708711733729, "set_robot_commands": 0.0023471949797288067, "deviation-center-line": 2.4844511690126176, "driven_lanedir_consec": 26.755710538616015, "sim_compute_sim_state": 0.0505277308496607, "sim_compute_performance-ego0": 0.002173218500802757, "sim_compute_performance-ego1": 0.0020764882518885834, "sim_compute_performance-ego2": 0.0020803480124493424, "sim_compute_performance-ego3": 0.002101155145281459}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 28.024014664942328, "get_ui_image": 0.052125212552644726, "step_physics": 0.9338675325458792, "survival_time": 59.99999999999873, "driven_lanedir": 27.632471559376445, "get_state_dump": 0.009908742253528249, "get_robot_state": 0.01506101539192549, "sim_render-ego0": 0.003983141480635644, "sim_render-ego1": 0.00394669222295731, "sim_render-ego2": 0.003922835277776536, "sim_render-ego3": 0.0039192101639772235, "get_duckie_state": 1.353089954334929e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.149281472097998, "agent_compute-ego0": 0.01450730025222359, "agent_compute-ego1": 0.0143500412632087, "agent_compute-ego2": 0.014134886461332576, "agent_compute-ego3": 0.014110300364244191, "complete-iteration": 1.1524708711733729, "set_robot_commands": 0.0023471949797288067, "deviation-center-line": 2.3905491924695164, "driven_lanedir_consec": 27.632471559376445, "sim_compute_sim_state": 0.0505277308496607, "sim_compute_performance-ego0": 0.002173218500802757, "sim_compute_performance-ego1": 0.0020764882518885834, "sim_compute_performance-ego2": 0.0020803480124493424, "sim_compute_performance-ego3": 0.002101155145281459}}
set_robot_commands_max0.002467035353928184
set_robot_commands_mean0.002407115166828495
set_robot_commands_median0.002407115166828495
set_robot_commands_min0.0023471949797288067
sim_compute_performance-ego0_max0.00230494188726395
sim_compute_performance-ego0_mean0.0022390801940333537
sim_compute_performance-ego0_median0.0022390801940333537
sim_compute_performance-ego0_min0.002173218500802757
sim_compute_performance-ego1_max0.002164307879369324
sim_compute_performance-ego1_mean0.0021203980656289536
sim_compute_performance-ego1_median0.0021203980656289536
sim_compute_performance-ego1_min0.0020764882518885834
sim_compute_performance-ego2_max0.002122927267882945
sim_compute_performance-ego2_mean0.002101637640166144
sim_compute_performance-ego2_median0.002101637640166144
sim_compute_performance-ego2_min0.0020803480124493424
sim_compute_performance-ego3_max0.0021383323637670917
sim_compute_performance-ego3_mean0.0021197437545242754
sim_compute_performance-ego3_median0.0021197437545242754
sim_compute_performance-ego3_min0.002101155145281459
sim_compute_sim_state_max0.0505277308496607
sim_compute_sim_state_mean0.042006278613723386
sim_compute_sim_state_median0.042006278613723386
sim_compute_sim_state_min0.03348482637778607
sim_render-ego0_max0.004107145941525474
sim_render-ego0_mean0.004045143711080559
sim_render-ego0_median0.004045143711080559
sim_render-ego0_min0.003983141480635644
sim_render-ego1_max0.004026269237762883
sim_render-ego1_mean0.003986480730360096
sim_render-ego1_median0.003986480730360096
sim_render-ego1_min0.00394669222295731
sim_render-ego2_max0.004153259985651402
sim_render-ego2_mean0.004038047631713969
sim_render-ego2_median0.004038047631713969
sim_render-ego2_min0.003922835277776536
sim_render-ego3_max0.004063337669086694
sim_render-ego3_mean0.003991273916531959
sim_render-ego3_median0.003991273916531959
sim_render-ego3_min0.0039192101639772235
simulation-passed1
step_physics_max0.9338675325458792
step_physics_mean0.8151044970646588
step_physics_median0.8151044970646588
step_physics_min0.6963414615834385
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6603113943YU CHENCBC Net v2 test - added mar 31 anomaly + mar 28 bc_v1aido-LF-sim-validationsim-1of4successnogpu-production-spot-3-030:12:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median14.585621220203992
survival_time_median59.99999999999873
deviation-center-line_median2.943278015023845
in-drivable-lane_median23.84999999999949


other stats
agent_compute-ego0_max0.09776046849805846
agent_compute-ego0_mean0.09776046849805846
agent_compute-ego0_median0.09776046849805846
agent_compute-ego0_min0.09776046849805846
complete-iteration_max0.340997743566864
complete-iteration_mean0.340997743566864
complete-iteration_median0.340997743566864
complete-iteration_min0.340997743566864
deviation-center-line_max2.943278015023845
deviation-center-line_mean2.943278015023845
deviation-center-line_min2.943278015023845
deviation-heading_max11.49743557264489
deviation-heading_mean11.49743557264489
deviation-heading_median11.49743557264489
deviation-heading_min11.49743557264489
driven_any_max25.723006165358665
driven_any_mean25.723006165358665
driven_any_median25.723006165358665
driven_any_min25.723006165358665
driven_lanedir_consec_max14.585621220203992
driven_lanedir_consec_mean14.585621220203992
driven_lanedir_consec_min14.585621220203992
driven_lanedir_max14.585621220203992
driven_lanedir_mean14.585621220203992
driven_lanedir_median14.585621220203992
driven_lanedir_min14.585621220203992
get_duckie_state_max1.9150907848399447e-06
get_duckie_state_mean1.9150907848399447e-06
get_duckie_state_median1.9150907848399447e-06
get_duckie_state_min1.9150907848399447e-06
get_robot_state_max0.004093568787586679
get_robot_state_mean0.004093568787586679
get_robot_state_median0.004093568787586679
get_robot_state_min0.004093568787586679
get_state_dump_max0.005197635201192915
get_state_dump_mean0.005197635201192915
get_state_dump_median0.005197635201192915
get_state_dump_min0.005197635201192915
get_ui_image_max0.03614092369460742
get_ui_image_mean0.03614092369460742
get_ui_image_median0.03614092369460742
get_ui_image_min0.03614092369460742
in-drivable-lane_max23.84999999999949
in-drivable-lane_mean23.84999999999949
in-drivable-lane_min23.84999999999949
per-episodes
details{"LF-norm-techtrack-000-ego0": {"driven_any": 25.723006165358665, "get_ui_image": 0.03614092369460742, "step_physics": 0.17494165847740206, "survival_time": 59.99999999999873, "driven_lanedir": 14.585621220203992, "get_state_dump": 0.005197635201192915, "get_robot_state": 0.004093568787586679, "sim_render-ego0": 0.004219859367008511, "get_duckie_state": 1.9150907848399447e-06, "in-drivable-lane": 23.84999999999949, "deviation-heading": 11.49743557264489, "agent_compute-ego0": 0.09776046849805846, "complete-iteration": 0.340997743566864, "set_robot_commands": 0.00259944322603529, "deviation-center-line": 2.943278015023845, "driven_lanedir_consec": 14.585621220203992, "sim_compute_sim_state": 0.013677291925701869, "sim_compute_performance-ego0": 0.002260074726647878}}
set_robot_commands_max0.00259944322603529
set_robot_commands_mean0.00259944322603529
set_robot_commands_median0.00259944322603529
set_robot_commands_min0.00259944322603529
sim_compute_performance-ego0_max0.002260074726647878
sim_compute_performance-ego0_mean0.002260074726647878
sim_compute_performance-ego0_median0.002260074726647878
sim_compute_performance-ego0_min0.002260074726647878
sim_compute_sim_state_max0.013677291925701869
sim_compute_sim_state_mean0.013677291925701869
sim_compute_sim_state_median0.013677291925701869
sim_compute_sim_state_min0.013677291925701869
sim_render-ego0_max0.004219859367008511
sim_render-ego0_mean0.004219859367008511
sim_render-ego0_median0.004219859367008511
sim_render-ego0_min0.004219859367008511
simulation-passed1
step_physics_max0.17494165847740206
step_physics_mean0.17494165847740206
step_physics_median0.17494165847740206
step_physics_min0.17494165847740206
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6602013964YU CHENCBC Net v2 test - APR 3 BC TFdata + mar 28 anomalyaido-LF-sim-validationsim-3of4successnogpu-production-spot-3-030:03:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.152967562510235
survival_time_median11.55000000000003
deviation-center-line_median0.510418622956628
in-drivable-lane_median5.100000000000017


other stats
agent_compute-ego0_max0.09889608210530774
agent_compute-ego0_mean0.09889608210530774
agent_compute-ego0_median0.09889608210530774
agent_compute-ego0_min0.09889608210530774
complete-iteration_max0.34434928770723017
complete-iteration_mean0.34434928770723017
complete-iteration_median0.34434928770723017
complete-iteration_min0.34434928770723017
deviation-center-line_max0.510418622956628
deviation-center-line_mean0.510418622956628
deviation-center-line_min0.510418622956628
deviation-heading_max2.3146721893290256
deviation-heading_mean2.3146721893290256
deviation-heading_median2.3146721893290256
deviation-heading_min2.3146721893290256
driven_any_max3.960840262455693
driven_any_mean3.960840262455693
driven_any_median3.960840262455693
driven_any_min3.960840262455693
driven_lanedir_consec_max2.152967562510235
driven_lanedir_consec_mean2.152967562510235
driven_lanedir_consec_min2.152967562510235
driven_lanedir_max2.152967562510235
driven_lanedir_mean2.152967562510235
driven_lanedir_median2.152967562510235
driven_lanedir_min2.152967562510235
get_duckie_state_max1.3554918354955214e-06
get_duckie_state_mean1.3554918354955214e-06
get_duckie_state_median1.3554918354955214e-06
get_duckie_state_min1.3554918354955214e-06
get_robot_state_max0.004111687684881276
get_robot_state_mean0.004111687684881276
get_robot_state_median0.004111687684881276
get_robot_state_min0.004111687684881276
get_state_dump_max0.005104873714775875
get_state_dump_mean0.005104873714775875
get_state_dump_median0.005104873714775875
get_state_dump_min0.005104873714775875
get_ui_image_max0.04076365869620751
get_ui_image_mean0.04076365869620751
get_ui_image_median0.04076365869620751
get_ui_image_min0.04076365869620751
in-drivable-lane_max5.100000000000017
in-drivable-lane_mean5.100000000000017
in-drivable-lane_min5.100000000000017
per-episodes
details{"LF-norm-zigzag-000-ego0": {"driven_any": 3.960840262455693, "get_ui_image": 0.04076365869620751, "step_physics": 0.17427557706832886, "survival_time": 11.55000000000003, "driven_lanedir": 2.152967562510235, "get_state_dump": 0.005104873714775875, "get_robot_state": 0.004111687684881276, "sim_render-ego0": 0.004232910172692661, "get_duckie_state": 1.3554918354955214e-06, "in-drivable-lane": 5.100000000000017, "deviation-heading": 2.3146721893290256, "agent_compute-ego0": 0.09889608210530774, "complete-iteration": 0.34434928770723017, "set_robot_commands": 0.0026407354864580877, "deviation-center-line": 0.510418622956628, "driven_lanedir_consec": 2.152967562510235, "sim_compute_sim_state": 0.01195336415849883, "sim_compute_performance-ego0": 0.002278574581803947}}
set_robot_commands_max0.0026407354864580877
set_robot_commands_mean0.0026407354864580877
set_robot_commands_median0.0026407354864580877
set_robot_commands_min0.0026407354864580877
sim_compute_performance-ego0_max0.002278574581803947
sim_compute_performance-ego0_mean0.002278574581803947
sim_compute_performance-ego0_median0.002278574581803947
sim_compute_performance-ego0_min0.002278574581803947
sim_compute_sim_state_max0.01195336415849883
sim_compute_sim_state_mean0.01195336415849883
sim_compute_sim_state_median0.01195336415849883
sim_compute_sim_state_min0.01195336415849883
sim_render-ego0_max0.004232910172692661
sim_render-ego0_mean0.004232910172692661
sim_render-ego0_median0.004232910172692661
sim_render-ego0_min0.004232910172692661
simulation-passed1
step_physics_max0.17427557706832886
step_physics_mean0.17427557706832886
step_physics_median0.17427557706832886
step_physics_min0.17427557706832886
survival_time_max11.55000000000003
survival_time_mean11.55000000000003
survival_time_min11.55000000000003
No reset possible
6601113993Frank (Chude) QianΒ πŸ‡¨πŸ‡¦CBC Net - MixTraining - Expert LF Human LFP - Best Lossaido-LF-sim-validationsim-3of4successnogpu-production-spot-3-030:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5750441837899909
survival_time_median4.149999999999993
deviation-center-line_median0.0788413563671545
in-drivable-lane_median2.4999999999999925


other stats
agent_compute-ego0_max0.058674355347951256
agent_compute-ego0_mean0.058674355347951256
agent_compute-ego0_median0.058674355347951256
agent_compute-ego0_min0.058674355347951256
complete-iteration_max0.27432009719666983
complete-iteration_mean0.27432009719666983
complete-iteration_median0.27432009719666983
complete-iteration_min0.27432009719666983
deviation-center-line_max0.0788413563671545
deviation-center-line_mean0.0788413563671545
deviation-center-line_min0.0788413563671545
deviation-heading_max0.5403287564388415
deviation-heading_mean0.5403287564388415
deviation-heading_median0.5403287564388415
deviation-heading_min0.5403287564388415
driven_any_max1.3464840286958533
driven_any_mean1.3464840286958533
driven_any_median1.3464840286958533
driven_any_min1.3464840286958533
driven_lanedir_consec_max0.5750441837899909
driven_lanedir_consec_mean0.5750441837899909
driven_lanedir_consec_min0.5750441837899909
driven_lanedir_max0.5750441837899909
driven_lanedir_mean0.5750441837899909
driven_lanedir_median0.5750441837899909
driven_lanedir_min0.5750441837899909
get_duckie_state_max1.538367498488653e-06
get_duckie_state_mean1.538367498488653e-06
get_duckie_state_median1.538367498488653e-06
get_duckie_state_min1.538367498488653e-06
get_robot_state_max0.0043501513344900945
get_robot_state_mean0.0043501513344900945
get_robot_state_median0.0043501513344900945
get_robot_state_min0.0043501513344900945
get_state_dump_max0.005564519337245396
get_state_dump_mean0.005564519337245396
get_state_dump_median0.005564519337245396
get_state_dump_min0.005564519337245396
get_ui_image_max0.03740075656345913
get_ui_image_mean0.03740075656345913
get_ui_image_median0.03740075656345913
get_ui_image_min0.03740075656345913
in-drivable-lane_max2.4999999999999925
in-drivable-lane_mean2.4999999999999925
in-drivable-lane_min2.4999999999999925
per-episodes
details{"LF-norm-zigzag-000-ego0": {"driven_any": 1.3464840286958533, "get_ui_image": 0.03740075656345913, "step_physics": 0.14831656785238356, "survival_time": 4.149999999999993, "driven_lanedir": 0.5750441837899909, "get_state_dump": 0.005564519337245396, "get_robot_state": 0.0043501513344900945, "sim_render-ego0": 0.00452929451352074, "get_duckie_state": 1.538367498488653e-06, "in-drivable-lane": 2.4999999999999925, "deviation-heading": 0.5403287564388415, "agent_compute-ego0": 0.058674355347951256, "complete-iteration": 0.27432009719666983, "set_robot_commands": 0.0027144011997041247, "deviation-center-line": 0.0788413563671545, "driven_lanedir_consec": 0.5750441837899909, "sim_compute_sim_state": 0.01028144359588623, "sim_compute_performance-ego0": 0.002377175149463472}}
set_robot_commands_max0.0027144011997041247
set_robot_commands_mean0.0027144011997041247
set_robot_commands_median0.0027144011997041247
set_robot_commands_min0.0027144011997041247
sim_compute_performance-ego0_max0.002377175149463472
sim_compute_performance-ego0_mean0.002377175149463472
sim_compute_performance-ego0_median0.002377175149463472
sim_compute_performance-ego0_min0.002377175149463472
sim_compute_sim_state_max0.01028144359588623
sim_compute_sim_state_mean0.01028144359588623
sim_compute_sim_state_median0.01028144359588623
sim_compute_sim_state_min0.01028144359588623
sim_render-ego0_max0.00452929451352074
sim_render-ego0_mean0.00452929451352074
sim_render-ego0_median0.00452929451352074
sim_render-ego0_min0.00452929451352074
simulation-passed1
step_physics_max0.14831656785238356
step_physics_mean0.14831656785238356
step_physics_median0.14831656785238356
step_physics_min0.14831656785238356
survival_time_max4.149999999999993
survival_time_mean4.149999999999993
survival_time_min4.149999999999993
No reset possible
6594814033YU CHENCBC V2, mar28_apr6 bc, mar31_apr6 anomaly aido-LF-sim-validationsim-0of4successnogpu-production-spot-3-030:11:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median20.13491249302489
survival_time_median59.99999999999873
deviation-center-line_median3.7986680624163425
in-drivable-lane_median11.149999999999764


other stats
agent_compute-ego0_max0.09864743127116156
agent_compute-ego0_mean0.09864743127116156
agent_compute-ego0_median0.09864743127116156
agent_compute-ego0_min0.09864743127116156
complete-iteration_max0.3105975406354512
complete-iteration_mean0.3105975406354512
complete-iteration_median0.3105975406354512
complete-iteration_min0.3105975406354512
deviation-center-line_max3.7986680624163425
deviation-center-line_mean3.7986680624163425
deviation-center-line_min3.7986680624163425
deviation-heading_max8.90711191714979
deviation-heading_mean8.90711191714979
deviation-heading_median8.90711191714979
deviation-heading_min8.90711191714979
driven_any_max25.125883209025616
driven_any_mean25.125883209025616
driven_any_median25.125883209025616
driven_any_min25.125883209025616
driven_lanedir_consec_max20.13491249302489
driven_lanedir_consec_mean20.13491249302489
driven_lanedir_consec_min20.13491249302489
driven_lanedir_max20.13491249302489
driven_lanedir_mean20.13491249302489
driven_lanedir_median20.13491249302489
driven_lanedir_min20.13491249302489
get_duckie_state_max1.418798988208882e-06
get_duckie_state_mean1.418798988208882e-06
get_duckie_state_median1.418798988208882e-06
get_duckie_state_min1.418798988208882e-06
get_robot_state_max0.004423252648854633
get_robot_state_mean0.004423252648854633
get_robot_state_median0.004423252648854633
get_robot_state_min0.004423252648854633
get_state_dump_max0.005437762612208638
get_state_dump_mean0.005437762612208638
get_state_dump_median0.005437762612208638
get_state_dump_min0.005437762612208638
get_ui_image_max0.03238785832648869
get_ui_image_mean0.03238785832648869
get_ui_image_median0.03238785832648869
get_ui_image_min0.03238785832648869
in-drivable-lane_max11.149999999999764
in-drivable-lane_mean11.149999999999764
in-drivable-lane_min11.149999999999764
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 25.125883209025616, "get_ui_image": 0.03238785832648869, "step_physics": 0.14905886943890193, "survival_time": 59.99999999999873, "driven_lanedir": 20.13491249302489, "get_state_dump": 0.005437762612208638, "get_robot_state": 0.004423252648854633, "sim_render-ego0": 0.0044955818182622065, "get_duckie_state": 1.418798988208882e-06, "in-drivable-lane": 11.149999999999764, "deviation-heading": 8.90711191714979, "agent_compute-ego0": 0.09864743127116156, "complete-iteration": 0.3105975406354512, "set_robot_commands": 0.002837902898097614, "deviation-center-line": 3.7986680624163425, "driven_lanedir_consec": 20.13491249302489, "sim_compute_sim_state": 0.01077118463857684, "sim_compute_performance-ego0": 0.0024322848038113585}}
set_robot_commands_max0.002837902898097614
set_robot_commands_mean0.002837902898097614
set_robot_commands_median0.002837902898097614
set_robot_commands_min0.002837902898097614
sim_compute_performance-ego0_max0.0024322848038113585
sim_compute_performance-ego0_mean0.0024322848038113585
sim_compute_performance-ego0_median0.0024322848038113585
sim_compute_performance-ego0_min0.0024322848038113585
sim_compute_sim_state_max0.01077118463857684
sim_compute_sim_state_mean0.01077118463857684
sim_compute_sim_state_median0.01077118463857684
sim_compute_sim_state_min0.01077118463857684
sim_render-ego0_max0.0044955818182622065
sim_render-ego0_mean0.0044955818182622065
sim_render-ego0_median0.0044955818182622065
sim_render-ego0_min0.0044955818182622065
simulation-passed1
step_physics_max0.14905886943890193
step_physics_mean0.14905886943890193
step_physics_median0.14905886943890193
step_physics_min0.14905886943890193
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6587813535AndrΓ‘s KalaposΒ πŸ‡­πŸ‡Ί3090aido-LF-sim-validationsim-2of4successnogpu-production-spot-3-030:12:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median28.238911837804295
survival_time_median59.99999999999873
deviation-center-line_median1.6555291663045095
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.014801519101704288
agent_compute-ego0_mean0.014801519101704288
agent_compute-ego0_median0.014801519101704288
agent_compute-ego0_min0.014801519101704288
complete-iteration_max0.202579332926589
complete-iteration_mean0.202579332926589
complete-iteration_median0.202579332926589
complete-iteration_min0.202579332926589
deviation-center-line_max1.6555291663045095
deviation-center-line_mean1.6555291663045095
deviation-center-line_min1.6555291663045095
deviation-heading_max5.205871208843381
deviation-heading_mean5.205871208843381
deviation-heading_median5.205871208843381
deviation-heading_min5.205871208843381
driven_any_max28.41622766818373
driven_any_mean28.41622766818373
driven_any_median28.41622766818373
driven_any_min28.41622766818373
driven_lanedir_consec_max28.238911837804295
driven_lanedir_consec_mean28.238911837804295
driven_lanedir_consec_min28.238911837804295
driven_lanedir_max28.238911837804295
driven_lanedir_mean28.238911837804295
driven_lanedir_median28.238911837804295
driven_lanedir_min28.238911837804295
get_duckie_state_max1.4366654928876002e-06
get_duckie_state_mean1.4366654928876002e-06
get_duckie_state_median1.4366654928876002e-06
get_duckie_state_min1.4366654928876002e-06
get_robot_state_max0.0040320925271878335
get_robot_state_mean0.0040320925271878335
get_robot_state_median0.0040320925271878335
get_robot_state_min0.0040320925271878335
get_state_dump_max0.005185436547348442
get_state_dump_mean0.005185436547348442
get_state_dump_median0.005185436547348442
get_state_dump_min0.005185436547348442
get_ui_image_max0.028535393255140065
get_ui_image_mean0.028535393255140065
get_ui_image_median0.028535393255140065
get_ui_image_min0.028535393255140065
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-small_loop-000-ego0": {"driven_any": 28.41622766818373, "get_ui_image": 0.028535393255140065, "step_physics": 0.13445418879551058, "survival_time": 59.99999999999873, "driven_lanedir": 28.238911837804295, "get_state_dump": 0.005185436547348442, "get_robot_state": 0.0040320925271878335, "sim_render-ego0": 0.004148262128742608, "get_duckie_state": 1.4366654928876002e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.205871208843381, "agent_compute-ego0": 0.014801519101704288, "complete-iteration": 0.202579332926589, "set_robot_commands": 0.002455252989642725, "deviation-center-line": 1.6555291663045095, "driven_lanedir_consec": 28.238911837804295, "sim_compute_sim_state": 0.00668408471678417, "sim_compute_performance-ego0": 0.002183354168906994}}
set_robot_commands_max0.002455252989642725
set_robot_commands_mean0.002455252989642725
set_robot_commands_median0.002455252989642725
set_robot_commands_min0.002455252989642725
sim_compute_performance-ego0_max0.002183354168906994
sim_compute_performance-ego0_mean0.002183354168906994
sim_compute_performance-ego0_median0.002183354168906994
sim_compute_performance-ego0_min0.002183354168906994
sim_compute_sim_state_max0.00668408471678417
sim_compute_sim_state_mean0.00668408471678417
sim_compute_sim_state_median0.00668408471678417
sim_compute_sim_state_min0.00668408471678417
sim_render-ego0_max0.004148262128742608
sim_render-ego0_mean0.004148262128742608
sim_render-ego0_median0.004148262128742608
sim_render-ego0_min0.004148262128742608
simulation-passed1
step_physics_max0.13445418879551058
step_physics_mean0.13445418879551058
step_physics_median0.13445418879551058
step_physics_min0.13445418879551058
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible