Duckietown Challenges Home Challenges Submissions

Evaluator 5112

ID5112
evaluatorgpu-production-spot-1-02
ownerI don't have one πŸ˜€
machinegpu-prod_25b8c20bf58f
processgpu-production-spot-1-02_25b8c20bf58f
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success11 65897
# timeout
# failed
# error
# aborted2 66277
# host-error1 66088
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors100%
RAM total (MB)249.0 GB
RAM free (MB)238.2 GB
Disk (MB)969.3 GB
Disk available (MB)865.4 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6628413686Anthony CourchesneΒ πŸ‡¨πŸ‡¦Real100FHaido-LF-sim-validationsim-2of4successnogpu-production-spot-1-020:08:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.355805663483838
survival_time_median59.99999999999873
deviation-center-line_median3.1766387784051706
in-drivable-lane_median22.69999999999952


other stats
agent_compute-ego0_max0.03851025031071519
agent_compute-ego0_mean0.03851025031071519
agent_compute-ego0_median0.03851025031071519
agent_compute-ego0_min0.03851025031071519
complete-iteration_max0.19087058777217564
complete-iteration_mean0.19087058777217564
complete-iteration_median0.19087058777217564
complete-iteration_min0.19087058777217564
deviation-center-line_max3.1766387784051706
deviation-center-line_mean3.1766387784051706
deviation-center-line_min3.1766387784051706
deviation-heading_max12.008215956979042
deviation-heading_mean12.008215956979042
deviation-heading_median12.008215956979042
deviation-heading_min12.008215956979042
driven_any_max12.536618181312257
driven_any_mean12.536618181312257
driven_any_median12.536618181312257
driven_any_min12.536618181312257
driven_lanedir_consec_max7.355805663483838
driven_lanedir_consec_mean7.355805663483838
driven_lanedir_consec_min7.355805663483838
driven_lanedir_max7.355805663483838
driven_lanedir_mean7.355805663483838
driven_lanedir_median7.355805663483838
driven_lanedir_min7.355805663483838
get_duckie_state_max1.5909129832805344e-06
get_duckie_state_mean1.5909129832805344e-06
get_duckie_state_median1.5909129832805344e-06
get_duckie_state_min1.5909129832805344e-06
get_robot_state_max0.003669111059666871
get_robot_state_mean0.003669111059666871
get_robot_state_median0.003669111059666871
get_robot_state_min0.003669111059666871
get_state_dump_max0.004476602230342004
get_state_dump_mean0.004476602230342004
get_state_dump_median0.004476602230342004
get_state_dump_min0.004476602230342004
get_ui_image_max0.02639124395448302
get_ui_image_mean0.02639124395448302
get_ui_image_median0.02639124395448302
get_ui_image_min0.02639124395448302
in-drivable-lane_max22.69999999999952
in-drivable-lane_mean22.69999999999952
in-drivable-lane_min22.69999999999952
per-episodes
details{"LF-norm-small_loop-000-ego0": {"driven_any": 12.536618181312257, "get_ui_image": 0.02639124395448302, "step_physics": 0.10380923996162256, "survival_time": 59.99999999999873, "driven_lanedir": 7.355805663483838, "get_state_dump": 0.004476602230342004, "get_robot_state": 0.003669111059666871, "sim_render-ego0": 0.003705694316130296, "get_duckie_state": 1.5909129832805344e-06, "in-drivable-lane": 22.69999999999952, "deviation-heading": 12.008215956979042, "agent_compute-ego0": 0.03851025031071519, "complete-iteration": 0.19087058777217564, "set_robot_commands": 0.0022286632277387862, "deviation-center-line": 3.1766387784051706, "driven_lanedir_consec": 7.355805663483838, "sim_compute_sim_state": 0.006073824273458032, "sim_compute_performance-ego0": 0.001929645633618103}}
set_robot_commands_max0.0022286632277387862
set_robot_commands_mean0.0022286632277387862
set_robot_commands_median0.0022286632277387862
set_robot_commands_min0.0022286632277387862
sim_compute_performance-ego0_max0.001929645633618103
sim_compute_performance-ego0_mean0.001929645633618103
sim_compute_performance-ego0_median0.001929645633618103
sim_compute_performance-ego0_min0.001929645633618103
sim_compute_sim_state_max0.006073824273458032
sim_compute_sim_state_mean0.006073824273458032
sim_compute_sim_state_median0.006073824273458032
sim_compute_sim_state_min0.006073824273458032
sim_render-ego0_max0.003705694316130296
sim_render-ego0_mean0.003705694316130296
sim_render-ego0_median0.003705694316130296
sim_render-ego0_min0.003705694316130296
simulation-passed1
step_physics_max0.10380923996162256
step_physics_mean0.10380923996162256
step_physics_median0.10380923996162256
step_physics_min0.10380923996162256
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6628213798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-1-020:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6627713798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-1-020:00:47
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6623413909YU CHENCBC Net v2 - testaido-LF-sim-validationsim-3of4successnogpu-production-spot-1-020:12:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median13.11855266360694
survival_time_median59.99999999999873
deviation-center-line_median2.6998220824103885
in-drivable-lane_median22.449999999999577


other stats
agent_compute-ego0_max0.0938351797521561
agent_compute-ego0_mean0.0938351797521561
agent_compute-ego0_median0.0938351797521561
agent_compute-ego0_min0.0938351797521561
complete-iteration_max0.3525015116730499
complete-iteration_mean0.3525015116730499
complete-iteration_median0.3525015116730499
complete-iteration_min0.3525015116730499
deviation-center-line_max2.6998220824103885
deviation-center-line_mean2.6998220824103885
deviation-center-line_min2.6998220824103885
deviation-heading_max14.250602068947932
deviation-heading_mean14.250602068947932
deviation-heading_median14.250602068947932
deviation-heading_min14.250602068947932
driven_any_max23.949632005019197
driven_any_mean23.949632005019197
driven_any_median23.949632005019197
driven_any_min23.949632005019197
driven_lanedir_consec_max13.11855266360694
driven_lanedir_consec_mean13.11855266360694
driven_lanedir_consec_min13.11855266360694
driven_lanedir_max13.11855266360694
driven_lanedir_mean13.11855266360694
driven_lanedir_median13.11855266360694
driven_lanedir_min13.11855266360694
get_duckie_state_max1.2959171393630309e-06
get_duckie_state_mean1.2959171393630309e-06
get_duckie_state_median1.2959171393630309e-06
get_duckie_state_min1.2959171393630309e-06
get_robot_state_max0.004070280592804844
get_robot_state_mean0.004070280592804844
get_robot_state_median0.004070280592804844
get_robot_state_min0.004070280592804844
get_state_dump_max0.005136562723799808
get_state_dump_mean0.005136562723799808
get_state_dump_median0.005136562723799808
get_state_dump_min0.005136562723799808
get_ui_image_max0.03921401570182756
get_ui_image_mean0.03921401570182756
get_ui_image_median0.03921401570182756
get_ui_image_min0.03921401570182756
in-drivable-lane_max22.449999999999577
in-drivable-lane_mean22.449999999999577
in-drivable-lane_min22.449999999999577
per-episodes
details{"LF-norm-zigzag-000-ego0": {"driven_any": 23.949632005019197, "get_ui_image": 0.03921401570182756, "step_physics": 0.18629216453018632, "survival_time": 59.99999999999873, "driven_lanedir": 13.11855266360694, "get_state_dump": 0.005136562723799808, "get_robot_state": 0.004070280592804844, "sim_render-ego0": 0.004161004122846033, "get_duckie_state": 1.2959171393630309e-06, "in-drivable-lane": 22.449999999999577, "deviation-heading": 14.250602068947932, "agent_compute-ego0": 0.0938351797521561, "complete-iteration": 0.3525015116730499, "set_robot_commands": 0.0026586323753185416, "deviation-center-line": 2.6998220824103885, "driven_lanedir_consec": 13.11855266360694, "sim_compute_sim_state": 0.014789683931971668, "sim_compute_performance-ego0": 0.0022513366162429543}}
set_robot_commands_max0.0026586323753185416
set_robot_commands_mean0.0026586323753185416
set_robot_commands_median0.0026586323753185416
set_robot_commands_min0.0026586323753185416
sim_compute_performance-ego0_max0.0022513366162429543
sim_compute_performance-ego0_mean0.0022513366162429543
sim_compute_performance-ego0_median0.0022513366162429543
sim_compute_performance-ego0_min0.0022513366162429543
sim_compute_sim_state_max0.014789683931971668
sim_compute_sim_state_mean0.014789683931971668
sim_compute_sim_state_median0.014789683931971668
sim_compute_sim_state_min0.014789683931971668
sim_render-ego0_max0.004161004122846033
sim_render-ego0_mean0.004161004122846033
sim_render-ego0_median0.004161004122846033
sim_render-ego0_min0.004161004122846033
simulation-passed1
step_physics_max0.18629216453018632
step_physics_mean0.18629216453018632
step_physics_median0.18629216453018632
step_physics_min0.18629216453018632
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6623013540AndrΓ‘s KalaposΒ πŸ‡­πŸ‡Ί3090aido-LFP-sim-testingsim-2of4successnogpu-production-spot-1-020:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.7000000000000008
in-drivable-lane_median0.0
driven_lanedir_consec_median0.35296912830735283
deviation-center-line_median0.07758282854933857


other stats
agent_compute-ego0_max0.017392090388706753
agent_compute-ego0_mean0.017392090388706753
agent_compute-ego0_median0.017392090388706753
agent_compute-ego0_min0.017392090388706753
complete-iteration_max0.2165571008409773
complete-iteration_mean0.2165571008409773
complete-iteration_median0.2165571008409773
complete-iteration_min0.2165571008409773
deviation-center-line_max0.07758282854933857
deviation-center-line_mean0.07758282854933857
deviation-center-line_min0.07758282854933857
deviation-heading_max0.20950925697284384
deviation-heading_mean0.20950925697284384
deviation-heading_median0.20950925697284384
deviation-heading_min0.20950925697284384
driven_any_max0.35625075510618204
driven_any_mean0.35625075510618204
driven_any_median0.35625075510618204
driven_any_min0.35625075510618204
driven_lanedir_consec_max0.35296912830735283
driven_lanedir_consec_mean0.35296912830735283
driven_lanedir_consec_min0.35296912830735283
driven_lanedir_max0.35296912830735283
driven_lanedir_mean0.35296912830735283
driven_lanedir_median0.35296912830735283
driven_lanedir_min0.35296912830735283
get_duckie_state_max0.02870511327471052
get_duckie_state_mean0.02870511327471052
get_duckie_state_median0.02870511327471052
get_duckie_state_min0.02870511327471052
get_robot_state_max0.004358536856515067
get_robot_state_mean0.004358536856515067
get_robot_state_median0.004358536856515067
get_robot_state_min0.004358536856515067
get_state_dump_max0.010388857977730887
get_state_dump_mean0.010388857977730887
get_state_dump_median0.010388857977730887
get_state_dump_min0.010388857977730887
get_ui_image_max0.03628466469900948
get_ui_image_mean0.03628466469900948
get_ui_image_median0.03628466469900948
get_ui_image_min0.03628466469900948
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 0.35625075510618204, "get_ui_image": 0.03628466469900948, "step_physics": 0.10338655199323382, "survival_time": 1.7000000000000008, "driven_lanedir": 0.35296912830735283, "get_state_dump": 0.010388857977730887, "get_robot_state": 0.004358536856515067, "sim_render-ego0": 0.004592316491263253, "get_duckie_state": 0.02870511327471052, "in-drivable-lane": 0.0, "deviation-heading": 0.20950925697284384, "agent_compute-ego0": 0.017392090388706753, "complete-iteration": 0.2165571008409773, "set_robot_commands": 0.0027479512350899833, "deviation-center-line": 0.07758282854933857, "driven_lanedir_consec": 0.35296912830735283, "sim_compute_sim_state": 0.006110307148524693, "sim_compute_performance-ego0": 0.002468960625784738}}
set_robot_commands_max0.0027479512350899833
set_robot_commands_mean0.0027479512350899833
set_robot_commands_median0.0027479512350899833
set_robot_commands_min0.0027479512350899833
sim_compute_performance-ego0_max0.002468960625784738
sim_compute_performance-ego0_mean0.002468960625784738
sim_compute_performance-ego0_median0.002468960625784738
sim_compute_performance-ego0_min0.002468960625784738
sim_compute_sim_state_max0.006110307148524693
sim_compute_sim_state_mean0.006110307148524693
sim_compute_sim_state_median0.006110307148524693
sim_compute_sim_state_min0.006110307148524693
sim_render-ego0_max0.004592316491263253
sim_render-ego0_mean0.004592316491263253
sim_render-ego0_median0.004592316491263253
sim_render-ego0_min0.004592316491263253
simulation-passed1
step_physics_max0.10338655199323382
step_physics_mean0.10338655199323382
step_physics_median0.10338655199323382
step_physics_min0.10338655199323382
survival_time_max1.7000000000000008
survival_time_mean1.7000000000000008
survival_time_min1.7000000000000008
No reset possible
6622713540AndrΓ‘s KalaposΒ πŸ‡­πŸ‡Ί3090aido-LFP-sim-testingsim-2of4successnogpu-production-spot-1-020:01:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.7000000000000008
in-drivable-lane_median0.0
driven_lanedir_consec_median0.3522771319289384
deviation-center-line_median0.07523452261896645


other stats
agent_compute-ego0_max0.018014138085501535
agent_compute-ego0_mean0.018014138085501535
agent_compute-ego0_median0.018014138085501535
agent_compute-ego0_min0.018014138085501535
complete-iteration_max0.21872844014848983
complete-iteration_mean0.21872844014848983
complete-iteration_median0.21872844014848983
complete-iteration_min0.21872844014848983
deviation-center-line_max0.07523452261896645
deviation-center-line_mean0.07523452261896645
deviation-center-line_min0.07523452261896645
deviation-heading_max0.2004805037569577
deviation-heading_mean0.2004805037569577
deviation-heading_median0.2004805037569577
deviation-heading_min0.2004805037569577
driven_any_max0.3553917915431748
driven_any_mean0.3553917915431748
driven_any_median0.3553917915431748
driven_any_min0.3553917915431748
driven_lanedir_consec_max0.3522771319289384
driven_lanedir_consec_mean0.3522771319289384
driven_lanedir_consec_min0.3522771319289384
driven_lanedir_max0.3522771319289384
driven_lanedir_mean0.3522771319289384
driven_lanedir_median0.3522771319289384
driven_lanedir_min0.3522771319289384
get_duckie_state_max0.02837306431361607
get_duckie_state_mean0.02837306431361607
get_duckie_state_median0.02837306431361607
get_duckie_state_min0.02837306431361607
get_robot_state_max0.004279157093593052
get_robot_state_mean0.004279157093593052
get_robot_state_median0.004279157093593052
get_robot_state_min0.004279157093593052
get_state_dump_max0.010222182955060688
get_state_dump_mean0.010222182955060688
get_state_dump_median0.010222182955060688
get_state_dump_min0.010222182955060688
get_ui_image_max0.037303529466901506
get_ui_image_mean0.037303529466901506
get_ui_image_median0.037303529466901506
get_ui_image_min0.037303529466901506
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 0.3553917915431748, "get_ui_image": 0.037303529466901506, "step_physics": 0.10527276992797852, "survival_time": 1.7000000000000008, "driven_lanedir": 0.3522771319289384, "get_state_dump": 0.010222182955060688, "get_robot_state": 0.004279157093593052, "sim_render-ego0": 0.004216017041887556, "get_duckie_state": 0.02837306431361607, "in-drivable-lane": 0.0, "deviation-heading": 0.2004805037569577, "agent_compute-ego0": 0.018014138085501535, "complete-iteration": 0.21872844014848983, "set_robot_commands": 0.002665805816650391, "deviation-center-line": 0.07523452261896645, "driven_lanedir_consec": 0.3522771319289384, "sim_compute_sim_state": 0.0059951509748186384, "sim_compute_performance-ego0": 0.0022690159933907647}}
set_robot_commands_max0.002665805816650391
set_robot_commands_mean0.002665805816650391
set_robot_commands_median0.002665805816650391
set_robot_commands_min0.002665805816650391
sim_compute_performance-ego0_max0.0022690159933907647
sim_compute_performance-ego0_mean0.0022690159933907647
sim_compute_performance-ego0_median0.0022690159933907647
sim_compute_performance-ego0_min0.0022690159933907647
sim_compute_sim_state_max0.0059951509748186384
sim_compute_sim_state_mean0.0059951509748186384
sim_compute_sim_state_median0.0059951509748186384
sim_compute_sim_state_min0.0059951509748186384
sim_render-ego0_max0.004216017041887556
sim_render-ego0_mean0.004216017041887556
sim_render-ego0_median0.004216017041887556
sim_render-ego0_min0.004216017041887556
simulation-passed1
step_physics_max0.10527276992797852
step_physics_mean0.10527276992797852
step_physics_median0.10527276992797852
step_physics_min0.10527276992797852
survival_time_max1.7000000000000008
survival_time_mean1.7000000000000008
survival_time_min1.7000000000000008
No reset possible
6620613944YU CHENCBC Net v2 test - added mar 31 anomaly + mar 28 bc_v1aido-LFP-sim-validationsim-3of4successnogpu-production-spot-1-020:05:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median23.7000000000002
in-drivable-lane_median7.950000000000074
driven_lanedir_consec_median6.137112539000098
deviation-center-line_median1.1652307156500996


other stats
agent_compute-ego0_max0.0959400749206543
agent_compute-ego0_mean0.0959400749206543
agent_compute-ego0_median0.0959400749206543
agent_compute-ego0_min0.0959400749206543
complete-iteration_max0.3574443641461824
complete-iteration_mean0.3574443641461824
complete-iteration_median0.3574443641461824
complete-iteration_min0.3574443641461824
deviation-center-line_max1.1652307156500996
deviation-center-line_mean1.1652307156500996
deviation-center-line_min1.1652307156500996
deviation-heading_max4.381090385260154
deviation-heading_mean4.381090385260154
deviation-heading_median4.381090385260154
deviation-heading_min4.381090385260154
driven_any_max9.911005485825156
driven_any_mean9.911005485825156
driven_any_median9.911005485825156
driven_any_min9.911005485825156
driven_lanedir_consec_max6.137112539000098
driven_lanedir_consec_mean6.137112539000098
driven_lanedir_consec_min6.137112539000098
driven_lanedir_max6.137112539000098
driven_lanedir_mean6.137112539000098
driven_lanedir_median6.137112539000098
driven_lanedir_min6.137112539000098
get_duckie_state_max0.02271660152234529
get_duckie_state_mean0.02271660152234529
get_duckie_state_median0.02271660152234529
get_duckie_state_min0.02271660152234529
get_robot_state_max0.00409389947590075
get_robot_state_mean0.00409389947590075
get_robot_state_median0.00409389947590075
get_robot_state_min0.00409389947590075
get_state_dump_max0.008673487211528576
get_state_dump_mean0.008673487211528576
get_state_dump_median0.008673487211528576
get_state_dump_min0.008673487211528576
get_ui_image_max0.03924234340065404
get_ui_image_mean0.03924234340065404
get_ui_image_median0.03924234340065404
get_ui_image_min0.03924234340065404
in-drivable-lane_max7.950000000000074
in-drivable-lane_mean7.950000000000074
in-drivable-lane_min7.950000000000074
per-episodes
details{"LFP-norm-techtrack-000-ego0": {"driven_any": 9.911005485825156, "get_ui_image": 0.03924234340065404, "step_physics": 0.1648240526098954, "survival_time": 23.7000000000002, "driven_lanedir": 6.137112539000098, "get_state_dump": 0.008673487211528576, "get_robot_state": 0.00409389947590075, "sim_render-ego0": 0.0040809340226022825, "get_duckie_state": 0.02271660152234529, "in-drivable-lane": 7.950000000000074, "deviation-heading": 4.381090385260154, "agent_compute-ego0": 0.0959400749206543, "complete-iteration": 0.3574443641461824, "set_robot_commands": 0.002518882249530993, "deviation-center-line": 1.1652307156500996, "driven_lanedir_consec": 6.137112539000098, "sim_compute_sim_state": 0.013081939596878854, "sim_compute_performance-ego0": 0.002158537412944593}}
set_robot_commands_max0.002518882249530993
set_robot_commands_mean0.002518882249530993
set_robot_commands_median0.002518882249530993
set_robot_commands_min0.002518882249530993
sim_compute_performance-ego0_max0.002158537412944593
sim_compute_performance-ego0_mean0.002158537412944593
sim_compute_performance-ego0_median0.002158537412944593
sim_compute_performance-ego0_min0.002158537412944593
sim_compute_sim_state_max0.013081939596878854
sim_compute_sim_state_mean0.013081939596878854
sim_compute_sim_state_median0.013081939596878854
sim_compute_sim_state_min0.013081939596878854
sim_render-ego0_max0.0040809340226022825
sim_render-ego0_mean0.0040809340226022825
sim_render-ego0_median0.0040809340226022825
sim_render-ego0_min0.0040809340226022825
simulation-passed1
step_physics_max0.1648240526098954
step_physics_mean0.1648240526098954
step_physics_median0.1648240526098954
step_physics_min0.1648240526098954
survival_time_max23.7000000000002
survival_time_mean23.7000000000002
survival_time_min23.7000000000002
No reset possible
6619213944YU CHENCBC Net v2 test - added mar 31 anomaly + mar 28 bc_v1aido-LFP-sim-validationsim-2of4successnogpu-production-spot-1-020:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.199999999999982
in-drivable-lane_median2.7999999999999914
driven_lanedir_consec_median1.37721786065758
deviation-center-line_median0.341375392549285


other stats
agent_compute-ego0_max0.09506594723668592
agent_compute-ego0_mean0.09506594723668592
agent_compute-ego0_median0.09506594723668592
agent_compute-ego0_min0.09506594723668592
complete-iteration_max0.32978567583807583
complete-iteration_mean0.32978567583807583
complete-iteration_median0.32978567583807583
complete-iteration_min0.32978567583807583
deviation-center-line_max0.341375392549285
deviation-center-line_mean0.341375392549285
deviation-center-line_min0.341375392549285
deviation-heading_max1.744177526027668
deviation-heading_mean1.744177526027668
deviation-heading_median1.744177526027668
deviation-heading_min1.744177526027668
driven_any_max2.4992082852085105
driven_any_mean2.4992082852085105
driven_any_median2.4992082852085105
driven_any_min2.4992082852085105
driven_lanedir_consec_max1.37721786065758
driven_lanedir_consec_mean1.37721786065758
driven_lanedir_consec_min1.37721786065758
driven_lanedir_max1.37721786065758
driven_lanedir_mean1.37721786065758
driven_lanedir_median1.37721786065758
driven_lanedir_min1.37721786065758
get_duckie_state_max0.027163628874153925
get_duckie_state_mean0.027163628874153925
get_duckie_state_median0.027163628874153925
get_duckie_state_min0.027163628874153925
get_robot_state_max0.004092255954084725
get_robot_state_mean0.004092255954084725
get_robot_state_median0.004092255954084725
get_robot_state_min0.004092255954084725
get_state_dump_max0.009551760246013771
get_state_dump_mean0.009551760246013771
get_state_dump_median0.009551760246013771
get_state_dump_min0.009551760246013771
get_ui_image_max0.034746508762754244
get_ui_image_mean0.034746508762754244
get_ui_image_median0.034746508762754244
get_ui_image_min0.034746508762754244
in-drivable-lane_max2.7999999999999914
in-drivable-lane_mean2.7999999999999914
in-drivable-lane_min2.7999999999999914
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.4992082852085105, "get_ui_image": 0.034746508762754244, "step_physics": 0.14200214024247795, "survival_time": 7.199999999999982, "driven_lanedir": 1.37721786065758, "get_state_dump": 0.009551760246013771, "get_robot_state": 0.004092255954084725, "sim_render-ego0": 0.00407075388678189, "get_duckie_state": 0.027163628874153925, "in-drivable-lane": 2.7999999999999914, "deviation-heading": 1.744177526027668, "agent_compute-ego0": 0.09506594723668592, "complete-iteration": 0.32978567583807583, "set_robot_commands": 0.0025016324273471175, "deviation-center-line": 0.341375392549285, "driven_lanedir_consec": 1.37721786065758, "sim_compute_sim_state": 0.00832395389162261, "sim_compute_performance-ego0": 0.0021482418323385305}}
set_robot_commands_max0.0025016324273471175
set_robot_commands_mean0.0025016324273471175
set_robot_commands_median0.0025016324273471175
set_robot_commands_min0.0025016324273471175
sim_compute_performance-ego0_max0.0021482418323385305
sim_compute_performance-ego0_mean0.0021482418323385305
sim_compute_performance-ego0_median0.0021482418323385305
sim_compute_performance-ego0_min0.0021482418323385305
sim_compute_sim_state_max0.00832395389162261
sim_compute_sim_state_mean0.00832395389162261
sim_compute_sim_state_median0.00832395389162261
sim_compute_sim_state_min0.00832395389162261
sim_render-ego0_max0.00407075388678189
sim_render-ego0_mean0.00407075388678189
sim_render-ego0_median0.00407075388678189
sim_render-ego0_min0.00407075388678189
simulation-passed1
step_physics_max0.14200214024247795
step_physics_mean0.14200214024247795
step_physics_median0.14200214024247795
step_physics_min0.14200214024247795
survival_time_max7.199999999999982
survival_time_mean7.199999999999982
survival_time_min7.199999999999982
No reset possible
6617713996Frank (Chude) QianΒ πŸ‡¨πŸ‡¦baseline-behavior-cloningaido-LFP-sim-validationsim-0of4successnogpu-production-spot-1-020:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.1999999999999966
in-drivable-lane_median0.0
driven_lanedir_consec_median0.4935451414543148
deviation-center-line_median0.26735476180902273


other stats
agent_compute-ego0_max0.06573464687053975
agent_compute-ego0_mean0.06573464687053975
agent_compute-ego0_median0.06573464687053975
agent_compute-ego0_min0.06573464687053975
complete-iteration_max0.30689279849712664
complete-iteration_mean0.30689279849712664
complete-iteration_median0.30689279849712664
complete-iteration_min0.30689279849712664
deviation-center-line_max0.26735476180902273
deviation-center-line_mean0.26735476180902273
deviation-center-line_min0.26735476180902273
deviation-heading_max1.23931602848654
deviation-heading_mean1.23931602848654
deviation-heading_median1.23931602848654
deviation-heading_min1.23931602848654
driven_any_max0.5282309334804229
driven_any_mean0.5282309334804229
driven_any_median0.5282309334804229
driven_any_min0.5282309334804229
driven_lanedir_consec_max0.4935451414543148
driven_lanedir_consec_mean0.4935451414543148
driven_lanedir_consec_min0.4935451414543148
driven_lanedir_max0.4935451414543148
driven_lanedir_mean0.4935451414543148
driven_lanedir_median0.4935451414543148
driven_lanedir_min0.4935451414543148
get_duckie_state_max0.023000034919151893
get_duckie_state_mean0.023000034919151893
get_duckie_state_median0.023000034919151893
get_duckie_state_min0.023000034919151893
get_robot_state_max0.00434409655057467
get_robot_state_mean0.00434409655057467
get_robot_state_median0.00434409655057467
get_robot_state_min0.00434409655057467
get_state_dump_max0.009081323330218976
get_state_dump_mean0.009081323330218976
get_state_dump_median0.009081323330218976
get_state_dump_min0.009081323330218976
get_ui_image_max0.04330404354975774
get_ui_image_mean0.04330404354975774
get_ui_image_median0.04330404354975774
get_ui_image_min0.04330404354975774
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-zigzag-000-ego0": {"driven_any": 0.5282309334804229, "get_ui_image": 0.04330404354975774, "step_physics": 0.14198752183180588, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4935451414543148, "get_state_dump": 0.009081323330218976, "get_robot_state": 0.00434409655057467, "sim_render-ego0": 0.0041941642761230465, "get_duckie_state": 0.023000034919151893, "in-drivable-lane": 0.0, "deviation-heading": 1.23931602848654, "agent_compute-ego0": 0.06573464687053975, "complete-iteration": 0.30689279849712664, "set_robot_commands": 0.0025411202357365536, "deviation-center-line": 0.26735476180902273, "driven_lanedir_consec": 0.4935451414543148, "sim_compute_sim_state": 0.010365834602942834, "sim_compute_performance-ego0": 0.002233402545635517}}
set_robot_commands_max0.0025411202357365536
set_robot_commands_mean0.0025411202357365536
set_robot_commands_median0.0025411202357365536
set_robot_commands_min0.0025411202357365536
sim_compute_performance-ego0_max0.002233402545635517
sim_compute_performance-ego0_mean0.002233402545635517
sim_compute_performance-ego0_median0.002233402545635517
sim_compute_performance-ego0_min0.002233402545635517
sim_compute_sim_state_max0.010365834602942834
sim_compute_sim_state_mean0.010365834602942834
sim_compute_sim_state_median0.010365834602942834
sim_compute_sim_state_min0.010365834602942834
sim_render-ego0_max0.0041941642761230465
sim_render-ego0_mean0.0041941642761230465
sim_render-ego0_median0.0041941642761230465
sim_render-ego0_min0.0041941642761230465
simulation-passed1
step_physics_max0.14198752183180588
step_physics_mean0.14198752183180588
step_physics_median0.14198752183180588
step_physics_min0.14198752183180588
survival_time_max3.1999999999999966
survival_time_mean3.1999999999999966
survival_time_min3.1999999999999966
No reset possible
6616613992Frank (Chude) QianΒ πŸ‡¨πŸ‡¦CBC Net - MixTraining - Expert LF Human LFPaido-LFP-sim-validationsim-3of4successnogpu-production-spot-1-020:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.2499999999999964
in-drivable-lane_median0.0
driven_lanedir_consec_median1.142798743710388
deviation-center-line_median0.17628683601342768


other stats
agent_compute-ego0_max0.05743658903873328
agent_compute-ego0_mean0.05743658903873328
agent_compute-ego0_median0.05743658903873328
agent_compute-ego0_min0.05743658903873328
complete-iteration_max0.28821321328481037
complete-iteration_mean0.28821321328481037
complete-iteration_median0.28821321328481037
complete-iteration_min0.28821321328481037
deviation-center-line_max0.17628683601342768
deviation-center-line_mean0.17628683601342768
deviation-center-line_min0.17628683601342768
deviation-heading_max0.8164738265365391
deviation-heading_mean0.8164738265365391
deviation-heading_median0.8164738265365391
deviation-heading_min0.8164738265365391
driven_any_max1.1635244246332228
driven_any_mean1.1635244246332228
driven_any_median1.1635244246332228
driven_any_min1.1635244246332228
driven_lanedir_consec_max1.142798743710388
driven_lanedir_consec_mean1.142798743710388
driven_lanedir_consec_min1.142798743710388
driven_lanedir_max1.142798743710388
driven_lanedir_mean1.142798743710388
driven_lanedir_median1.142798743710388
driven_lanedir_min1.142798743710388
get_duckie_state_max0.022518591447310013
get_duckie_state_mean0.022518591447310013
get_duckie_state_median0.022518591447310013
get_duckie_state_min0.022518591447310013
get_robot_state_max0.004197575829245828
get_robot_state_mean0.004197575829245828
get_robot_state_median0.004197575829245828
get_robot_state_min0.004197575829245828
get_state_dump_max0.00898441762635202
get_state_dump_mean0.00898441762635202
get_state_dump_median0.00898441762635202
get_state_dump_min0.00898441762635202
get_ui_image_max0.03620420802723278
get_ui_image_mean0.03620420802723278
get_ui_image_median0.03620420802723278
get_ui_image_min0.03620420802723278
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-techtrack-000-ego0": {"driven_any": 1.1635244246332228, "get_ui_image": 0.03620420802723278, "step_physics": 0.1370229215332956, "survival_time": 3.2499999999999964, "driven_lanedir": 1.142798743710388, "get_state_dump": 0.00898441762635202, "get_robot_state": 0.004197575829245828, "sim_render-ego0": 0.0042724681623054275, "get_duckie_state": 0.022518591447310013, "in-drivable-lane": 0.0, "deviation-heading": 0.8164738265365391, "agent_compute-ego0": 0.05743658903873328, "complete-iteration": 0.28821321328481037, "set_robot_commands": 0.0026436719027432528, "deviation-center-line": 0.17628683601342768, "driven_lanedir_consec": 1.142798743710388, "sim_compute_sim_state": 0.012496113777160645, "sim_compute_performance-ego0": 0.0023335037809429746}}
set_robot_commands_max0.0026436719027432528
set_robot_commands_mean0.0026436719027432528
set_robot_commands_median0.0026436719027432528
set_robot_commands_min0.0026436719027432528
sim_compute_performance-ego0_max0.0023335037809429746
sim_compute_performance-ego0_mean0.0023335037809429746
sim_compute_performance-ego0_median0.0023335037809429746
sim_compute_performance-ego0_min0.0023335037809429746
sim_compute_sim_state_max0.012496113777160645
sim_compute_sim_state_mean0.012496113777160645
sim_compute_sim_state_median0.012496113777160645
sim_compute_sim_state_min0.012496113777160645
sim_render-ego0_max0.0042724681623054275
sim_render-ego0_mean0.0042724681623054275
sim_render-ego0_median0.0042724681623054275
sim_render-ego0_min0.0042724681623054275
simulation-passed1
step_physics_max0.1370229215332956
step_physics_mean0.1370229215332956
step_physics_median0.1370229215332956
step_physics_min0.1370229215332956
survival_time_max3.2499999999999964
survival_time_mean3.2499999999999964
survival_time_min3.2499999999999964
No reset possible
6614314014YU CHENCBC Net v2 test - APR 6 anomaly + mar 28 bcaido-LFP-sim-validationsim-2of4successnogpu-production-spot-1-020:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.600000000000058
in-drivable-lane_median3.700000000000019
driven_lanedir_consec_median3.544999109589921
deviation-center-line_median0.6374406194829157


other stats
agent_compute-ego0_max0.1000439098903111
agent_compute-ego0_mean0.1000439098903111
agent_compute-ego0_median0.1000439098903111
agent_compute-ego0_min0.1000439098903111
complete-iteration_max0.3657910911154834
complete-iteration_mean0.3657910911154834
complete-iteration_median0.3657910911154834
complete-iteration_min0.3657910911154834
deviation-center-line_max0.6374406194829157
deviation-center-line_mean0.6374406194829157
deviation-center-line_min0.6374406194829157
deviation-heading_max2.739105791596955
deviation-heading_mean2.739105791596955
deviation-heading_median2.739105791596955
deviation-heading_min2.739105791596955
driven_any_max5.36095017695179
driven_any_mean5.36095017695179
driven_any_median5.36095017695179
driven_any_min5.36095017695179
driven_lanedir_consec_max3.544999109589921
driven_lanedir_consec_mean3.544999109589921
driven_lanedir_consec_min3.544999109589921
driven_lanedir_max3.544999109589921
driven_lanedir_mean3.544999109589921
driven_lanedir_median3.544999109589921
driven_lanedir_min3.544999109589921
get_duckie_state_max0.028190590959765536
get_duckie_state_mean0.028190590959765536
get_duckie_state_median0.028190590959765536
get_duckie_state_min0.028190590959765536
get_robot_state_max0.004348353151873354
get_robot_state_mean0.004348353151873354
get_robot_state_median0.004348353151873354
get_robot_state_min0.004348353151873354
get_state_dump_max0.009915048822815164
get_state_dump_mean0.009915048822815164
get_state_dump_median0.009915048822815164
get_state_dump_min0.009915048822815164
get_ui_image_max0.03668222409901602
get_ui_image_mean0.03668222409901602
get_ui_image_median0.03668222409901602
get_ui_image_min0.03668222409901602
in-drivable-lane_max3.700000000000019
in-drivable-lane_mean3.700000000000019
in-drivable-lane_min3.700000000000019
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 5.36095017695179, "get_ui_image": 0.03668222409901602, "step_physics": 0.1680433296021961, "survival_time": 13.600000000000058, "driven_lanedir": 3.544999109589921, "get_state_dump": 0.009915048822815164, "get_robot_state": 0.004348353151873354, "sim_render-ego0": 0.00427187144101321, "get_duckie_state": 0.028190590959765536, "in-drivable-lane": 3.700000000000019, "deviation-heading": 2.739105791596955, "agent_compute-ego0": 0.1000439098903111, "complete-iteration": 0.3657910911154834, "set_robot_commands": 0.0025734980027754227, "deviation-center-line": 0.6374406194829157, "driven_lanedir_consec": 3.544999109589921, "sim_compute_sim_state": 0.009348226554227837, "sim_compute_performance-ego0": 0.002254684329469562}}
set_robot_commands_max0.0025734980027754227
set_robot_commands_mean0.0025734980027754227
set_robot_commands_median0.0025734980027754227
set_robot_commands_min0.0025734980027754227
sim_compute_performance-ego0_max0.002254684329469562
sim_compute_performance-ego0_mean0.002254684329469562
sim_compute_performance-ego0_median0.002254684329469562
sim_compute_performance-ego0_min0.002254684329469562
sim_compute_sim_state_max0.009348226554227837
sim_compute_sim_state_mean0.009348226554227837
sim_compute_sim_state_median0.009348226554227837
sim_compute_sim_state_min0.009348226554227837
sim_render-ego0_max0.00427187144101321
sim_render-ego0_mean0.00427187144101321
sim_render-ego0_median0.00427187144101321
sim_render-ego0_min0.00427187144101321
simulation-passed1
step_physics_max0.1680433296021961
step_physics_mean0.1680433296021961
step_physics_median0.1680433296021961
step_physics_min0.1680433296021961
survival_time_max13.600000000000058
survival_time_mean13.600000000000058
survival_time_min13.600000000000058
No reset possible
6612814032YU CHENCBC V2, mar28 bc, mar31_apr6 anomaly aido-LFP-sim-validationsim-3of4successnogpu-production-spot-1-020:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.850000000000003
in-drivable-lane_median1.149999999999996
driven_lanedir_consec_median2.822418662877072
deviation-center-line_median0.3903797841630981


other stats
agent_compute-ego0_max0.09650754446935172
agent_compute-ego0_mean0.09650754446935172
agent_compute-ego0_median0.09650754446935172
agent_compute-ego0_min0.09650754446935172
complete-iteration_max0.3611706651822485
complete-iteration_mean0.3611706651822485
complete-iteration_median0.3611706651822485
complete-iteration_min0.3611706651822485
deviation-center-line_max0.3903797841630981
deviation-center-line_mean0.3903797841630981
deviation-center-line_min0.3903797841630981
deviation-heading_max1.9459160015359072
deviation-heading_mean1.9459160015359072
deviation-heading_median1.9459160015359072
deviation-heading_min1.9459160015359072
driven_any_max3.495141838164526
driven_any_mean3.495141838164526
driven_any_median3.495141838164526
driven_any_min3.495141838164526
driven_lanedir_consec_max2.822418662877072
driven_lanedir_consec_mean2.822418662877072
driven_lanedir_consec_min2.822418662877072
driven_lanedir_max2.822418662877072
driven_lanedir_mean2.822418662877072
driven_lanedir_median2.822418662877072
driven_lanedir_min2.822418662877072
get_duckie_state_max0.02134928558811997
get_duckie_state_mean0.02134928558811997
get_duckie_state_median0.02134928558811997
get_duckie_state_min0.02134928558811997
get_robot_state_max0.0037730595078131167
get_robot_state_mean0.0037730595078131167
get_robot_state_median0.0037730595078131167
get_robot_state_min0.0037730595078131167
get_state_dump_max0.008161826567216353
get_state_dump_mean0.008161826567216353
get_state_dump_median0.008161826567216353
get_state_dump_min0.008161826567216353
get_ui_image_max0.03802625458649914
get_ui_image_mean0.03802625458649914
get_ui_image_median0.03802625458649914
get_ui_image_min0.03802625458649914
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean1.149999999999996
in-drivable-lane_min1.149999999999996
per-episodes
details{"LFP-norm-techtrack-000-ego0": {"driven_any": 3.495141838164526, "get_ui_image": 0.03802625458649914, "step_physics": 0.1718314705473004, "survival_time": 9.850000000000003, "driven_lanedir": 2.822418662877072, "get_state_dump": 0.008161826567216353, "get_robot_state": 0.0037730595078131167, "sim_render-ego0": 0.004040651851230198, "get_duckie_state": 0.02134928558811997, "in-drivable-lane": 1.149999999999996, "deviation-heading": 1.9459160015359072, "agent_compute-ego0": 0.09650754446935172, "complete-iteration": 0.3611706651822485, "set_robot_commands": 0.0024418674334131104, "deviation-center-line": 0.3903797841630981, "driven_lanedir_consec": 2.822418662877072, "sim_compute_sim_state": 0.01284794012705485, "sim_compute_performance-ego0": 0.0020893667683456883}}
set_robot_commands_max0.0024418674334131104
set_robot_commands_mean0.0024418674334131104
set_robot_commands_median0.0024418674334131104
set_robot_commands_min0.0024418674334131104
sim_compute_performance-ego0_max0.0020893667683456883
sim_compute_performance-ego0_mean0.0020893667683456883
sim_compute_performance-ego0_median0.0020893667683456883
sim_compute_performance-ego0_min0.0020893667683456883
sim_compute_sim_state_max0.01284794012705485
sim_compute_sim_state_mean0.01284794012705485
sim_compute_sim_state_median0.01284794012705485
sim_compute_sim_state_min0.01284794012705485
sim_render-ego0_max0.004040651851230198
sim_render-ego0_mean0.004040651851230198
sim_render-ego0_median0.004040651851230198
sim_render-ego0_min0.004040651851230198
simulation-passed1
step_physics_max0.1718314705473004
step_physics_mean0.1718314705473004
step_physics_median0.1718314705473004
step_physics_min0.1718314705473004
survival_time_max9.850000000000003
survival_time_mean9.850000000000003
survival_time_min9.850000000000003
No reset possible
6608813513AndrΓ‘s KalaposΒ πŸ‡­πŸ‡Ίreal-v1.0-3091-310aido-LFV-sim-validationsim-1of4host-errornogpu-production-spot-1-020:10:18
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1146, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6589713593Andras Beres202-1aido-LFV_multi-sim-validation402successnogpu-production-spot-1-020:48:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median41.99999999999975
in-drivable-lane_median0.5500000000000043
driven_lanedir_consec_median12.593708356652003
deviation-center-line_median3.17688221834753


other stats
agent_compute-ego0_max0.027368413462183785
agent_compute-ego0_mean0.02630675889484556
agent_compute-ego0_median0.02630675889484556
agent_compute-ego0_min0.025245104327507335
agent_compute-ego1_max0.02325963940793093
agent_compute-ego1_mean0.021361117127696217
agent_compute-ego1_median0.021361117127696217
agent_compute-ego1_min0.019462594847461493
agent_compute-ego2_max0.022118828754903213
agent_compute-ego2_mean0.020646384842268828
agent_compute-ego2_median0.020646384842268828
agent_compute-ego2_min0.019173940929634443
agent_compute-ego3_max0.020340878933791797
agent_compute-ego3_mean0.019357355001348373
agent_compute-ego3_median0.019357355001348373
agent_compute-ego3_min0.01837383106890495
complete-iteration_max0.9311465796593312
complete-iteration_mean0.8285011882207092
complete-iteration_median0.8285011882207092
complete-iteration_min0.7258557967820871
deviation-center-line_max4.36426391100485
deviation-center-line_mean3.22735939084556
deviation-center-line_min2.300471697029999
deviation-heading_max11.24195297238657
deviation-heading_mean6.3085036813801
deviation-heading_median5.86399088311939
deviation-heading_min3.3710689067607893
driven_any_max22.505112897383498
driven_any_mean14.393412240237208
driven_any_median13.148016157425744
driven_any_min10.857545182725268
driven_lanedir_consec_max21.23246817162177
driven_lanedir_consec_mean13.868149980024302
driven_lanedir_consec_min10.64994298166031
driven_lanedir_max21.23246817162177
driven_lanedir_mean13.868149980024302
driven_lanedir_median12.593708356652003
driven_lanedir_min10.64994298166031
get_duckie_state_max3.3033259399754092e-06
get_duckie_state_mean3.1691081899852533e-06
get_duckie_state_median3.1691081899852533e-06
get_duckie_state_min3.034890439995097e-06
get_robot_state_max0.016313316430222026
get_robot_state_mean0.015999533088339603
get_robot_state_median0.015999533088339603
get_robot_state_min0.015685749746457176
get_state_dump_max0.010736210764616646
get_state_dump_mean0.010661013172338016
get_state_dump_median0.010661013172338016
get_state_dump_min0.010585815580059384
get_ui_image_max0.05411938710826066
get_ui_image_mean0.050877602185192106
get_ui_image_median0.050877602185192106
get_ui_image_min0.04763581726212355
in-drivable-lane_max2.2999999999999865
in-drivable-lane_mean0.8062500000000015
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 17.965589558795916, "get_ui_image": 0.04763581726212355, "step_physics": 0.4985884773365966, "survival_time": 35.8500000000001, "driven_lanedir": 17.573629289655322, "get_state_dump": 0.010736210764616646, "get_robot_state": 0.016313316430222026, "sim_render-ego0": 0.004321186987470451, "sim_render-ego1": 0.004143127491879264, "sim_render-ego2": 0.00412072079427395, "sim_render-ego3": 0.0041115473239866805, "get_duckie_state": 3.3033259399754092e-06, "in-drivable-lane": 0.4500000000000029, "deviation-heading": 4.5992298488982035, "agent_compute-ego0": 0.025245104327507335, "agent_compute-ego1": 0.02325963940793093, "agent_compute-ego2": 0.022118828754903213, "agent_compute-ego3": 0.01837383106890495, "complete-iteration": 0.7258557967820871, "set_robot_commands": 0.002542113527282035, "deviation-center-line": 2.300471697029999, "driven_lanedir_consec": 17.573629289655322, "sim_compute_sim_state": 0.02686701544812131, "sim_compute_performance-ego0": 0.002414611720773171, "sim_compute_performance-ego1": 0.0023202627150129143, "sim_compute_performance-ego2": 0.0022977085830773484, "sim_compute_performance-ego3": 0.0022906798838240854}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 11.220895235839588, "get_ui_image": 0.04763581726212355, "step_physics": 0.4985884773365966, "survival_time": 35.8500000000001, "driven_lanedir": 11.081393940726109, "get_state_dump": 0.010736210764616646, "get_robot_state": 0.016313316430222026, "sim_render-ego0": 0.004321186987470451, "sim_render-ego1": 0.004143127491879264, "sim_render-ego2": 0.00412072079427395, "sim_render-ego3": 0.0041115473239866805, "get_duckie_state": 3.3033259399754092e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.3710689067607893, "agent_compute-ego0": 0.025245104327507335, "agent_compute-ego1": 0.02325963940793093, "agent_compute-ego2": 0.022118828754903213, "agent_compute-ego3": 0.01837383106890495, "complete-iteration": 0.7258557967820871, "set_robot_commands": 0.002542113527282035, "deviation-center-line": 3.1983738649826936, "driven_lanedir_consec": 11.081393940726109, "sim_compute_sim_state": 0.02686701544812131, "sim_compute_performance-ego0": 0.002414611720773171, "sim_compute_performance-ego1": 0.0023202627150129143, "sim_compute_performance-ego2": 0.0022977085830773484, "sim_compute_performance-ego3": 0.0022906798838240854}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 10.857545182725268, "get_ui_image": 0.04763581726212355, "step_physics": 0.4985884773365966, "survival_time": 35.8500000000001, "driven_lanedir": 10.64994298166031, "get_state_dump": 0.010736210764616646, "get_robot_state": 0.016313316430222026, "sim_render-ego0": 0.004321186987470451, "sim_render-ego1": 0.004143127491879264, "sim_render-ego2": 0.00412072079427395, "sim_render-ego3": 0.0041115473239866805, "get_duckie_state": 3.3033259399754092e-06, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 3.610357908114036, "agent_compute-ego0": 0.025245104327507335, "agent_compute-ego1": 0.02325963940793093, "agent_compute-ego2": 0.022118828754903213, "agent_compute-ego3": 0.01837383106890495, "complete-iteration": 0.7258557967820871, "set_robot_commands": 0.002542113527282035, "deviation-center-line": 2.462117451170284, "driven_lanedir_consec": 10.64994298166031, "sim_compute_sim_state": 0.02686701544812131, "sim_compute_performance-ego0": 0.002414611720773171, "sim_compute_performance-ego1": 0.0023202627150129143, "sim_compute_performance-ego2": 0.0022977085830773484, "sim_compute_performance-ego3": 0.0022906798838240854}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 14.709919736822012, "get_ui_image": 0.04763581726212355, "step_physics": 0.4985884773365966, "survival_time": 35.8500000000001, "driven_lanedir": 14.45320891348207, "get_state_dump": 0.010736210764616646, "get_robot_state": 0.016313316430222026, "sim_render-ego0": 0.004321186987470451, "sim_render-ego1": 0.004143127491879264, "sim_render-ego2": 0.00412072079427395, "sim_render-ego3": 0.0041115473239866805, "get_duckie_state": 3.3033259399754092e-06, "in-drivable-lane": 0.20000000000000284, "deviation-heading": 4.3397854135411205, "agent_compute-ego0": 0.025245104327507335, "agent_compute-ego1": 0.02325963940793093, "agent_compute-ego2": 0.022118828754903213, "agent_compute-ego3": 0.01837383106890495, "complete-iteration": 0.7258557967820871, "set_robot_commands": 0.002542113527282035, "deviation-center-line": 2.6612846070622944, "driven_lanedir_consec": 14.45320891348207, "sim_compute_sim_state": 0.02686701544812131, "sim_compute_performance-ego0": 0.002414611720773171, "sim_compute_performance-ego1": 0.0023202627150129143, "sim_compute_performance-ego2": 0.0022977085830773484, "sim_compute_performance-ego3": 0.0022906798838240854}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 22.505112897383498, "get_ui_image": 0.05411938710826066, "step_physics": 0.6922467773880702, "survival_time": 48.1499999999994, "driven_lanedir": 21.23246817162177, "get_state_dump": 0.010585815580059384, "get_robot_state": 0.015685749746457176, "sim_render-ego0": 0.004146445588946837, "sim_render-ego1": 0.004119389779340182, "sim_render-ego2": 0.004107974376915896, "sim_render-ego3": 0.00407834369611938, "get_duckie_state": 3.034890439995097e-06, "in-drivable-lane": 2.2999999999999865, "deviation-heading": 7.7640754021523986, "agent_compute-ego0": 0.027368413462183785, "agent_compute-ego1": 0.019462594847461493, "agent_compute-ego2": 0.019173940929634443, "agent_compute-ego3": 0.020340878933791797, "complete-iteration": 0.9311465796593312, "set_robot_commands": 0.002527799596430355, "deviation-center-line": 3.4963581838987436, "driven_lanedir_consec": 21.23246817162177, "sim_compute_sim_state": 0.03634548879757956, "sim_compute_performance-ego0": 0.002304686550282838, "sim_compute_performance-ego1": 0.0022368144197582704, "sim_compute_performance-ego2": 0.002272171845574597, "sim_compute_performance-ego3": 0.002213444699884945}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.586112578029471, "get_ui_image": 0.05411938710826066, "step_physics": 0.6922467773880702, "survival_time": 48.1499999999994, "driven_lanedir": 10.953939461462518, "get_state_dump": 0.010585815580059384, "get_robot_state": 0.015685749746457176, "sim_render-ego0": 0.004146445588946837, "sim_render-ego1": 0.004119389779340182, "sim_render-ego2": 0.004107974376915896, "sim_render-ego3": 0.00407834369611938, "get_duckie_state": 3.034890439995097e-06, "in-drivable-lane": 1.150000000000002, "deviation-heading": 11.24195297238657, "agent_compute-ego0": 0.027368413462183785, "agent_compute-ego1": 0.019462594847461493, "agent_compute-ego2": 0.019173940929634443, "agent_compute-ego3": 0.020340878933791797, "complete-iteration": 0.9311465796593312, "set_robot_commands": 0.002527799596430355, "deviation-center-line": 4.180614839903248, "driven_lanedir_consec": 10.953939461462518, "sim_compute_sim_state": 0.03634548879757956, "sim_compute_performance-ego0": 0.002304686550282838, "sim_compute_performance-ego1": 0.0022368144197582704, "sim_compute_performance-ego2": 0.002272171845574597, "sim_compute_performance-ego3": 0.002213444699884945}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.954890892498108, "get_ui_image": 0.05411938710826066, "step_physics": 0.6922467773880702, "survival_time": 48.1499999999994, "driven_lanedir": 14.106022772577898, "get_state_dump": 0.010585815580059384, "get_robot_state": 0.015685749746457176, "sim_render-ego0": 0.004146445588946837, "sim_render-ego1": 0.004119389779340182, "sim_render-ego2": 0.004107974376915896, "sim_render-ego3": 0.00407834369611938, "get_duckie_state": 3.034890439995097e-06, "in-drivable-lane": 1.5000000000000124, "deviation-heading": 7.128751917340577, "agent_compute-ego0": 0.027368413462183785, "agent_compute-ego1": 0.019462594847461493, "agent_compute-ego2": 0.019173940929634443, "agent_compute-ego3": 0.020340878933791797, "complete-iteration": 0.9311465796593312, "set_robot_commands": 0.002527799596430355, "deviation-center-line": 3.155390571712366, "driven_lanedir_consec": 14.106022772577898, "sim_compute_sim_state": 0.03634548879757956, "sim_compute_performance-ego0": 0.002304686550282838, "sim_compute_performance-ego1": 0.0022368144197582704, "sim_compute_performance-ego2": 0.002272171845574597, "sim_compute_performance-ego3": 0.002213444699884945}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 11.347231839803808, "get_ui_image": 0.05411938710826066, "step_physics": 0.6922467773880702, "survival_time": 48.1499999999994, "driven_lanedir": 10.89459430900842, "get_state_dump": 0.010585815580059384, "get_robot_state": 0.015685749746457176, "sim_render-ego0": 0.004146445588946837, "sim_render-ego1": 0.004119389779340182, "sim_render-ego2": 0.004107974376915896, "sim_render-ego3": 0.00407834369611938, "get_duckie_state": 3.034890439995097e-06, "in-drivable-lane": 0.6500000000000057, "deviation-heading": 8.4128070818471, "agent_compute-ego0": 0.027368413462183785, "agent_compute-ego1": 0.019462594847461493, "agent_compute-ego2": 0.019173940929634443, "agent_compute-ego3": 0.020340878933791797, "complete-iteration": 0.9311465796593312, "set_robot_commands": 0.002527799596430355, "deviation-center-line": 4.36426391100485, "driven_lanedir_consec": 10.89459430900842, "sim_compute_sim_state": 0.03634548879757956, "sim_compute_performance-ego0": 0.002304686550282838, "sim_compute_performance-ego1": 0.0022368144197582704, "sim_compute_performance-ego2": 0.002272171845574597, "sim_compute_performance-ego3": 0.002213444699884945}}
set_robot_commands_max0.002542113527282035
set_robot_commands_mean0.002534956561856195
set_robot_commands_median0.002534956561856195
set_robot_commands_min0.002527799596430355
sim_compute_performance-ego0_max0.002414611720773171
sim_compute_performance-ego0_mean0.0023596491355280047
sim_compute_performance-ego0_median0.0023596491355280047
sim_compute_performance-ego0_min0.002304686550282838
sim_compute_performance-ego1_max0.0023202627150129143
sim_compute_performance-ego1_mean0.0022785385673855926
sim_compute_performance-ego1_median0.0022785385673855926
sim_compute_performance-ego1_min0.0022368144197582704
sim_compute_performance-ego2_max0.0022977085830773484
sim_compute_performance-ego2_mean0.002284940214325973
sim_compute_performance-ego2_median0.002284940214325973
sim_compute_performance-ego2_min0.002272171845574597
sim_compute_performance-ego3_max0.0022906798838240854
sim_compute_performance-ego3_mean0.0022520622918545154
sim_compute_performance-ego3_median0.0022520622918545154
sim_compute_performance-ego3_min0.002213444699884945
sim_compute_sim_state_max0.03634548879757956
sim_compute_sim_state_mean0.03160625212285043
sim_compute_sim_state_median0.03160625212285043
sim_compute_sim_state_min0.02686701544812131
sim_render-ego0_max0.004321186987470451
sim_render-ego0_mean0.004233816288208644
sim_render-ego0_median0.004233816288208644
sim_render-ego0_min0.004146445588946837
sim_render-ego1_max0.004143127491879264
sim_render-ego1_mean0.004131258635609723
sim_render-ego1_median0.004131258635609723
sim_render-ego1_min0.004119389779340182
sim_render-ego2_max0.00412072079427395
sim_render-ego2_mean0.004114347585594923
sim_render-ego2_median0.004114347585594923
sim_render-ego2_min0.004107974376915896
sim_render-ego3_max0.0041115473239866805
sim_render-ego3_mean0.00409494551005303
sim_render-ego3_median0.00409494551005303
sim_render-ego3_min0.00407834369611938
simulation-passed1
step_physics_max0.6922467773880702
step_physics_mean0.5954176273623334
step_physics_median0.5954176273623334
step_physics_min0.4985884773365966
survival_time_max48.1499999999994
survival_time_mean41.99999999999975
survival_time_min35.8500000000001
No reset possible