Duckietown Challenges Home Challenges Submissions

Evaluator 5100

ID5100
evaluatorgpu-production-spot-1-03
ownerI don't have one πŸ˜€
machinegpu-prod_197efe39ad18
processgpu-production-spot-1-03_197efe39ad18
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success13 65887
# timeout
# failed
# error
# aborted1 66319
# host-error1 66047
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors100%
RAM total (MB)249.0 GB
RAM free (MB)238.2 GB
Disk (MB)969.3 GB
Disk available (MB)865.4 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6631913798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-1-030:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6631013939YU CHENCBC Net v2 test - added mar 31 datasetaido-LFP-sim-validationsim-0of4successnogpu-production-spot-1-030:01:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.499999999999999
in-drivable-lane_median0.0
driven_lanedir_consec_median0.4892829262516568
deviation-center-line_median0.19277303603280177


other stats
agent_compute-ego0_max0.09149227422826432
agent_compute-ego0_mean0.09149227422826432
agent_compute-ego0_median0.09149227422826432
agent_compute-ego0_min0.09149227422826432
complete-iteration_max0.32567581475949753
complete-iteration_mean0.32567581475949753
complete-iteration_median0.32567581475949753
complete-iteration_min0.32567581475949753
deviation-center-line_max0.19277303603280177
deviation-center-line_mean0.19277303603280177
deviation-center-line_min0.19277303603280177
deviation-heading_max0.892285281949834
deviation-heading_mean0.892285281949834
deviation-heading_median0.892285281949834
deviation-heading_min0.892285281949834
driven_any_max0.5155629812243301
driven_any_mean0.5155629812243301
driven_any_median0.5155629812243301
driven_any_min0.5155629812243301
driven_lanedir_consec_max0.4892829262516568
driven_lanedir_consec_mean0.4892829262516568
driven_lanedir_consec_min0.4892829262516568
driven_lanedir_max0.4892829262516568
driven_lanedir_mean0.4892829262516568
driven_lanedir_median0.4892829262516568
driven_lanedir_min0.4892829262516568
get_duckie_state_max0.020550601622637586
get_duckie_state_mean0.020550601622637586
get_duckie_state_median0.020550601622637586
get_duckie_state_min0.020550601622637586
get_robot_state_max0.0037148232553519457
get_robot_state_mean0.0037148232553519457
get_robot_state_median0.0037148232553519457
get_robot_state_min0.0037148232553519457
get_state_dump_max0.008094287386127547
get_state_dump_mean0.008094287386127547
get_state_dump_median0.008094287386127547
get_state_dump_min0.008094287386127547
get_ui_image_max0.039146072724286246
get_ui_image_mean0.039146072724286246
get_ui_image_median0.039146072724286246
get_ui_image_min0.039146072724286246
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-zigzag-000-ego0": {"driven_any": 0.5155629812243301, "get_ui_image": 0.039146072724286246, "step_physics": 0.14539631675271428, "survival_time": 2.499999999999999, "driven_lanedir": 0.4892829262516568, "get_state_dump": 0.008094287386127547, "get_robot_state": 0.0037148232553519457, "sim_render-ego0": 0.003773207757987228, "get_duckie_state": 0.020550601622637586, "in-drivable-lane": 0.0, "deviation-heading": 0.892285281949834, "agent_compute-ego0": 0.09149227422826432, "complete-iteration": 0.32567581475949753, "set_robot_commands": 0.0023778092627431834, "deviation-center-line": 0.19277303603280177, "driven_lanedir_consec": 0.4892829262516568, "sim_compute_sim_state": 0.009067871991325829, "sim_compute_performance-ego0": 0.0019686596066344018}}
set_robot_commands_max0.0023778092627431834
set_robot_commands_mean0.0023778092627431834
set_robot_commands_median0.0023778092627431834
set_robot_commands_min0.0023778092627431834
sim_compute_performance-ego0_max0.0019686596066344018
sim_compute_performance-ego0_mean0.0019686596066344018
sim_compute_performance-ego0_median0.0019686596066344018
sim_compute_performance-ego0_min0.0019686596066344018
sim_compute_sim_state_max0.009067871991325829
sim_compute_sim_state_mean0.009067871991325829
sim_compute_sim_state_median0.009067871991325829
sim_compute_sim_state_min0.009067871991325829
sim_render-ego0_max0.003773207757987228
sim_render-ego0_mean0.003773207757987228
sim_render-ego0_median0.003773207757987228
sim_render-ego0_min0.003773207757987228
simulation-passed1
step_physics_max0.14539631675271428
step_physics_mean0.14539631675271428
step_physics_median0.14539631675271428
step_physics_min0.14539631675271428
survival_time_max2.499999999999999
survival_time_mean2.499999999999999
survival_time_min2.499999999999999
No reset possible
6630013912YU CHENCBC Net v2 - testaido-LFP-sim-validationsim-0of4successnogpu-production-spot-1-030:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.4499999999999993
in-drivable-lane_median0.4500000000000003
driven_lanedir_consec_median0.33683028089042233
deviation-center-line_median0.18316877432201983


other stats
agent_compute-ego0_max0.1031407117843628
agent_compute-ego0_mean0.1031407117843628
agent_compute-ego0_median0.1031407117843628
agent_compute-ego0_min0.1031407117843628
complete-iteration_max0.3606362295150757
complete-iteration_mean0.3606362295150757
complete-iteration_median0.3606362295150757
complete-iteration_min0.3606362295150757
deviation-center-line_max0.18316877432201983
deviation-center-line_mean0.18316877432201983
deviation-center-line_min0.18316877432201983
deviation-heading_max0.7851823650333535
deviation-heading_mean0.7851823650333535
deviation-heading_median0.7851823650333535
deviation-heading_min0.7851823650333535
driven_any_max0.5406210426888415
driven_any_mean0.5406210426888415
driven_any_median0.5406210426888415
driven_any_min0.5406210426888415
driven_lanedir_consec_max0.33683028089042233
driven_lanedir_consec_mean0.33683028089042233
driven_lanedir_consec_min0.33683028089042233
driven_lanedir_max0.33683028089042233
driven_lanedir_mean0.33683028089042233
driven_lanedir_median0.33683028089042233
driven_lanedir_min0.33683028089042233
get_duckie_state_max0.022992892265319823
get_duckie_state_mean0.022992892265319823
get_duckie_state_median0.022992892265319823
get_duckie_state_min0.022992892265319823
get_robot_state_max0.004267172813415527
get_robot_state_mean0.004267172813415527
get_robot_state_median0.004267172813415527
get_robot_state_min0.004267172813415527
get_state_dump_max0.00926609992980957
get_state_dump_mean0.00926609992980957
get_state_dump_median0.00926609992980957
get_state_dump_min0.00926609992980957
get_ui_image_max0.041932377815246585
get_ui_image_mean0.041932377815246585
get_ui_image_median0.041932377815246585
get_ui_image_min0.041932377815246585
in-drivable-lane_max0.4500000000000003
in-drivable-lane_mean0.4500000000000003
in-drivable-lane_min0.4500000000000003
per-episodes
details{"LFP-norm-zigzag-000-ego0": {"driven_any": 0.5406210426888415, "get_ui_image": 0.041932377815246585, "step_physics": 0.15966870307922362, "survival_time": 2.4499999999999993, "driven_lanedir": 0.33683028089042233, "get_state_dump": 0.00926609992980957, "get_robot_state": 0.004267172813415527, "sim_render-ego0": 0.004217853546142578, "get_duckie_state": 0.022992892265319823, "in-drivable-lane": 0.4500000000000003, "deviation-heading": 0.7851823650333535, "agent_compute-ego0": 0.1031407117843628, "complete-iteration": 0.3606362295150757, "set_robot_commands": 0.0026291847229003907, "deviation-center-line": 0.18316877432201983, "driven_lanedir_consec": 0.33683028089042233, "sim_compute_sim_state": 0.01008732795715332, "sim_compute_performance-ego0": 0.002304658889770508}}
set_robot_commands_max0.0026291847229003907
set_robot_commands_mean0.0026291847229003907
set_robot_commands_median0.0026291847229003907
set_robot_commands_min0.0026291847229003907
sim_compute_performance-ego0_max0.002304658889770508
sim_compute_performance-ego0_mean0.002304658889770508
sim_compute_performance-ego0_median0.002304658889770508
sim_compute_performance-ego0_min0.002304658889770508
sim_compute_sim_state_max0.01008732795715332
sim_compute_sim_state_mean0.01008732795715332
sim_compute_sim_state_median0.01008732795715332
sim_compute_sim_state_min0.01008732795715332
sim_render-ego0_max0.004217853546142578
sim_render-ego0_mean0.004217853546142578
sim_render-ego0_median0.004217853546142578
sim_render-ego0_min0.004217853546142578
simulation-passed1
step_physics_max0.15966870307922362
step_physics_mean0.15966870307922362
step_physics_median0.15966870307922362
step_physics_min0.15966870307922362
survival_time_max2.4499999999999993
survival_time_mean2.4499999999999993
survival_time_min2.4499999999999993
No reset possible
6625113697Samuel Alexandertemplate-pytorchaido-LF-sim-validationsim-2of4successnogpu-production-spot-1-030:11:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.283298420165983
survival_time_median59.99999999999873
deviation-center-line_median1.933673962505924
in-drivable-lane_median38.34999999999907


other stats
agent_compute-ego0_max0.016035740024144207
agent_compute-ego0_mean0.016035740024144207
agent_compute-ego0_median0.016035740024144207
agent_compute-ego0_min0.016035740024144207
complete-iteration_max0.238956021428803
complete-iteration_mean0.238956021428803
complete-iteration_median0.238956021428803
complete-iteration_min0.238956021428803
deviation-center-line_max1.933673962505924
deviation-center-line_mean1.933673962505924
deviation-center-line_min1.933673962505924
deviation-heading_max14.21613375207371
deviation-heading_mean14.21613375207371
deviation-heading_median14.21613375207371
deviation-heading_min14.21613375207371
driven_any_max8.665485278782231
driven_any_mean8.665485278782231
driven_any_median8.665485278782231
driven_any_min8.665485278782231
driven_lanedir_consec_max2.283298420165983
driven_lanedir_consec_mean2.283298420165983
driven_lanedir_consec_min2.283298420165983
driven_lanedir_max2.283298420165983
driven_lanedir_mean2.283298420165983
driven_lanedir_median2.283298420165983
driven_lanedir_min2.283298420165983
get_duckie_state_max1.870027489705844e-06
get_duckie_state_mean1.870027489705844e-06
get_duckie_state_median1.870027489705844e-06
get_duckie_state_min1.870027489705844e-06
get_robot_state_max0.003966527814968341
get_robot_state_mean0.003966527814968341
get_robot_state_median0.003966527814968341
get_robot_state_min0.003966527814968341
get_state_dump_max0.005296504864784005
get_state_dump_mean0.005296504864784005
get_state_dump_median0.005296504864784005
get_state_dump_min0.005296504864784005
get_ui_image_max0.027644673156103028
get_ui_image_mean0.027644673156103028
get_ui_image_median0.027644673156103028
get_ui_image_min0.027644673156103028
in-drivable-lane_max38.34999999999907
in-drivable-lane_mean38.34999999999907
in-drivable-lane_min38.34999999999907
per-episodes
details{"LF-norm-small_loop-000-ego0": {"driven_any": 8.665485278782231, "get_ui_image": 0.027644673156103028, "step_physics": 0.1709444701522713, "survival_time": 59.99999999999873, "driven_lanedir": 2.283298420165983, "get_state_dump": 0.005296504864784005, "get_robot_state": 0.003966527814968341, "sim_render-ego0": 0.004025205386667625, "get_duckie_state": 1.870027489705844e-06, "in-drivable-lane": 38.34999999999907, "deviation-heading": 14.21613375207371, "agent_compute-ego0": 0.016035740024144207, "complete-iteration": 0.238956021428803, "set_robot_commands": 0.002348505190071913, "deviation-center-line": 1.933673962505924, "driven_lanedir_consec": 2.283298420165983, "sim_compute_sim_state": 0.006516901678487125, "sim_compute_performance-ego0": 0.0020923973817213886}}
set_robot_commands_max0.002348505190071913
set_robot_commands_mean0.002348505190071913
set_robot_commands_median0.002348505190071913
set_robot_commands_min0.002348505190071913
sim_compute_performance-ego0_max0.0020923973817213886
sim_compute_performance-ego0_mean0.0020923973817213886
sim_compute_performance-ego0_median0.0020923973817213886
sim_compute_performance-ego0_min0.0020923973817213886
sim_compute_sim_state_max0.006516901678487125
sim_compute_sim_state_mean0.006516901678487125
sim_compute_sim_state_median0.006516901678487125
sim_compute_sim_state_min0.006516901678487125
sim_render-ego0_max0.004025205386667625
sim_render-ego0_mean0.004025205386667625
sim_render-ego0_median0.004025205386667625
sim_render-ego0_min0.004025205386667625
simulation-passed1
step_physics_max0.1709444701522713
step_physics_mean0.1709444701522713
step_physics_median0.1709444701522713
step_physics_min0.1709444701522713
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6621713911YU CHENCBC Net v2 - testaido-LF-sim-validationsim-3of4successnogpu-production-spot-1-030:13:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median17.67138341175619
survival_time_median59.99999999999873
deviation-center-line_median3.733799504574528
in-drivable-lane_median8.849999999999834


other stats
agent_compute-ego0_max0.09301333621975584
agent_compute-ego0_mean0.09301333621975584
agent_compute-ego0_median0.09301333621975584
agent_compute-ego0_min0.09301333621975584
complete-iteration_max0.3640832480145534
complete-iteration_mean0.3640832480145534
complete-iteration_median0.3640832480145534
complete-iteration_min0.3640832480145534
deviation-center-line_max3.733799504574528
deviation-center-line_mean3.733799504574528
deviation-center-line_min3.733799504574528
deviation-heading_max16.154796149665884
deviation-heading_mean16.154796149665884
deviation-heading_median16.154796149665884
deviation-heading_min16.154796149665884
driven_any_max22.450804762447632
driven_any_mean22.450804762447632
driven_any_median22.450804762447632
driven_any_min22.450804762447632
driven_lanedir_consec_max17.67138341175619
driven_lanedir_consec_mean17.67138341175619
driven_lanedir_consec_min17.67138341175619
driven_lanedir_max17.67138341175619
driven_lanedir_mean17.67138341175619
driven_lanedir_median17.67138341175619
driven_lanedir_min17.67138341175619
get_duckie_state_max1.7122066983771662e-06
get_duckie_state_mean1.7122066983771662e-06
get_duckie_state_median1.7122066983771662e-06
get_duckie_state_min1.7122066983771662e-06
get_robot_state_max0.004066658456756312
get_robot_state_mean0.004066658456756312
get_robot_state_median0.004066658456756312
get_robot_state_min0.004066658456756312
get_state_dump_max0.0050469395719301095
get_state_dump_mean0.0050469395719301095
get_state_dump_median0.0050469395719301095
get_state_dump_min0.0050469395719301095
get_ui_image_max0.03961415274951182
get_ui_image_mean0.03961415274951182
get_ui_image_median0.03961415274951182
get_ui_image_min0.03961415274951182
in-drivable-lane_max8.849999999999834
in-drivable-lane_mean8.849999999999834
in-drivable-lane_min8.849999999999834
per-episodes
details{"LF-norm-zigzag-000-ego0": {"driven_any": 22.450804762447632, "get_ui_image": 0.03961415274951182, "step_physics": 0.19889755927950617, "survival_time": 59.99999999999873, "driven_lanedir": 17.67138341175619, "get_state_dump": 0.0050469395719301095, "get_robot_state": 0.004066658456756312, "sim_render-ego0": 0.004172534966448959, "get_duckie_state": 1.7122066983771662e-06, "in-drivable-lane": 8.849999999999834, "deviation-heading": 16.154796149665884, "agent_compute-ego0": 0.09301333621975584, "complete-iteration": 0.3640832480145534, "set_robot_commands": 0.002580719526165431, "deviation-center-line": 3.733799504574528, "driven_lanedir_consec": 17.67138341175619, "sim_compute_sim_state": 0.014385192817097202, "sim_compute_performance-ego0": 0.0022090735979421647}}
set_robot_commands_max0.002580719526165431
set_robot_commands_mean0.002580719526165431
set_robot_commands_median0.002580719526165431
set_robot_commands_min0.002580719526165431
sim_compute_performance-ego0_max0.0022090735979421647
sim_compute_performance-ego0_mean0.0022090735979421647
sim_compute_performance-ego0_median0.0022090735979421647
sim_compute_performance-ego0_min0.0022090735979421647
sim_compute_sim_state_max0.014385192817097202
sim_compute_sim_state_mean0.014385192817097202
sim_compute_sim_state_median0.014385192817097202
sim_compute_sim_state_min0.014385192817097202
sim_render-ego0_max0.004172534966448959
sim_render-ego0_mean0.004172534966448959
sim_render-ego0_median0.004172534966448959
sim_render-ego0_min0.004172534966448959
simulation-passed1
step_physics_max0.19889755927950617
step_physics_mean0.19889755927950617
step_physics_median0.19889755927950617
step_physics_min0.19889755927950617
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6619713946YU CHENCBC Net v2 test - added APR 1 2 times anomaly + mar 28 bc_v1aido-LFP-sim-validationsim-1of4successnogpu-production-spot-1-030:02:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.099999999999983
in-drivable-lane_median3.699999999999988
driven_lanedir_consec_median1.2175071304085108
deviation-center-line_median0.2419230167925999


other stats
agent_compute-ego0_max0.1016193820046378
agent_compute-ego0_mean0.1016193820046378
agent_compute-ego0_median0.1016193820046378
agent_compute-ego0_min0.1016193820046378
complete-iteration_max0.2860103787242116
complete-iteration_mean0.2860103787242116
complete-iteration_median0.2860103787242116
complete-iteration_min0.2860103787242116
deviation-center-line_max0.2419230167925999
deviation-center-line_mean0.2419230167925999
deviation-center-line_min0.2419230167925999
deviation-heading_max1.4360117713024034
deviation-heading_mean1.4360117713024034
deviation-heading_median1.4360117713024034
deviation-heading_min1.4360117713024034
driven_any_max2.1486472689125113
driven_any_mean2.1486472689125113
driven_any_median2.1486472689125113
driven_any_min2.1486472689125113
driven_lanedir_consec_max1.2175071304085108
driven_lanedir_consec_mean1.2175071304085108
driven_lanedir_consec_min1.2175071304085108
driven_lanedir_max1.2175071304085108
driven_lanedir_mean1.2175071304085108
driven_lanedir_median1.2175071304085108
driven_lanedir_min1.2175071304085108
get_duckie_state_max0.004872068658575312
get_duckie_state_mean0.004872068658575312
get_duckie_state_median0.004872068658575312
get_duckie_state_min0.004872068658575312
get_robot_state_max0.004284283497950414
get_robot_state_mean0.004284283497950414
get_robot_state_median0.004284283497950414
get_robot_state_min0.004284283497950414
get_state_dump_max0.00614891018900838
get_state_dump_mean0.00614891018900838
get_state_dump_median0.00614891018900838
get_state_dump_min0.00614891018900838
get_ui_image_max0.029668914688217057
get_ui_image_mean0.029668914688217057
get_ui_image_median0.029668914688217057
get_ui_image_min0.029668914688217057
in-drivable-lane_max3.699999999999988
in-drivable-lane_mean3.699999999999988
in-drivable-lane_min3.699999999999988
per-episodes
details{"LFP-norm-small_loop-000-ego0": {"driven_any": 2.1486472689125113, "get_ui_image": 0.029668914688217057, "step_physics": 0.1235214930314284, "survival_time": 7.099999999999983, "driven_lanedir": 1.2175071304085108, "get_state_dump": 0.00614891018900838, "get_robot_state": 0.004284283497950414, "sim_render-ego0": 0.004196327049415428, "get_duckie_state": 0.004872068658575312, "in-drivable-lane": 3.699999999999988, "deviation-heading": 1.4360117713024034, "agent_compute-ego0": 0.1016193820046378, "complete-iteration": 0.2860103787242116, "set_robot_commands": 0.002679943204759718, "deviation-center-line": 0.2419230167925999, "driven_lanedir_consec": 1.2175071304085108, "sim_compute_sim_state": 0.006655769748287601, "sim_compute_performance-ego0": 0.002256068316372958}}
set_robot_commands_max0.002679943204759718
set_robot_commands_mean0.002679943204759718
set_robot_commands_median0.002679943204759718
set_robot_commands_min0.002679943204759718
sim_compute_performance-ego0_max0.002256068316372958
sim_compute_performance-ego0_mean0.002256068316372958
sim_compute_performance-ego0_median0.002256068316372958
sim_compute_performance-ego0_min0.002256068316372958
sim_compute_sim_state_max0.006655769748287601
sim_compute_sim_state_mean0.006655769748287601
sim_compute_sim_state_median0.006655769748287601
sim_compute_sim_state_min0.006655769748287601
sim_render-ego0_max0.004196327049415428
sim_render-ego0_mean0.004196327049415428
sim_render-ego0_median0.004196327049415428
sim_render-ego0_min0.004196327049415428
simulation-passed1
step_physics_max0.1235214930314284
step_physics_mean0.1235214930314284
step_physics_median0.1235214930314284
step_physics_min0.1235214930314284
survival_time_max7.099999999999983
survival_time_mean7.099999999999983
survival_time_min7.099999999999983
No reset possible
6618813992Frank (Chude) QianΒ πŸ‡¨πŸ‡¦CBC Net - MixTraining - Expert LF Human LFPaido-LFP-sim-validationsim-1of4successnogpu-production-spot-1-030:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.149999999999986
in-drivable-lane_median1.6999999999999948
driven_lanedir_consec_median1.6372643474784363
deviation-center-line_median0.39010489094708134


other stats
agent_compute-ego0_max0.0653651722015873
agent_compute-ego0_mean0.0653651722015873
agent_compute-ego0_median0.0653651722015873
agent_compute-ego0_min0.0653651722015873
complete-iteration_max0.2615527299142653
complete-iteration_mean0.2615527299142653
complete-iteration_median0.2615527299142653
complete-iteration_min0.2615527299142653
deviation-center-line_max0.39010489094708134
deviation-center-line_mean0.39010489094708134
deviation-center-line_min0.39010489094708134
deviation-heading_max1.4884544891321891
deviation-heading_mean1.4884544891321891
deviation-heading_median1.4884544891321891
deviation-heading_min1.4884544891321891
driven_any_max2.5868159185985085
driven_any_mean2.5868159185985085
driven_any_median2.5868159185985085
driven_any_min2.5868159185985085
driven_lanedir_consec_max1.6372643474784363
driven_lanedir_consec_mean1.6372643474784363
driven_lanedir_consec_min1.6372643474784363
driven_lanedir_max1.6372643474784363
driven_lanedir_mean1.6372643474784363
driven_lanedir_median1.6372643474784363
driven_lanedir_min1.6372643474784363
get_duckie_state_max0.0049428689864373975
get_duckie_state_mean0.0049428689864373975
get_duckie_state_median0.0049428689864373975
get_duckie_state_min0.0049428689864373975
get_robot_state_max0.004370289464150706
get_robot_state_mean0.004370289464150706
get_robot_state_median0.004370289464150706
get_robot_state_min0.004370289464150706
get_state_dump_max0.006568035771769862
get_state_dump_mean0.006568035771769862
get_state_dump_median0.006568035771769862
get_state_dump_min0.006568035771769862
get_ui_image_max0.02963396426170103
get_ui_image_mean0.02963396426170103
get_ui_image_median0.02963396426170103
get_ui_image_min0.02963396426170103
in-drivable-lane_max1.6999999999999948
in-drivable-lane_mean1.6999999999999948
in-drivable-lane_min1.6999999999999948
per-episodes
details{"LFP-norm-small_loop-000-ego0": {"driven_any": 2.5868159185985085, "get_ui_image": 0.02963396426170103, "step_physics": 0.13442578238825645, "survival_time": 6.149999999999986, "driven_lanedir": 1.6372643474784363, "get_state_dump": 0.006568035771769862, "get_robot_state": 0.004370289464150706, "sim_render-ego0": 0.004404489071138443, "get_duckie_state": 0.0049428689864373975, "in-drivable-lane": 1.6999999999999948, "deviation-heading": 1.4884544891321891, "agent_compute-ego0": 0.0653651722015873, "complete-iteration": 0.2615527299142653, "set_robot_commands": 0.002681074603911369, "deviation-center-line": 0.39010489094708134, "driven_lanedir_consec": 1.6372643474784363, "sim_compute_sim_state": 0.006685005080315375, "sim_compute_performance-ego0": 0.0023702344586772305}}
set_robot_commands_max0.002681074603911369
set_robot_commands_mean0.002681074603911369
set_robot_commands_median0.002681074603911369
set_robot_commands_min0.002681074603911369
sim_compute_performance-ego0_max0.0023702344586772305
sim_compute_performance-ego0_mean0.0023702344586772305
sim_compute_performance-ego0_median0.0023702344586772305
sim_compute_performance-ego0_min0.0023702344586772305
sim_compute_sim_state_max0.006685005080315375
sim_compute_sim_state_mean0.006685005080315375
sim_compute_sim_state_median0.006685005080315375
sim_compute_sim_state_min0.006685005080315375
sim_render-ego0_max0.004404489071138443
sim_render-ego0_mean0.004404489071138443
sim_render-ego0_median0.004404489071138443
sim_render-ego0_min0.004404489071138443
simulation-passed1
step_physics_max0.13442578238825645
step_physics_mean0.13442578238825645
step_physics_median0.13442578238825645
step_physics_min0.13442578238825645
survival_time_max6.149999999999986
survival_time_mean6.149999999999986
survival_time_min6.149999999999986
No reset possible
6618113992Frank (Chude) QianΒ πŸ‡¨πŸ‡¦CBC Net - MixTraining - Expert LF Human LFPaido-LFP-sim-validationsim-3of4successnogpu-production-spot-1-030:01:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.1999999999999966
in-drivable-lane_median0.0
driven_lanedir_consec_median1.1081929058436897
deviation-center-line_median0.20450604089572008


other stats
agent_compute-ego0_max0.05877131682175856
agent_compute-ego0_mean0.05877131682175856
agent_compute-ego0_median0.05877131682175856
agent_compute-ego0_min0.05877131682175856
complete-iteration_max0.290569334763747
complete-iteration_mean0.290569334763747
complete-iteration_median0.290569334763747
complete-iteration_min0.290569334763747
deviation-center-line_max0.20450604089572008
deviation-center-line_mean0.20450604089572008
deviation-center-line_min0.20450604089572008
deviation-heading_max0.526746341930796
deviation-heading_mean0.526746341930796
deviation-heading_median0.526746341930796
deviation-heading_min0.526746341930796
driven_any_max1.1287336441969378
driven_any_mean1.1287336441969378
driven_any_median1.1287336441969378
driven_any_min1.1287336441969378
driven_lanedir_consec_max1.1081929058436897
driven_lanedir_consec_mean1.1081929058436897
driven_lanedir_consec_min1.1081929058436897
driven_lanedir_max1.1081929058436897
driven_lanedir_mean1.1081929058436897
driven_lanedir_median1.1081929058436897
driven_lanedir_min1.1081929058436897
get_duckie_state_max0.02280290310199444
get_duckie_state_mean0.02280290310199444
get_duckie_state_median0.02280290310199444
get_duckie_state_min0.02280290310199444
get_robot_state_max0.004054718751173753
get_robot_state_mean0.004054718751173753
get_robot_state_median0.004054718751173753
get_robot_state_min0.004054718751173753
get_state_dump_max0.0089691712306096
get_state_dump_mean0.0089691712306096
get_state_dump_median0.0089691712306096
get_state_dump_min0.0089691712306096
get_ui_image_max0.03885557834918683
get_ui_image_mean0.03885557834918683
get_ui_image_median0.03885557834918683
get_ui_image_min0.03885557834918683
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-techtrack-000-ego0": {"driven_any": 1.1287336441969378, "get_ui_image": 0.03885557834918683, "step_physics": 0.1350358119377723, "survival_time": 3.1999999999999966, "driven_lanedir": 1.1081929058436897, "get_state_dump": 0.0089691712306096, "get_robot_state": 0.004054718751173753, "sim_render-ego0": 0.004312603290264423, "get_duckie_state": 0.02280290310199444, "in-drivable-lane": 0.0, "deviation-heading": 0.526746341930796, "agent_compute-ego0": 0.05877131682175856, "complete-iteration": 0.290569334763747, "set_robot_commands": 0.002640665494478666, "deviation-center-line": 0.20450604089572008, "driven_lanedir_consec": 1.1081929058436897, "sim_compute_sim_state": 0.01275152059701773, "sim_compute_performance-ego0": 0.002254970257098858}}
set_robot_commands_max0.002640665494478666
set_robot_commands_mean0.002640665494478666
set_robot_commands_median0.002640665494478666
set_robot_commands_min0.002640665494478666
sim_compute_performance-ego0_max0.002254970257098858
sim_compute_performance-ego0_mean0.002254970257098858
sim_compute_performance-ego0_median0.002254970257098858
sim_compute_performance-ego0_min0.002254970257098858
sim_compute_sim_state_max0.01275152059701773
sim_compute_sim_state_mean0.01275152059701773
sim_compute_sim_state_median0.01275152059701773
sim_compute_sim_state_min0.01275152059701773
sim_render-ego0_max0.004312603290264423
sim_render-ego0_mean0.004312603290264423
sim_render-ego0_median0.004312603290264423
sim_render-ego0_min0.004312603290264423
simulation-passed1
step_physics_max0.1350358119377723
step_physics_mean0.1350358119377723
step_physics_median0.1350358119377723
step_physics_min0.1350358119377723
survival_time_max3.1999999999999966
survival_time_mean3.1999999999999966
survival_time_min3.1999999999999966
No reset possible
6615113996Frank (Chude) QianΒ πŸ‡¨πŸ‡¦baseline-behavior-cloningaido-LFP-sim-validationsim-1of4successnogpu-production-spot-1-030:04:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.750000000000217
in-drivable-lane_median4.5500000000000504
driven_lanedir_consec_median4.496694134904974
deviation-center-line_median1.3794442412069925


other stats
agent_compute-ego0_max0.040684482743663174
agent_compute-ego0_mean0.040684482743663174
agent_compute-ego0_median0.040684482743663174
agent_compute-ego0_min0.040684482743663174
complete-iteration_max0.21425207343793684
complete-iteration_mean0.21425207343793684
complete-iteration_median0.21425207343793684
complete-iteration_min0.21425207343793684
deviation-center-line_max1.3794442412069925
deviation-center-line_mean1.3794442412069925
deviation-center-line_min1.3794442412069925
deviation-heading_max6.773061816016197
deviation-heading_mean6.773061816016197
deviation-heading_median6.773061816016197
deviation-heading_min6.773061816016197
driven_any_max5.798291685615088
driven_any_mean5.798291685615088
driven_any_median5.798291685615088
driven_any_min5.798291685615088
driven_lanedir_consec_max4.496694134904974
driven_lanedir_consec_mean4.496694134904974
driven_lanedir_consec_min4.496694134904974
driven_lanedir_max4.496694134904974
driven_lanedir_mean4.496694134904974
driven_lanedir_median4.496694134904974
driven_lanedir_min4.496694134904974
get_duckie_state_max0.004542437291914417
get_duckie_state_mean0.004542437291914417
get_duckie_state_median0.004542437291914417
get_duckie_state_min0.004542437291914417
get_robot_state_max0.003984340736942906
get_robot_state_mean0.003984340736942906
get_robot_state_median0.003984340736942906
get_robot_state_min0.003984340736942906
get_state_dump_max0.005965188626320132
get_state_dump_mean0.005965188626320132
get_state_dump_median0.005965188626320132
get_state_dump_min0.005965188626320132
get_ui_image_max0.02905339387155348
get_ui_image_mean0.02905339387155348
get_ui_image_median0.02905339387155348
get_ui_image_min0.02905339387155348
in-drivable-lane_max4.5500000000000504
in-drivable-lane_mean4.5500000000000504
in-drivable-lane_min4.5500000000000504
per-episodes
details{"LFP-norm-small_loop-000-ego0": {"driven_any": 5.798291685615088, "get_ui_image": 0.02905339387155348, "step_physics": 0.11487049969934648, "survival_time": 24.750000000000217, "driven_lanedir": 4.496694134904974, "get_state_dump": 0.005965188626320132, "get_robot_state": 0.003984340736942906, "sim_render-ego0": 0.0040069039790861065, "get_duckie_state": 0.004542437291914417, "in-drivable-lane": 4.5500000000000504, "deviation-heading": 6.773061816016197, "agent_compute-ego0": 0.040684482743663174, "complete-iteration": 0.21425207343793684, "set_robot_commands": 0.002409425473982288, "deviation-center-line": 1.3794442412069925, "driven_lanedir_consec": 4.496694134904974, "sim_compute_sim_state": 0.006531822585290478, "sim_compute_performance-ego0": 0.0021158548132065805}}
set_robot_commands_max0.002409425473982288
set_robot_commands_mean0.002409425473982288
set_robot_commands_median0.002409425473982288
set_robot_commands_min0.002409425473982288
sim_compute_performance-ego0_max0.0021158548132065805
sim_compute_performance-ego0_mean0.0021158548132065805
sim_compute_performance-ego0_median0.0021158548132065805
sim_compute_performance-ego0_min0.0021158548132065805
sim_compute_sim_state_max0.006531822585290478
sim_compute_sim_state_mean0.006531822585290478
sim_compute_sim_state_median0.006531822585290478
sim_compute_sim_state_min0.006531822585290478
sim_render-ego0_max0.0040069039790861065
sim_render-ego0_mean0.0040069039790861065
sim_render-ego0_median0.0040069039790861065
sim_render-ego0_min0.0040069039790861065
simulation-passed1
step_physics_max0.11487049969934648
step_physics_mean0.11487049969934648
step_physics_median0.11487049969934648
step_physics_min0.11487049969934648
survival_time_max24.750000000000217
survival_time_mean24.750000000000217
survival_time_min24.750000000000217
No reset possible
6614014032YU CHENCBC V2, mar28 bc, mar31_apr6 anomaly aido-LFP-sim-validationsim-0of4successnogpu-production-spot-1-030:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.499999999999999
in-drivable-lane_median0.20000000000000015
driven_lanedir_consec_median0.4444774667224096
deviation-center-line_median0.2341197363357758


other stats
agent_compute-ego0_max0.10732439920014028
agent_compute-ego0_mean0.10732439920014028
agent_compute-ego0_median0.10732439920014028
agent_compute-ego0_min0.10732439920014028
complete-iteration_max0.38072503781786154
complete-iteration_mean0.38072503781786154
complete-iteration_median0.38072503781786154
complete-iteration_min0.38072503781786154
deviation-center-line_max0.2341197363357758
deviation-center-line_mean0.2341197363357758
deviation-center-line_min0.2341197363357758
deviation-heading_max0.6748260988584457
deviation-heading_mean0.6748260988584457
deviation-heading_median0.6748260988584457
deviation-heading_min0.6748260988584457
driven_any_max0.5465902205378907
driven_any_mean0.5465902205378907
driven_any_median0.5465902205378907
driven_any_min0.5465902205378907
driven_lanedir_consec_max0.4444774667224096
driven_lanedir_consec_mean0.4444774667224096
driven_lanedir_consec_min0.4444774667224096
driven_lanedir_max0.4444774667224096
driven_lanedir_mean0.4444774667224096
driven_lanedir_median0.4444774667224096
driven_lanedir_min0.4444774667224096
get_duckie_state_max0.02390444512460746
get_duckie_state_mean0.02390444512460746
get_duckie_state_median0.02390444512460746
get_duckie_state_min0.02390444512460746
get_robot_state_max0.0043200418060901115
get_robot_state_mean0.0043200418060901115
get_robot_state_median0.0043200418060901115
get_robot_state_min0.0043200418060901115
get_state_dump_max0.009158821666941925
get_state_dump_mean0.009158821666941925
get_state_dump_median0.009158821666941925
get_state_dump_min0.009158821666941925
get_ui_image_max0.0440824873307172
get_ui_image_mean0.0440824873307172
get_ui_image_median0.0440824873307172
get_ui_image_min0.0440824873307172
in-drivable-lane_max0.20000000000000015
in-drivable-lane_mean0.20000000000000015
in-drivable-lane_min0.20000000000000015
per-episodes
details{"LFP-norm-zigzag-000-ego0": {"driven_any": 0.5465902205378907, "get_ui_image": 0.0440824873307172, "step_physics": 0.171586742588118, "survival_time": 2.499999999999999, "driven_lanedir": 0.4444774667224096, "get_state_dump": 0.009158821666941925, "get_robot_state": 0.0043200418060901115, "sim_render-ego0": 0.004522122588812136, "get_duckie_state": 0.02390444512460746, "in-drivable-lane": 0.20000000000000015, "deviation-heading": 0.6748260988584457, "agent_compute-ego0": 0.10732439920014028, "complete-iteration": 0.38072503781786154, "set_robot_commands": 0.0027340393440396177, "deviation-center-line": 0.2341197363357758, "driven_lanedir_consec": 0.4444774667224096, "sim_compute_sim_state": 0.010544561872295305, "sim_compute_performance-ego0": 0.002427059061387006}}
set_robot_commands_max0.0027340393440396177
set_robot_commands_mean0.0027340393440396177
set_robot_commands_median0.0027340393440396177
set_robot_commands_min0.0027340393440396177
sim_compute_performance-ego0_max0.002427059061387006
sim_compute_performance-ego0_mean0.002427059061387006
sim_compute_performance-ego0_median0.002427059061387006
sim_compute_performance-ego0_min0.002427059061387006
sim_compute_sim_state_max0.010544561872295305
sim_compute_sim_state_mean0.010544561872295305
sim_compute_sim_state_median0.010544561872295305
sim_compute_sim_state_min0.010544561872295305
sim_render-ego0_max0.004522122588812136
sim_render-ego0_mean0.004522122588812136
sim_render-ego0_median0.004522122588812136
sim_render-ego0_min0.004522122588812136
simulation-passed1
step_physics_max0.171586742588118
step_physics_mean0.171586742588118
step_physics_median0.171586742588118
step_physics_min0.171586742588118
survival_time_max2.499999999999999
survival_time_mean2.499999999999999
survival_time_min2.499999999999999
No reset possible
6612914032YU CHENCBC V2, mar28 bc, mar31_apr6 anomaly aido-LFP-sim-validationsim-2of4successnogpu-production-spot-1-030:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.849999999999987
in-drivable-lane_median0.0
driven_lanedir_consec_median2.163990316265352
deviation-center-line_median0.5186014384134997


other stats
agent_compute-ego0_max0.09467797158128125
agent_compute-ego0_mean0.09467797158128125
agent_compute-ego0_median0.09467797158128125
agent_compute-ego0_min0.09467797158128125
complete-iteration_max0.3147408719790184
complete-iteration_mean0.3147408719790184
complete-iteration_median0.3147408719790184
complete-iteration_min0.3147408719790184
deviation-center-line_max0.5186014384134997
deviation-center-line_mean0.5186014384134997
deviation-center-line_min0.5186014384134997
deviation-heading_max1.22785187640114
deviation-heading_mean1.22785187640114
deviation-heading_median1.22785187640114
deviation-heading_min1.22785187640114
driven_any_max2.2149453889767527
driven_any_mean2.2149453889767527
driven_any_median2.2149453889767527
driven_any_min2.2149453889767527
driven_lanedir_consec_max2.163990316265352
driven_lanedir_consec_mean2.163990316265352
driven_lanedir_consec_min2.163990316265352
driven_lanedir_max2.163990316265352
driven_lanedir_mean2.163990316265352
driven_lanedir_median2.163990316265352
driven_lanedir_min2.163990316265352
get_duckie_state_max0.025250966266050175
get_duckie_state_mean0.025250966266050175
get_duckie_state_median0.025250966266050175
get_duckie_state_min0.025250966266050175
get_robot_state_max0.0039174354682534425
get_robot_state_mean0.0039174354682534425
get_robot_state_median0.0039174354682534425
get_robot_state_min0.0039174354682534425
get_state_dump_max0.008992964938535528
get_state_dump_mean0.008992964938535528
get_state_dump_median0.008992964938535528
get_state_dump_min0.008992964938535528
get_ui_image_max0.03364233041213731
get_ui_image_mean0.03364233041213731
get_ui_image_median0.03364233041213731
get_ui_image_min0.03364233041213731
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.2149453889767527, "get_ui_image": 0.03364233041213731, "step_physics": 0.13188978777093402, "survival_time": 5.849999999999987, "driven_lanedir": 2.163990316265352, "get_state_dump": 0.008992964938535528, "get_robot_state": 0.0039174354682534425, "sim_render-ego0": 0.003904954861786406, "get_duckie_state": 0.025250966266050175, "in-drivable-lane": 0.0, "deviation-heading": 1.22785187640114, "agent_compute-ego0": 0.09467797158128125, "complete-iteration": 0.3147408719790184, "set_robot_commands": 0.0024426488553063344, "deviation-center-line": 0.5186014384134997, "driven_lanedir_consec": 2.163990316265352, "sim_compute_sim_state": 0.007865992643065372, "sim_compute_performance-ego0": 0.0020569502297094313}}
set_robot_commands_max0.0024426488553063344
set_robot_commands_mean0.0024426488553063344
set_robot_commands_median0.0024426488553063344
set_robot_commands_min0.0024426488553063344
sim_compute_performance-ego0_max0.0020569502297094313
sim_compute_performance-ego0_mean0.0020569502297094313
sim_compute_performance-ego0_median0.0020569502297094313
sim_compute_performance-ego0_min0.0020569502297094313
sim_compute_sim_state_max0.007865992643065372
sim_compute_sim_state_mean0.007865992643065372
sim_compute_sim_state_median0.007865992643065372
sim_compute_sim_state_min0.007865992643065372
sim_render-ego0_max0.003904954861786406
sim_render-ego0_mean0.003904954861786406
sim_render-ego0_median0.003904954861786406
sim_render-ego0_min0.003904954861786406
simulation-passed1
step_physics_max0.13188978777093402
step_physics_mean0.13188978777093402
step_physics_median0.13188978777093402
step_physics_min0.13188978777093402
survival_time_max5.849999999999987
survival_time_mean5.849999999999987
survival_time_min5.849999999999987
No reset possible
6604713578MΓ‘rton TimΒ πŸ‡­πŸ‡Ί3626aido-LFV_multi-sim-validation402host-errornogpu-production-spot-1-030:21:11
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1146, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6602513945YU CHENCBC Net v2 test - added APR 1 2 times anomaly + mar 28 bc_v1aido-LF-sim-validationsim-2of4successnogpu-production-spot-1-030:10:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median14.219990291977169
survival_time_median59.99999999999873
deviation-center-line_median3.2043384787677076
in-drivable-lane_median19.049999999999716


other stats
agent_compute-ego0_max0.09722801648409142
agent_compute-ego0_mean0.09722801648409142
agent_compute-ego0_median0.09722801648409142
agent_compute-ego0_min0.09722801648409142
complete-iteration_max0.2988754382836233
complete-iteration_mean0.2988754382836233
complete-iteration_median0.2988754382836233
complete-iteration_min0.2988754382836233
deviation-center-line_max3.2043384787677076
deviation-center-line_mean3.2043384787677076
deviation-center-line_min3.2043384787677076
deviation-heading_max18.310466176596144
deviation-heading_mean18.310466176596144
deviation-heading_median18.310466176596144
deviation-heading_min18.310466176596144
driven_any_max23.01441289575472
driven_any_mean23.01441289575472
driven_any_median23.01441289575472
driven_any_min23.01441289575472
driven_lanedir_consec_max14.219990291977169
driven_lanedir_consec_mean14.219990291977169
driven_lanedir_consec_min14.219990291977169
driven_lanedir_max14.219990291977169
driven_lanedir_mean14.219990291977169
driven_lanedir_median14.219990291977169
driven_lanedir_min14.219990291977169
get_duckie_state_max1.6060002538981187e-06
get_duckie_state_mean1.6060002538981187e-06
get_duckie_state_median1.6060002538981187e-06
get_duckie_state_min1.6060002538981187e-06
get_robot_state_max0.004347946324217429
get_robot_state_mean0.004347946324217429
get_robot_state_median0.004347946324217429
get_robot_state_min0.004347946324217429
get_state_dump_max0.005271305549551704
get_state_dump_mean0.005271305549551704
get_state_dump_median0.005271305549551704
get_state_dump_min0.005271305549551704
get_ui_image_max0.02953078466887081
get_ui_image_mean0.02953078466887081
get_ui_image_median0.02953078466887081
get_ui_image_min0.02953078466887081
in-drivable-lane_max19.049999999999716
in-drivable-lane_mean19.049999999999716
in-drivable-lane_min19.049999999999716
per-episodes
details{"LF-norm-small_loop-000-ego0": {"driven_any": 23.01441289575472, "get_ui_image": 0.02953078466887081, "step_physics": 0.14576760219793136, "survival_time": 59.99999999999873, "driven_lanedir": 14.219990291977169, "get_state_dump": 0.005271305549551704, "get_robot_state": 0.004347946324217429, "sim_render-ego0": 0.004390444187796384, "get_duckie_state": 1.6060002538981187e-06, "in-drivable-lane": 19.049999999999716, "deviation-heading": 18.310466176596144, "agent_compute-ego0": 0.09722801648409142, "complete-iteration": 0.2988754382836233, "set_robot_commands": 0.002750400500333279, "deviation-center-line": 3.2043384787677076, "driven_lanedir_consec": 14.219990291977169, "sim_compute_sim_state": 0.007105452929011591, "sim_compute_performance-ego0": 0.002383002035822301}}
set_robot_commands_max0.002750400500333279
set_robot_commands_mean0.002750400500333279
set_robot_commands_median0.002750400500333279
set_robot_commands_min0.002750400500333279
sim_compute_performance-ego0_max0.002383002035822301
sim_compute_performance-ego0_mean0.002383002035822301
sim_compute_performance-ego0_median0.002383002035822301
sim_compute_performance-ego0_min0.002383002035822301
sim_compute_sim_state_max0.007105452929011591
sim_compute_sim_state_mean0.007105452929011591
sim_compute_sim_state_median0.007105452929011591
sim_compute_sim_state_min0.007105452929011591
sim_render-ego0_max0.004390444187796384
sim_render-ego0_mean0.004390444187796384
sim_render-ego0_median0.004390444187796384
sim_render-ego0_min0.004390444187796384
simulation-passed1
step_physics_max0.14576760219793136
step_physics_mean0.14576760219793136
step_physics_median0.14576760219793136
step_physics_min0.14576760219793136
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6595814031YU CHENCBC V2, mar28 bc, mar31_apr6 anomaly aido-LF-sim-validationsim-1of4successnogpu-production-spot-1-030:12:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median16.04583389521964
survival_time_median59.99999999999873
deviation-center-line_median3.4703236301652756
in-drivable-lane_median19.349999999999625


other stats
agent_compute-ego0_max0.08779039490133599
agent_compute-ego0_mean0.08779039490133599
agent_compute-ego0_median0.08779039490133599
agent_compute-ego0_min0.08779039490133599
complete-iteration_max0.3197635881708226
complete-iteration_mean0.3197635881708226
complete-iteration_median0.3197635881708226
complete-iteration_min0.3197635881708226
deviation-center-line_max3.4703236301652756
deviation-center-line_mean3.4703236301652756
deviation-center-line_min3.4703236301652756
deviation-heading_max12.618845824011114
deviation-heading_mean12.618845824011114
deviation-heading_median12.618845824011114
deviation-heading_min12.618845824011114
driven_any_max25.00964385587135
driven_any_mean25.00964385587135
driven_any_median25.00964385587135
driven_any_min25.00964385587135
driven_lanedir_consec_max16.04583389521964
driven_lanedir_consec_mean16.04583389521964
driven_lanedir_consec_min16.04583389521964
driven_lanedir_max16.04583389521964
driven_lanedir_mean16.04583389521964
driven_lanedir_median16.04583389521964
driven_lanedir_min16.04583389521964
get_duckie_state_max1.219885236119152e-06
get_duckie_state_mean1.219885236119152e-06
get_duckie_state_median1.219885236119152e-06
get_duckie_state_min1.219885236119152e-06
get_robot_state_max0.003852026349400402
get_robot_state_mean0.003852026349400402
get_robot_state_median0.003852026349400402
get_robot_state_min0.003852026349400402
get_state_dump_max0.004739570379455719
get_state_dump_mean0.004739570379455719
get_state_dump_median0.004739570379455719
get_state_dump_min0.004739570379455719
get_ui_image_max0.035018055564060895
get_ui_image_mean0.035018055564060895
get_ui_image_median0.035018055564060895
get_ui_image_min0.035018055564060895
in-drivable-lane_max19.349999999999625
in-drivable-lane_mean19.349999999999625
in-drivable-lane_min19.349999999999625
per-episodes
details{"LF-norm-techtrack-000-ego0": {"driven_any": 25.00964385587135, "get_ui_image": 0.035018055564060895, "step_physics": 0.16697528261030645, "survival_time": 59.99999999999873, "driven_lanedir": 16.04583389521964, "get_state_dump": 0.004739570379455719, "get_robot_state": 0.003852026349400402, "sim_render-ego0": 0.004037491387868305, "get_duckie_state": 1.219885236119152e-06, "in-drivable-lane": 19.349999999999625, "deviation-heading": 12.618845824011114, "agent_compute-ego0": 0.08779039490133599, "complete-iteration": 0.3197635881708226, "set_robot_commands": 0.002514328587362907, "deviation-center-line": 3.4703236301652756, "driven_lanedir_consec": 16.04583389521964, "sim_compute_sim_state": 0.012611495763634168, "sim_compute_performance-ego0": 0.0021402152948435103}}
set_robot_commands_max0.002514328587362907
set_robot_commands_mean0.002514328587362907
set_robot_commands_median0.002514328587362907
set_robot_commands_min0.002514328587362907
sim_compute_performance-ego0_max0.0021402152948435103
sim_compute_performance-ego0_mean0.0021402152948435103
sim_compute_performance-ego0_median0.0021402152948435103
sim_compute_performance-ego0_min0.0021402152948435103
sim_compute_sim_state_max0.012611495763634168
sim_compute_sim_state_mean0.012611495763634168
sim_compute_sim_state_median0.012611495763634168
sim_compute_sim_state_min0.012611495763634168
sim_render-ego0_max0.004037491387868305
sim_render-ego0_mean0.004037491387868305
sim_render-ego0_median0.004037491387868305
sim_render-ego0_min0.004037491387868305
simulation-passed1
step_physics_max0.16697528261030645
step_physics_mean0.16697528261030645
step_physics_median0.16697528261030645
step_physics_min0.16697528261030645
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6588713579Andras Beres202-1aido-LF-sim-testingsim-1of4successnogpu-production-spot-1-030:13:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median28.146669698972723
survival_time_median59.99999999999873
deviation-center-line_median3.9801925841448487
in-drivable-lane_median2.5499999999999403


other stats
agent_compute-ego0_max0.020203859780253616
agent_compute-ego0_mean0.020203859780253616
agent_compute-ego0_median0.020203859780253616
agent_compute-ego0_min0.020203859780253616
complete-iteration_max0.2685320200669974
complete-iteration_mean0.2685320200669974
complete-iteration_median0.2685320200669974
complete-iteration_min0.2685320200669974
deviation-center-line_max3.9801925841448487
deviation-center-line_mean3.9801925841448487
deviation-center-line_min3.9801925841448487
deviation-heading_max8.907389062688784
deviation-heading_mean8.907389062688784
deviation-heading_median8.907389062688784
deviation-heading_min8.907389062688784
driven_any_max29.59858964229844
driven_any_mean29.59858964229844
driven_any_median29.59858964229844
driven_any_min29.59858964229844
driven_lanedir_consec_max28.146669698972723
driven_lanedir_consec_mean28.146669698972723
driven_lanedir_consec_min28.146669698972723
driven_lanedir_max28.146669698972723
driven_lanedir_mean28.146669698972723
driven_lanedir_median28.146669698972723
driven_lanedir_min28.146669698972723
get_duckie_state_max1.4392462102300815e-06
get_duckie_state_mean1.4392462102300815e-06
get_duckie_state_median1.4392462102300815e-06
get_duckie_state_min1.4392462102300815e-06
get_robot_state_max0.004237372114894591
get_robot_state_mean0.004237372114894591
get_robot_state_median0.004237372114894591
get_robot_state_min0.004237372114894591
get_state_dump_max0.005327421262996779
get_state_dump_mean0.005327421262996779
get_state_dump_median0.005327421262996779
get_state_dump_min0.005327421262996779
get_ui_image_max0.0368727738414577
get_ui_image_mean0.0368727738414577
get_ui_image_median0.0368727738414577
get_ui_image_min0.0368727738414577
in-drivable-lane_max2.5499999999999403
in-drivable-lane_mean2.5499999999999403
in-drivable-lane_min2.5499999999999403
per-episodes
details{"LF-norm-techtrack-000-ego0": {"driven_any": 29.59858964229844, "get_ui_image": 0.0368727738414577, "step_physics": 0.1776922249377121, "survival_time": 59.99999999999873, "driven_lanedir": 28.146669698972723, "get_state_dump": 0.005327421262996779, "get_robot_state": 0.004237372114894591, "sim_render-ego0": 0.004345103167772889, "get_duckie_state": 1.4392462102300815e-06, "in-drivable-lane": 2.5499999999999403, "deviation-heading": 8.907389062688784, "agent_compute-ego0": 0.020203859780253616, "complete-iteration": 0.2685320200669974, "set_robot_commands": 0.002675816181001814, "deviation-center-line": 3.9801925841448487, "driven_lanedir_consec": 28.146669698972723, "sim_compute_sim_state": 0.014718923640191605, "sim_compute_performance-ego0": 0.0023540876787171375}}
set_robot_commands_max0.002675816181001814
set_robot_commands_mean0.002675816181001814
set_robot_commands_median0.002675816181001814
set_robot_commands_min0.002675816181001814
sim_compute_performance-ego0_max0.0023540876787171375
sim_compute_performance-ego0_mean0.0023540876787171375
sim_compute_performance-ego0_median0.0023540876787171375
sim_compute_performance-ego0_min0.0023540876787171375
sim_compute_sim_state_max0.014718923640191605
sim_compute_sim_state_mean0.014718923640191605
sim_compute_sim_state_median0.014718923640191605
sim_compute_sim_state_min0.014718923640191605
sim_render-ego0_max0.004345103167772889
sim_render-ego0_mean0.004345103167772889
sim_render-ego0_median0.004345103167772889
sim_render-ego0_min0.004345103167772889
simulation-passed1
step_physics_max0.1776922249377121
step_physics_mean0.1776922249377121
step_physics_median0.1776922249377121
step_physics_min0.1776922249377121
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible