Duckietown Challenges Home Challenges Submissions

Evaluator 5096

ID5096
evaluatorgpu-production-spot-3-01
ownerI don't have one 😀
machinegpu-production-spot-3_3796f36240d7
processgpu-production-spot-3-01_3796f36240d7
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success17 65885
# timeout
# failed6 66070
# error
# aborted1 66325
# host-error1 66142
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors99%
RAM total (MB)249.0 GB
RAM free (MB)238.9 GB
Disk (MB)969.3 GB
Disk available (MB)862.2 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6632513798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednogpu-production-spot-3-010:00:43
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6632013939YU CHENCBC Net v2 test - added mar 31 datasetaido-LFP-sim-validationsim-3of4successnogpu-production-spot-3-010:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.699999999999984
in-drivable-lane_median2.6499999999999906
driven_lanedir_consec_median1.280714407366344
deviation-center-line_median0.22378888413386297


other stats
agent_compute-ego0_max0.09686900068212438
agent_compute-ego0_mean0.09686900068212438
agent_compute-ego0_median0.09686900068212438
agent_compute-ego0_min0.09686900068212438
complete-iteration_max0.3561097339347557
complete-iteration_mean0.3561097339347557
complete-iteration_median0.3561097339347557
complete-iteration_min0.3561097339347557
deviation-center-line_max0.22378888413386297
deviation-center-line_mean0.22378888413386297
deviation-center-line_min0.22378888413386297
deviation-heading_max1.1540271232727222
deviation-heading_mean1.1540271232727222
deviation-heading_median1.1540271232727222
deviation-heading_min1.1540271232727222
driven_any_max2.030154214941604
driven_any_mean2.030154214941604
driven_any_median2.030154214941604
driven_any_min2.030154214941604
driven_lanedir_consec_max1.280714407366344
driven_lanedir_consec_mean1.280714407366344
driven_lanedir_consec_min1.280714407366344
driven_lanedir_max1.280714407366344
driven_lanedir_mean1.280714407366344
driven_lanedir_median1.280714407366344
driven_lanedir_min1.280714407366344
get_duckie_state_max0.02192983274106626
get_duckie_state_mean0.02192983274106626
get_duckie_state_median0.02192983274106626
get_duckie_state_min0.02192983274106626
get_robot_state_max0.003926416679664894
get_robot_state_mean0.003926416679664894
get_robot_state_median0.003926416679664894
get_robot_state_min0.003926416679664894
get_state_dump_max0.00839538750825105
get_state_dump_mean0.00839538750825105
get_state_dump_median0.00839538750825105
get_state_dump_min0.00839538750825105
get_ui_image_max0.037369526757134335
get_ui_image_mean0.037369526757134335
get_ui_image_median0.037369526757134335
get_ui_image_min0.037369526757134335
in-drivable-lane_max2.6499999999999906
in-drivable-lane_mean2.6499999999999906
in-drivable-lane_min2.6499999999999906
per-episodes
details{"LFP-norm-techtrack-000-ego0": {"driven_any": 2.030154214941604, "get_ui_image": 0.037369526757134335, "step_physics": 0.1648033036126031, "survival_time": 6.699999999999984, "driven_lanedir": 1.280714407366344, "get_state_dump": 0.00839538750825105, "get_robot_state": 0.003926416679664894, "sim_render-ego0": 0.004047598662199797, "get_duckie_state": 0.02192983274106626, "in-drivable-lane": 2.6499999999999906, "deviation-heading": 1.1540271232727222, "agent_compute-ego0": 0.09686900068212438, "complete-iteration": 0.3561097339347557, "set_robot_commands": 0.002514733208550347, "deviation-center-line": 0.22378888413386297, "driven_lanedir_consec": 1.280714407366344, "sim_compute_sim_state": 0.013651047812567816, "sim_compute_performance-ego0": 0.0024982946890371818}}
set_robot_commands_max0.002514733208550347
set_robot_commands_mean0.002514733208550347
set_robot_commands_median0.002514733208550347
set_robot_commands_min0.002514733208550347
sim_compute_performance-ego0_max0.0024982946890371818
sim_compute_performance-ego0_mean0.0024982946890371818
sim_compute_performance-ego0_median0.0024982946890371818
sim_compute_performance-ego0_min0.0024982946890371818
sim_compute_sim_state_max0.013651047812567816
sim_compute_sim_state_mean0.013651047812567816
sim_compute_sim_state_median0.013651047812567816
sim_compute_sim_state_min0.013651047812567816
sim_render-ego0_max0.004047598662199797
sim_render-ego0_mean0.004047598662199797
sim_render-ego0_median0.004047598662199797
sim_render-ego0_min0.004047598662199797
simulation-passed1
step_physics_max0.1648033036126031
step_physics_mean0.1648033036126031
step_physics_median0.1648033036126031
step_physics_min0.1648033036126031
survival_time_max6.699999999999984
survival_time_mean6.699999999999984
survival_time_min6.699999999999984
No reset possible
6627313692Samuel Alexandertemplate-pytorchaido-LF-sim-validationsim-0of4successnogpu-production-spot-3-010:10:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0558907929435035
survival_time_median59.99999999999873
deviation-center-line_median1.7436320326789383
in-drivable-lane_median41.49999999999873


other stats
agent_compute-ego0_max0.015410477275356068
agent_compute-ego0_mean0.015410477275356068
agent_compute-ego0_median0.015410477275356068
agent_compute-ego0_min0.015410477275356068
complete-iteration_max0.2927884136409585
complete-iteration_mean0.2927884136409585
complete-iteration_median0.2927884136409585
complete-iteration_min0.2927884136409585
deviation-center-line_max1.7436320326789383
deviation-center-line_mean1.7436320326789383
deviation-center-line_min1.7436320326789383
deviation-heading_max13.41054431337428
deviation-heading_mean13.41054431337428
deviation-heading_median13.41054431337428
deviation-heading_min13.41054431337428
driven_any_max4.541720776121821
driven_any_mean4.541720776121821
driven_any_median4.541720776121821
driven_any_min4.541720776121821
driven_lanedir_consec_max1.0558907929435035
driven_lanedir_consec_mean1.0558907929435035
driven_lanedir_consec_min1.0558907929435035
driven_lanedir_max1.0558907929435035
driven_lanedir_mean1.0558907929435035
driven_lanedir_median1.0558907929435035
driven_lanedir_min1.0558907929435035
get_duckie_state_max1.4837139552082248e-06
get_duckie_state_mean1.4837139552082248e-06
get_duckie_state_median1.4837139552082248e-06
get_duckie_state_min1.4837139552082248e-06
get_robot_state_max0.004224567190991353
get_robot_state_mean0.004224567190991353
get_robot_state_median0.004224567190991353
get_robot_state_min0.004224567190991353
get_state_dump_max0.005210184832595965
get_state_dump_mean0.005210184832595965
get_state_dump_median0.005210184832595965
get_state_dump_min0.005210184832595965
get_ui_image_max0.032564315271814304
get_ui_image_mean0.032564315271814304
get_ui_image_median0.032564315271814304
get_ui_image_min0.032564315271814304
in-drivable-lane_max41.49999999999873
in-drivable-lane_mean41.49999999999873
in-drivable-lane_min41.49999999999873
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.541720776121821, "get_ui_image": 0.032564315271814304, "step_physics": 0.21662118413069167, "survival_time": 59.99999999999873, "driven_lanedir": 1.0558907929435035, "get_state_dump": 0.005210184832595965, "get_robot_state": 0.004224567190991353, "sim_render-ego0": 0.004277407974128819, "get_duckie_state": 1.4837139552082248e-06, "in-drivable-lane": 41.49999999999873, "deviation-heading": 13.41054431337428, "agent_compute-ego0": 0.015410477275356068, "complete-iteration": 0.2927884136409585, "set_robot_commands": 0.0025693623846913256, "deviation-center-line": 1.7436320326789383, "driven_lanedir_consec": 1.0558907929435035, "sim_compute_sim_state": 0.009557602506791624, "sim_compute_performance-ego0": 0.0022636865398270403}}
set_robot_commands_max0.0025693623846913256
set_robot_commands_mean0.0025693623846913256
set_robot_commands_median0.0025693623846913256
set_robot_commands_min0.0025693623846913256
sim_compute_performance-ego0_max0.0022636865398270403
sim_compute_performance-ego0_mean0.0022636865398270403
sim_compute_performance-ego0_median0.0022636865398270403
sim_compute_performance-ego0_min0.0022636865398270403
sim_compute_sim_state_max0.009557602506791624
sim_compute_sim_state_mean0.009557602506791624
sim_compute_sim_state_median0.009557602506791624
sim_compute_sim_state_min0.009557602506791624
sim_render-ego0_max0.004277407974128819
sim_render-ego0_mean0.004277407974128819
sim_render-ego0_median0.004277407974128819
sim_render-ego0_min0.004277407974128819
simulation-passed1
step_physics_max0.21662118413069167
step_physics_mean0.21662118413069167
step_physics_median0.21662118413069167
step_physics_min0.21662118413069167
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6625813696Samuel Alexandertemplate-tensorflowaido-LF-sim-validationsim-3of4successnogpu-production-spot-3-010:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0992294293298066
survival_time_median2.1000000000000005
deviation-center-line_median0.04570520831846874
in-drivable-lane_median1.2000000000000004


other stats
agent_compute-ego0_max0.06863072861072629
agent_compute-ego0_mean0.06863072861072629
agent_compute-ego0_median0.06863072861072629
agent_compute-ego0_min0.06863072861072629
complete-iteration_max0.28199852899063466
complete-iteration_mean0.28199852899063466
complete-iteration_median0.28199852899063466
complete-iteration_min0.28199852899063466
deviation-center-line_max0.04570520831846874
deviation-center-line_mean0.04570520831846874
deviation-center-line_min0.04570520831846874
deviation-heading_max0.6615557226264039
deviation-heading_mean0.6615557226264039
deviation-heading_median0.6615557226264039
deviation-heading_min0.6615557226264039
driven_any_max0.27317920244916577
driven_any_mean0.27317920244916577
driven_any_median0.27317920244916577
driven_any_min0.27317920244916577
driven_lanedir_consec_max0.0992294293298066
driven_lanedir_consec_mean0.0992294293298066
driven_lanedir_consec_min0.0992294293298066
driven_lanedir_max0.0992294293298066
driven_lanedir_mean0.0992294293298066
driven_lanedir_median0.0992294293298066
driven_lanedir_min0.0992294293298066
get_duckie_state_max1.441600710846657e-06
get_duckie_state_mean1.441600710846657e-06
get_duckie_state_median1.441600710846657e-06
get_duckie_state_min1.441600710846657e-06
get_robot_state_max0.004626579062883244
get_robot_state_mean0.004626579062883244
get_robot_state_median0.004626579062883244
get_robot_state_min0.004626579062883244
get_state_dump_max0.00582339042841002
get_state_dump_mean0.00582339042841002
get_state_dump_median0.00582339042841002
get_state_dump_min0.00582339042841002
get_ui_image_max0.040554262870966
get_ui_image_mean0.040554262870966
get_ui_image_median0.040554262870966
get_ui_image_min0.040554262870966
in-drivable-lane_max1.2000000000000004
in-drivable-lane_mean1.2000000000000004
in-drivable-lane_min1.2000000000000004
per-episodes
details{"LF-norm-zigzag-000-ego0": {"driven_any": 0.27317920244916577, "get_ui_image": 0.040554262870966, "step_physics": 0.14202042513115462, "survival_time": 2.1000000000000005, "driven_lanedir": 0.0992294293298066, "get_state_dump": 0.00582339042841002, "get_robot_state": 0.004626579062883244, "sim_render-ego0": 0.004597636156303938, "get_duckie_state": 1.441600710846657e-06, "in-drivable-lane": 1.2000000000000004, "deviation-heading": 0.6615557226264039, "agent_compute-ego0": 0.06863072861072629, "complete-iteration": 0.28199852899063466, "set_robot_commands": 0.002736651620199514, "deviation-center-line": 0.04570520831846874, "driven_lanedir_consec": 0.0992294293298066, "sim_compute_sim_state": 0.01046459064927212, "sim_compute_performance-ego0": 0.002440236335576967}}
set_robot_commands_max0.002736651620199514
set_robot_commands_mean0.002736651620199514
set_robot_commands_median0.002736651620199514
set_robot_commands_min0.002736651620199514
sim_compute_performance-ego0_max0.002440236335576967
sim_compute_performance-ego0_mean0.002440236335576967
sim_compute_performance-ego0_median0.002440236335576967
sim_compute_performance-ego0_min0.002440236335576967
sim_compute_sim_state_max0.01046459064927212
sim_compute_sim_state_mean0.01046459064927212
sim_compute_sim_state_median0.01046459064927212
sim_compute_sim_state_min0.01046459064927212
sim_render-ego0_max0.004597636156303938
sim_render-ego0_mean0.004597636156303938
sim_render-ego0_median0.004597636156303938
sim_render-ego0_min0.004597636156303938
simulation-passed1
step_physics_max0.14202042513115462
step_physics_mean0.14202042513115462
step_physics_median0.14202042513115462
step_physics_min0.14202042513115462
survival_time_max2.1000000000000005
survival_time_mean2.1000000000000005
survival_time_min2.1000000000000005
No reset possible
6622813909YU CHENCBC Net v2 - testaido-LF-sim-validationsim-1of4successnogpu-production-spot-3-010:11:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median13.129293762396465
survival_time_median59.99999999999873
deviation-center-line_median2.465943462157634
in-drivable-lane_median27.2999999999995


other stats
agent_compute-ego0_max0.0955416376048778
agent_compute-ego0_mean0.0955416376048778
agent_compute-ego0_median0.0955416376048778
agent_compute-ego0_min0.0955416376048778
complete-iteration_max0.3289873542436255
complete-iteration_mean0.3289873542436255
complete-iteration_median0.3289873542436255
complete-iteration_min0.3289873542436255
deviation-center-line_max2.465943462157634
deviation-center-line_mean2.465943462157634
deviation-center-line_min2.465943462157634
deviation-heading_max11.566804188641775
deviation-heading_mean11.566804188641775
deviation-heading_median11.566804188641775
deviation-heading_min11.566804188641775
driven_any_max25.36960542153335
driven_any_mean25.36960542153335
driven_any_median25.36960542153335
driven_any_min25.36960542153335
driven_lanedir_consec_max13.129293762396465
driven_lanedir_consec_mean13.129293762396465
driven_lanedir_consec_min13.129293762396465
driven_lanedir_max13.129293762396465
driven_lanedir_mean13.129293762396465
driven_lanedir_median13.129293762396465
driven_lanedir_min13.129293762396465
get_duckie_state_max1.3221213462251508e-06
get_duckie_state_mean1.3221213462251508e-06
get_duckie_state_median1.3221213462251508e-06
get_duckie_state_min1.3221213462251508e-06
get_robot_state_max0.004060461757383576
get_robot_state_mean0.004060461757383576
get_robot_state_median0.004060461757383576
get_robot_state_min0.004060461757383576
get_state_dump_max0.005108006689371812
get_state_dump_mean0.005108006689371812
get_state_dump_median0.005108006689371812
get_state_dump_min0.005108006689371812
get_ui_image_max0.035503794410445114
get_ui_image_mean0.035503794410445114
get_ui_image_median0.035503794410445114
get_ui_image_min0.035503794410445114
in-drivable-lane_max27.2999999999995
in-drivable-lane_mean27.2999999999995
in-drivable-lane_min27.2999999999995
per-episodes
details{"LF-norm-techtrack-000-ego0": {"driven_any": 25.36960542153335, "get_ui_image": 0.035503794410445114, "step_physics": 0.1663346090086493, "survival_time": 59.99999999999873, "driven_lanedir": 13.129293762396465, "get_state_dump": 0.005108006689371812, "get_robot_state": 0.004060461757383576, "sim_render-ego0": 0.004184816600281829, "get_duckie_state": 1.3221213462251508e-06, "in-drivable-lane": 27.2999999999995, "deviation-heading": 11.566804188641775, "agent_compute-ego0": 0.0955416376048778, "complete-iteration": 0.3289873542436255, "set_robot_commands": 0.0025797684325663674, "deviation-center-line": 2.465943462157634, "driven_lanedir_consec": 13.129293762396465, "sim_compute_sim_state": 0.01333981449657634, "sim_compute_performance-ego0": 0.0022413772309848807}}
set_robot_commands_max0.0025797684325663674
set_robot_commands_mean0.0025797684325663674
set_robot_commands_median0.0025797684325663674
set_robot_commands_min0.0025797684325663674
sim_compute_performance-ego0_max0.0022413772309848807
sim_compute_performance-ego0_mean0.0022413772309848807
sim_compute_performance-ego0_median0.0022413772309848807
sim_compute_performance-ego0_min0.0022413772309848807
sim_compute_sim_state_max0.01333981449657634
sim_compute_sim_state_mean0.01333981449657634
sim_compute_sim_state_median0.01333981449657634
sim_compute_sim_state_min0.01333981449657634
sim_render-ego0_max0.004184816600281829
sim_render-ego0_mean0.004184816600281829
sim_render-ego0_median0.004184816600281829
sim_render-ego0_min0.004184816600281829
simulation-passed1
step_physics_max0.1663346090086493
step_physics_mean0.1663346090086493
step_physics_median0.1663346090086493
step_physics_min0.1663346090086493
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6622313941YU CHENCBC Net v2 test - added mar 31 anomaly + mar 28 bcaido-LFP-sim-validationsim-1of4successnogpu-production-spot-3-010:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.249999999999982
in-drivable-lane_median4.199999999999986
driven_lanedir_consec_median1.196072754402646
deviation-center-line_median0.18333145604972584


other stats
agent_compute-ego0_max0.09811792798238256
agent_compute-ego0_mean0.09811792798238256
agent_compute-ego0_median0.09811792798238256
agent_compute-ego0_min0.09811792798238256
complete-iteration_max0.2943905461324404
complete-iteration_mean0.2943905461324404
complete-iteration_median0.2943905461324404
complete-iteration_min0.2943905461324404
deviation-center-line_max0.18333145604972584
deviation-center-line_mean0.18333145604972584
deviation-center-line_min0.18333145604972584
deviation-heading_max1.0612425344412106
deviation-heading_mean1.0612425344412106
deviation-heading_median1.0612425344412106
deviation-heading_min1.0612425344412106
driven_any_max2.1542783616060093
driven_any_mean2.1542783616060093
driven_any_median2.1542783616060093
driven_any_min2.1542783616060093
driven_lanedir_consec_max1.196072754402646
driven_lanedir_consec_mean1.196072754402646
driven_lanedir_consec_min1.196072754402646
driven_lanedir_max1.196072754402646
driven_lanedir_mean1.196072754402646
driven_lanedir_median1.196072754402646
driven_lanedir_min1.196072754402646
get_duckie_state_max0.00473960131815035
get_duckie_state_mean0.00473960131815035
get_duckie_state_median0.00473960131815035
get_duckie_state_min0.00473960131815035
get_robot_state_max0.004157125133357636
get_robot_state_mean0.004157125133357636
get_robot_state_median0.004157125133357636
get_robot_state_min0.004157125133357636
get_state_dump_max0.006118251852793236
get_state_dump_mean0.006118251852793236
get_state_dump_median0.006118251852793236
get_state_dump_min0.006118251852793236
get_ui_image_max0.029361094513984574
get_ui_image_mean0.029361094513984574
get_ui_image_median0.029361094513984574
get_ui_image_min0.029361094513984574
in-drivable-lane_max4.199999999999986
in-drivable-lane_mean4.199999999999986
in-drivable-lane_min4.199999999999986
per-episodes
details{"LFP-norm-small_loop-000-ego0": {"driven_any": 2.1542783616060093, "get_ui_image": 0.029361094513984574, "step_physics": 0.13646652110635418, "survival_time": 7.249999999999982, "driven_lanedir": 1.196072754402646, "get_state_dump": 0.006118251852793236, "get_robot_state": 0.004157125133357636, "sim_render-ego0": 0.004145491613100653, "get_duckie_state": 0.00473960131815035, "in-drivable-lane": 4.199999999999986, "deviation-heading": 1.0612425344412106, "agent_compute-ego0": 0.09811792798238256, "complete-iteration": 0.2943905461324404, "set_robot_commands": 0.002658770508962135, "deviation-center-line": 0.18333145604972584, "driven_lanedir_consec": 1.196072754402646, "sim_compute_sim_state": 0.006328675844897963, "sim_compute_performance-ego0": 0.0021892459425207687}}
set_robot_commands_max0.002658770508962135
set_robot_commands_mean0.002658770508962135
set_robot_commands_median0.002658770508962135
set_robot_commands_min0.002658770508962135
sim_compute_performance-ego0_max0.0021892459425207687
sim_compute_performance-ego0_mean0.0021892459425207687
sim_compute_performance-ego0_median0.0021892459425207687
sim_compute_performance-ego0_min0.0021892459425207687
sim_compute_sim_state_max0.006328675844897963
sim_compute_sim_state_mean0.006328675844897963
sim_compute_sim_state_median0.006328675844897963
sim_compute_sim_state_min0.006328675844897963
sim_render-ego0_max0.004145491613100653
sim_render-ego0_mean0.004145491613100653
sim_render-ego0_median0.004145491613100653
sim_render-ego0_min0.004145491613100653
simulation-passed1
step_physics_max0.13646652110635418
step_physics_mean0.13646652110635418
step_physics_median0.13646652110635418
step_physics_min0.13646652110635418
survival_time_max7.249999999999982
survival_time_mean7.249999999999982
survival_time_min7.249999999999982
No reset possible
6621213941YU CHENCBC Net v2 test - added mar 31 anomaly + mar 28 bcaido-LFP-sim-validationsim-2of4successnogpu-production-spot-3-010:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.949999999999983
in-drivable-lane_median2.549999999999992
driven_lanedir_consec_median1.4721626404659571
deviation-center-line_median0.340265533274142


other stats
agent_compute-ego0_max0.09831589460372923
agent_compute-ego0_mean0.09831589460372923
agent_compute-ego0_median0.09831589460372923
agent_compute-ego0_min0.09831589460372923
complete-iteration_max0.337778753893716
complete-iteration_mean0.337778753893716
complete-iteration_median0.337778753893716
complete-iteration_min0.337778753893716
deviation-center-line_max0.340265533274142
deviation-center-line_mean0.340265533274142
deviation-center-line_min0.340265533274142
deviation-heading_max1.5687724194637076
deviation-heading_mean1.5687724194637076
deviation-heading_median1.5687724194637076
deviation-heading_min1.5687724194637076
driven_any_max2.5078253523495784
driven_any_mean2.5078253523495784
driven_any_median2.5078253523495784
driven_any_min2.5078253523495784
driven_lanedir_consec_max1.4721626404659571
driven_lanedir_consec_mean1.4721626404659571
driven_lanedir_consec_min1.4721626404659571
driven_lanedir_max1.4721626404659571
driven_lanedir_mean1.4721626404659571
driven_lanedir_median1.4721626404659571
driven_lanedir_min1.4721626404659571
get_duckie_state_max0.026691712651933944
get_duckie_state_mean0.026691712651933944
get_duckie_state_median0.026691712651933944
get_duckie_state_min0.026691712651933944
get_robot_state_max0.004123272214617048
get_robot_state_mean0.004123272214617048
get_robot_state_median0.004123272214617048
get_robot_state_min0.004123272214617048
get_state_dump_max0.009531056880950928
get_state_dump_mean0.009531056880950928
get_state_dump_median0.009531056880950928
get_state_dump_min0.009531056880950928
get_ui_image_max0.03502866200038365
get_ui_image_mean0.03502866200038365
get_ui_image_median0.03502866200038365
get_ui_image_min0.03502866200038365
in-drivable-lane_max2.549999999999992
in-drivable-lane_mean2.549999999999992
in-drivable-lane_min2.549999999999992
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.5078253523495784, "get_ui_image": 0.03502866200038365, "step_physics": 0.14679775408336093, "survival_time": 6.949999999999983, "driven_lanedir": 1.4721626404659571, "get_state_dump": 0.009531056880950928, "get_robot_state": 0.004123272214617048, "sim_render-ego0": 0.004102749483925956, "get_duckie_state": 0.026691712651933944, "in-drivable-lane": 2.549999999999992, "deviation-heading": 1.5687724194637076, "agent_compute-ego0": 0.09831589460372923, "complete-iteration": 0.337778753893716, "set_robot_commands": 0.002579312665121896, "deviation-center-line": 0.340265533274142, "driven_lanedir_consec": 1.4721626404659571, "sim_compute_sim_state": 0.008368791852678572, "sim_compute_performance-ego0": 0.00213383606501988}}
set_robot_commands_max0.002579312665121896
set_robot_commands_mean0.002579312665121896
set_robot_commands_median0.002579312665121896
set_robot_commands_min0.002579312665121896
sim_compute_performance-ego0_max0.00213383606501988
sim_compute_performance-ego0_mean0.00213383606501988
sim_compute_performance-ego0_median0.00213383606501988
sim_compute_performance-ego0_min0.00213383606501988
sim_compute_sim_state_max0.008368791852678572
sim_compute_sim_state_mean0.008368791852678572
sim_compute_sim_state_median0.008368791852678572
sim_compute_sim_state_min0.008368791852678572
sim_render-ego0_max0.004102749483925956
sim_render-ego0_mean0.004102749483925956
sim_render-ego0_median0.004102749483925956
sim_render-ego0_min0.004102749483925956
simulation-passed1
step_physics_max0.14679775408336093
step_physics_mean0.14679775408336093
step_physics_median0.14679775408336093
step_physics_min0.14679775408336093
survival_time_max6.949999999999983
survival_time_mean6.949999999999983
survival_time_min6.949999999999983
No reset possible
6620013992Frank (Chude) Qian 🇨🇦CBC Net - MixTraining - Expert LF Human LFPaido-LFP-sim-validationsim-1of4successnogpu-production-spot-3-010:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.349999999999985
in-drivable-lane_median2.199999999999993
driven_lanedir_consec_median1.5059490424835658
deviation-center-line_median0.272329392249347


other stats
agent_compute-ego0_max0.059080151841044426
agent_compute-ego0_mean0.059080151841044426
agent_compute-ego0_median0.059080151841044426
agent_compute-ego0_min0.059080151841044426
complete-iteration_max0.2463986184448004
complete-iteration_mean0.2463986184448004
complete-iteration_median0.2463986184448004
complete-iteration_min0.2463986184448004
deviation-center-line_max0.272329392249347
deviation-center-line_mean0.272329392249347
deviation-center-line_min0.272329392249347
deviation-heading_max1.4782358244719314
deviation-heading_mean1.4782358244719314
deviation-heading_median1.4782358244719314
deviation-heading_min1.4782358244719314
driven_any_max2.717700186043142
driven_any_mean2.717700186043142
driven_any_median2.717700186043142
driven_any_min2.717700186043142
driven_lanedir_consec_max1.5059490424835658
driven_lanedir_consec_mean1.5059490424835658
driven_lanedir_consec_min1.5059490424835658
driven_lanedir_max1.5059490424835658
driven_lanedir_mean1.5059490424835658
driven_lanedir_median1.5059490424835658
driven_lanedir_min1.5059490424835658
get_duckie_state_max0.004787173122167587
get_duckie_state_mean0.004787173122167587
get_duckie_state_median0.004787173122167587
get_duckie_state_min0.004787173122167587
get_robot_state_max0.004107162356376648
get_robot_state_mean0.004107162356376648
get_robot_state_median0.004107162356376648
get_robot_state_min0.004107162356376648
get_state_dump_max0.006461627781391144
get_state_dump_mean0.006461627781391144
get_state_dump_median0.006461627781391144
get_state_dump_min0.006461627781391144
get_ui_image_max0.030052924528717995
get_ui_image_mean0.030052924528717995
get_ui_image_median0.030052924528717995
get_ui_image_min0.030052924528717995
in-drivable-lane_max2.199999999999993
in-drivable-lane_mean2.199999999999993
in-drivable-lane_min2.199999999999993
per-episodes
details{"LFP-norm-small_loop-000-ego0": {"driven_any": 2.717700186043142, "get_ui_image": 0.030052924528717995, "step_physics": 0.12615483067929745, "survival_time": 6.349999999999985, "driven_lanedir": 1.5059490424835658, "get_state_dump": 0.006461627781391144, "get_robot_state": 0.004107162356376648, "sim_render-ego0": 0.004268676042556763, "get_duckie_state": 0.004787173122167587, "in-drivable-lane": 2.199999999999993, "deviation-heading": 1.4782358244719314, "agent_compute-ego0": 0.059080151841044426, "complete-iteration": 0.2463986184448004, "set_robot_commands": 0.002688709646463394, "deviation-center-line": 0.272329392249347, "driven_lanedir_consec": 1.5059490424835658, "sim_compute_sim_state": 0.006419211626052856, "sim_compute_performance-ego0": 0.002277011051774025}}
set_robot_commands_max0.002688709646463394
set_robot_commands_mean0.002688709646463394
set_robot_commands_median0.002688709646463394
set_robot_commands_min0.002688709646463394
sim_compute_performance-ego0_max0.002277011051774025
sim_compute_performance-ego0_mean0.002277011051774025
sim_compute_performance-ego0_median0.002277011051774025
sim_compute_performance-ego0_min0.002277011051774025
sim_compute_sim_state_max0.006419211626052856
sim_compute_sim_state_mean0.006419211626052856
sim_compute_sim_state_median0.006419211626052856
sim_compute_sim_state_min0.006419211626052856
sim_render-ego0_max0.004268676042556763
sim_render-ego0_mean0.004268676042556763
sim_render-ego0_median0.004268676042556763
sim_render-ego0_min0.004268676042556763
simulation-passed1
step_physics_max0.12615483067929745
step_physics_mean0.12615483067929745
step_physics_median0.12615483067929745
step_physics_min0.12615483067929745
survival_time_max6.349999999999985
survival_time_mean6.349999999999985
survival_time_min6.349999999999985
No reset possible
6618313965YU CHENCBC Net v2 test - APR 3 BC TFdata + mar 28 anomalyaido-LFP-sim-validationsim-3of4successnogpu-production-spot-3-010:02:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.249999999999996
in-drivable-lane_median2.3499999999999917
driven_lanedir_consec_median2.278079862061614
deviation-center-line_median0.5603623490771914


other stats
agent_compute-ego0_max0.09627922119632844
agent_compute-ego0_mean0.09627922119632844
agent_compute-ego0_median0.09627922119632844
agent_compute-ego0_min0.09627922119632844
complete-iteration_max0.335386263426914
complete-iteration_mean0.335386263426914
complete-iteration_median0.335386263426914
complete-iteration_min0.335386263426914
deviation-center-line_max0.5603623490771914
deviation-center-line_mean0.5603623490771914
deviation-center-line_min0.5603623490771914
deviation-heading_max1.7019235219461202
deviation-heading_mean1.7019235219461202
deviation-heading_median1.7019235219461202
deviation-heading_min1.7019235219461202
driven_any_max3.364396565212572
driven_any_mean3.364396565212572
driven_any_median3.364396565212572
driven_any_min3.364396565212572
driven_lanedir_consec_max2.278079862061614
driven_lanedir_consec_mean2.278079862061614
driven_lanedir_consec_min2.278079862061614
driven_lanedir_max2.278079862061614
driven_lanedir_mean2.278079862061614
driven_lanedir_median2.278079862061614
driven_lanedir_min2.278079862061614
get_duckie_state_max0.021786692321941414
get_duckie_state_mean0.021786692321941414
get_duckie_state_median0.021786692321941414
get_duckie_state_min0.021786692321941414
get_robot_state_max0.003971519008759529
get_robot_state_mean0.003971519008759529
get_robot_state_median0.003971519008759529
get_robot_state_min0.003971519008759529
get_state_dump_max0.008538212827456895
get_state_dump_mean0.008538212827456895
get_state_dump_median0.008538212827456895
get_state_dump_min0.008538212827456895
get_ui_image_max0.038584181057509555
get_ui_image_mean0.038584181057509555
get_ui_image_median0.038584181057509555
get_ui_image_min0.038584181057509555
in-drivable-lane_max2.3499999999999917
in-drivable-lane_mean2.3499999999999917
in-drivable-lane_min2.3499999999999917
per-episodes
details{"LFP-norm-techtrack-000-ego0": {"driven_any": 3.364396565212572, "get_ui_image": 0.038584181057509555, "step_physics": 0.14467103378747098, "survival_time": 9.249999999999996, "driven_lanedir": 2.278079862061614, "get_state_dump": 0.008538212827456895, "get_robot_state": 0.003971519008759529, "sim_render-ego0": 0.004019542406964046, "get_duckie_state": 0.021786692321941414, "in-drivable-lane": 2.3499999999999917, "deviation-heading": 1.7019235219461202, "agent_compute-ego0": 0.09627922119632844, "complete-iteration": 0.335386263426914, "set_robot_commands": 0.0025681411066362935, "deviation-center-line": 0.5603623490771914, "driven_lanedir_consec": 2.278079862061614, "sim_compute_sim_state": 0.012781441852610598, "sim_compute_performance-ego0": 0.0020807981491088867}}
set_robot_commands_max0.0025681411066362935
set_robot_commands_mean0.0025681411066362935
set_robot_commands_median0.0025681411066362935
set_robot_commands_min0.0025681411066362935
sim_compute_performance-ego0_max0.0020807981491088867
sim_compute_performance-ego0_mean0.0020807981491088867
sim_compute_performance-ego0_median0.0020807981491088867
sim_compute_performance-ego0_min0.0020807981491088867
sim_compute_sim_state_max0.012781441852610598
sim_compute_sim_state_mean0.012781441852610598
sim_compute_sim_state_median0.012781441852610598
sim_compute_sim_state_min0.012781441852610598
sim_render-ego0_max0.004019542406964046
sim_render-ego0_mean0.004019542406964046
sim_render-ego0_median0.004019542406964046
sim_render-ego0_min0.004019542406964046
simulation-passed1
step_physics_max0.14467103378747098
step_physics_mean0.14467103378747098
step_physics_median0.14467103378747098
step_physics_min0.14467103378747098
survival_time_max9.249999999999996
survival_time_mean9.249999999999996
survival_time_min9.249999999999996
No reset possible
6618013996Frank (Chude) Qian 🇨🇦baseline-behavior-cloningaido-LFP-sim-validationsim-2of4failednogpu-production-spot-3-010:00:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 589, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 84, in on_received_get_commands
              ||     linear, angular = self.compute_action(self.to_predictor)
              ||   File "solution.py", line 79, in compute_action
              ||     (linear, angular) = self.model.predict(observation)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 88, in _method_wrapper
              ||     return method(self, *args, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 1268, in predict
              ||     tmp_batch_outputs = predict_function(iterator)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 580, in __call__
              ||     result = self._call(*args, **kwds)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 650, in _call
              ||     return self._concrete_stateful_fn._filtered_call(canon_args, canon_kwds)  # pylint: disable=protected-access
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1661, in _filtered_call
              ||     return self._call_flat(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1745, in _call_flat
              ||     return self._build_call_outputs(self._inference_function.call(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 593, in call
              ||     outputs = execute.execute(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/execute.py", line 59, in quick_execute
              ||     tensors = pywrap_tfe.TFE_Py_Execute(ctx._handle, device_name, op_name,
              || tensorflow.python.framework.errors_impl.UnknownError:  Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || 	 [[node FrankNet/conv2d_5/Conv2D (defined at solution.py:79) ]] [Op:__inference_predict_function_790]
              ||
              || Errors may have originated from an input operation.
              || Input Source operations connected to node FrankNet/conv2d_5/Conv2D:
              ||  FrankNet/lambda_1/truediv (defined at /submission/frankModel.py:42)
              ||
              || Function call stack:
              || predict_function
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 312, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 593, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6617113996Frank (Chude) Qian 🇨🇦baseline-behavior-cloningaido-LFP-sim-validationsim-2of4failednogpu-production-spot-3-010:00:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 589, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 84, in on_received_get_commands
              ||     linear, angular = self.compute_action(self.to_predictor)
              ||   File "solution.py", line 79, in compute_action
              ||     (linear, angular) = self.model.predict(observation)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 88, in _method_wrapper
              ||     return method(self, *args, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 1268, in predict
              ||     tmp_batch_outputs = predict_function(iterator)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 580, in __call__
              ||     result = self._call(*args, **kwds)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 650, in _call
              ||     return self._concrete_stateful_fn._filtered_call(canon_args, canon_kwds)  # pylint: disable=protected-access
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1661, in _filtered_call
              ||     return self._call_flat(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1745, in _call_flat
              ||     return self._build_call_outputs(self._inference_function.call(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 593, in call
              ||     outputs = execute.execute(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/execute.py", line 59, in quick_execute
              ||     tensors = pywrap_tfe.TFE_Py_Execute(ctx._handle, device_name, op_name,
              || tensorflow.python.framework.errors_impl.UnknownError:  Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || 	 [[node FrankNet/conv2d_5/Conv2D (defined at solution.py:79) ]] [Op:__inference_predict_function_790]
              ||
              || Errors may have originated from an input operation.
              || Input Source operations connected to node FrankNet/conv2d_5/Conv2D:
              ||  FrankNet/lambda_1/truediv (defined at /submission/frankModel.py:42)
              ||
              || Function call stack:
              || predict_function
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 312, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 593, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6616113994Frank (Chude) Qian 🇨🇦CBC Net - MixTraining - Expert LF Human LFP - Best Lossaido-LFP-sim-validationsim-1of4successnogpu-production-spot-3-010:01:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.949999999999994
in-drivable-lane_median2.0499999999999927
driven_lanedir_consec_median0.661983254392674
deviation-center-line_median0.09751335537416515


other stats
agent_compute-ego0_max0.05654112100601196
agent_compute-ego0_mean0.05654112100601196
agent_compute-ego0_median0.05654112100601196
agent_compute-ego0_min0.05654112100601196
complete-iteration_max0.22672721445560456
complete-iteration_mean0.22672721445560456
complete-iteration_median0.22672721445560456
complete-iteration_min0.22672721445560456
deviation-center-line_max0.09751335537416515
deviation-center-line_mean0.09751335537416515
deviation-center-line_min0.09751335537416515
deviation-heading_max0.4874996883081997
deviation-heading_mean0.4874996883081997
deviation-heading_median0.4874996883081997
deviation-heading_min0.4874996883081997
driven_any_max1.3127944532591047
driven_any_mean1.3127944532591047
driven_any_median1.3127944532591047
driven_any_min1.3127944532591047
driven_lanedir_consec_max0.661983254392674
driven_lanedir_consec_mean0.661983254392674
driven_lanedir_consec_min0.661983254392674
driven_lanedir_max0.661983254392674
driven_lanedir_mean0.661983254392674
driven_lanedir_median0.661983254392674
driven_lanedir_min0.661983254392674
get_duckie_state_max0.005038183927536011
get_duckie_state_mean0.005038183927536011
get_duckie_state_median0.005038183927536011
get_duckie_state_min0.005038183927536011
get_robot_state_max0.004286816716194153
get_robot_state_mean0.004286816716194153
get_robot_state_median0.004286816716194153
get_robot_state_min0.004286816716194153
get_state_dump_max0.006059369444847107
get_state_dump_mean0.006059369444847107
get_state_dump_median0.006059369444847107
get_state_dump_min0.006059369444847107
get_ui_image_max0.02986944913864136
get_ui_image_mean0.02986944913864136
get_ui_image_median0.02986944913864136
get_ui_image_min0.02986944913864136
in-drivable-lane_max2.0499999999999927
in-drivable-lane_mean2.0499999999999927
in-drivable-lane_min2.0499999999999927
per-episodes
details{"LFP-norm-small_loop-000-ego0": {"driven_any": 1.3127944532591047, "get_ui_image": 0.02986944913864136, "step_physics": 0.1087101399898529, "survival_time": 3.949999999999994, "driven_lanedir": 0.661983254392674, "get_state_dump": 0.006059369444847107, "get_robot_state": 0.004286816716194153, "sim_render-ego0": 0.004304382205009461, "get_duckie_state": 0.005038183927536011, "in-drivable-lane": 2.0499999999999927, "deviation-heading": 0.4874996883081997, "agent_compute-ego0": 0.05654112100601196, "complete-iteration": 0.22672721445560456, "set_robot_commands": 0.0028589040040969847, "deviation-center-line": 0.09751335537416515, "driven_lanedir_consec": 0.661983254392674, "sim_compute_sim_state": 0.00660824179649353, "sim_compute_performance-ego0": 0.002341166138648987}}
set_robot_commands_max0.0028589040040969847
set_robot_commands_mean0.0028589040040969847
set_robot_commands_median0.0028589040040969847
set_robot_commands_min0.0028589040040969847
sim_compute_performance-ego0_max0.002341166138648987
sim_compute_performance-ego0_mean0.002341166138648987
sim_compute_performance-ego0_median0.002341166138648987
sim_compute_performance-ego0_min0.002341166138648987
sim_compute_sim_state_max0.00660824179649353
sim_compute_sim_state_mean0.00660824179649353
sim_compute_sim_state_median0.00660824179649353
sim_compute_sim_state_min0.00660824179649353
sim_render-ego0_max0.004304382205009461
sim_render-ego0_mean0.004304382205009461
sim_render-ego0_median0.004304382205009461
sim_render-ego0_min0.004304382205009461
simulation-passed1
step_physics_max0.1087101399898529
step_physics_mean0.1087101399898529
step_physics_median0.1087101399898529
step_physics_min0.1087101399898529
survival_time_max3.949999999999994
survival_time_mean3.949999999999994
survival_time_min3.949999999999994
No reset possible
6615313996Frank (Chude) Qian 🇨🇦baseline-behavior-cloningaido-LFP-sim-validationsim-0of4failednogpu-production-spot-3-010:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 589, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 84, in on_received_get_commands
              ||     linear, angular = self.compute_action(self.to_predictor)
              ||   File "solution.py", line 79, in compute_action
              ||     (linear, angular) = self.model.predict(observation)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 88, in _method_wrapper
              ||     return method(self, *args, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 1268, in predict
              ||     tmp_batch_outputs = predict_function(iterator)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 580, in __call__
              ||     result = self._call(*args, **kwds)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 650, in _call
              ||     return self._concrete_stateful_fn._filtered_call(canon_args, canon_kwds)  # pylint: disable=protected-access
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1661, in _filtered_call
              ||     return self._call_flat(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1745, in _call_flat
              ||     return self._build_call_outputs(self._inference_function.call(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 593, in call
              ||     outputs = execute.execute(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/execute.py", line 59, in quick_execute
              ||     tensors = pywrap_tfe.TFE_Py_Execute(ctx._handle, device_name, op_name,
              || tensorflow.python.framework.errors_impl.UnknownError:  Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || 	 [[node FrankNet/conv2d_5/Conv2D (defined at solution.py:79) ]] [Op:__inference_predict_function_790]
              ||
              || Errors may have originated from an input operation.
              || Input Source operations connected to node FrankNet/conv2d_5/Conv2D:
              ||  FrankNet/lambda_1/truediv (defined at /submission/frankModel.py:42)
              ||
              || Function call stack:
              || predict_function
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 312, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 593, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6614813998Frank (Chude) Qian 🇨🇦baseline-behavior-cloning New Datasetaido-LFP-sim-validationsim-2of4failednogpu-production-spot-3-010:00:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 589, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 84, in on_received_get_commands
              ||     linear, angular = self.compute_action(self.to_predictor)
              ||   File "solution.py", line 79, in compute_action
              ||     (linear, angular) = self.model.predict(observation)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 88, in _method_wrapper
              ||     return method(self, *args, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 1268, in predict
              ||     tmp_batch_outputs = predict_function(iterator)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 580, in __call__
              ||     result = self._call(*args, **kwds)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/def_function.py", line 650, in _call
              ||     return self._concrete_stateful_fn._filtered_call(canon_args, canon_kwds)  # pylint: disable=protected-access
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1661, in _filtered_call
              ||     return self._call_flat(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 1745, in _call_flat
              ||     return self._build_call_outputs(self._inference_function.call(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/function.py", line 593, in call
              ||     outputs = execute.execute(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/execute.py", line 59, in quick_execute
              ||     tensors = pywrap_tfe.TFE_Py_Execute(ctx._handle, device_name, op_name,
              || tensorflow.python.framework.errors_impl.UnknownError:  Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || 	 [[node FrankNet/conv2d_5/Conv2D (defined at solution.py:79) ]] [Op:__inference_predict_function_790]
              ||
              || Errors may have originated from an input operation.
              || Input Source operations connected to node FrankNet/conv2d_5/Conv2D:
              ||  FrankNet/lambda_1/truediv (defined at /submission/frankModel.py:42)
              ||
              || Function call stack:
              || predict_function
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 312, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 593, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6614213998Frank (Chude) Qian 🇨🇦baseline-behavior-cloning New Datasetaido-LFP-sim-validationsim-2of4host-errornogpu-production-spot-3-010:00:47
The container "solut [...]
The container "solution-ego0" exited with code 139.


Error code 139 means GPU memory error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6612014036YU CHENCBC V2 non dropout comparsion, mar28_apr6 bc, mar31_apr6 anomaly aido-LFP-sim-validationsim-1of4successnogpu-production-spot-3-010:05:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.350000000000083
in-drivable-lane_median6.050000000000059
driven_lanedir_consec_median2.4648910245435527
deviation-center-line_median0.6549474646858414


other stats
agent_compute-ego0_max0.09849469692676098
agent_compute-ego0_mean0.09849469692676098
agent_compute-ego0_median0.09849469692676098
agent_compute-ego0_min0.09849469692676098
complete-iteration_max0.29087821616754905
complete-iteration_mean0.29087821616754905
complete-iteration_median0.29087821616754905
complete-iteration_min0.29087821616754905
deviation-center-line_max0.6549474646858414
deviation-center-line_mean0.6549474646858414
deviation-center-line_min0.6549474646858414
deviation-heading_max3.857978854143183
deviation-heading_mean3.857978854143183
deviation-heading_median3.857978854143183
deviation-heading_min3.857978854143183
driven_any_max4.345009313554871
driven_any_mean4.345009313554871
driven_any_median4.345009313554871
driven_any_min4.345009313554871
driven_lanedir_consec_max2.4648910245435527
driven_lanedir_consec_mean2.4648910245435527
driven_lanedir_consec_min2.4648910245435527
driven_lanedir_max2.4648910245435527
driven_lanedir_mean2.4648910245435527
driven_lanedir_median2.4648910245435527
driven_lanedir_min2.4648910245435527
get_duckie_state_max0.004782134062283999
get_duckie_state_mean0.004782134062283999
get_duckie_state_median0.004782134062283999
get_duckie_state_min0.004782134062283999
get_robot_state_max0.004136680782615364
get_robot_state_mean0.004136680782615364
get_robot_state_median0.004136680782615364
get_robot_state_min0.004136680782615364
get_state_dump_max0.005937063074731208
get_state_dump_mean0.005937063074731208
get_state_dump_median0.005937063074731208
get_state_dump_min0.005937063074731208
get_ui_image_max0.03014203402903173
get_ui_image_mean0.03014203402903173
get_ui_image_median0.03014203402903173
get_ui_image_min0.03014203402903173
in-drivable-lane_max6.050000000000059
in-drivable-lane_mean6.050000000000059
in-drivable-lane_min6.050000000000059
per-episodes
details{"LFP-norm-small_loop-000-ego0": {"driven_any": 4.345009313554871, "get_ui_image": 0.03014203402903173, "step_physics": 0.13126141994030444, "survival_time": 15.350000000000083, "driven_lanedir": 2.4648910245435527, "get_state_dump": 0.005937063074731208, "get_robot_state": 0.004136680782615364, "sim_render-ego0": 0.004224155630384173, "get_duckie_state": 0.004782134062283999, "in-drivable-lane": 6.050000000000059, "deviation-heading": 3.857978854143183, "agent_compute-ego0": 0.09849469692676098, "complete-iteration": 0.29087821616754905, "set_robot_commands": 0.002670452192232206, "deviation-center-line": 0.6549474646858414, "driven_lanedir_consec": 2.4648910245435527, "sim_compute_sim_state": 0.006908303731447691, "sim_compute_performance-ego0": 0.0022219822004243923}}
set_robot_commands_max0.002670452192232206
set_robot_commands_mean0.002670452192232206
set_robot_commands_median0.002670452192232206
set_robot_commands_min0.002670452192232206
sim_compute_performance-ego0_max0.0022219822004243923
sim_compute_performance-ego0_mean0.0022219822004243923
sim_compute_performance-ego0_median0.0022219822004243923
sim_compute_performance-ego0_min0.0022219822004243923
sim_compute_sim_state_max0.006908303731447691
sim_compute_sim_state_mean0.006908303731447691
sim_compute_sim_state_median0.006908303731447691
sim_compute_sim_state_min0.006908303731447691
sim_render-ego0_max0.004224155630384173
sim_render-ego0_mean0.004224155630384173
sim_render-ego0_median0.004224155630384173
sim_render-ego0_min0.004224155630384173
simulation-passed1
step_physics_max0.13126141994030444
step_physics_mean0.13126141994030444
step_physics_median0.13126141994030444
step_physics_min0.13126141994030444
survival_time_max15.350000000000083
survival_time_mean15.350000000000083
survival_time_min15.350000000000083
No reset possible
6607913534András Kalapos 🇭🇺3090aido-LF-sim-testingsim-1of4successnogpu-production-spot-3-010:10:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median27.703008560768232
survival_time_median59.99999999999873
deviation-center-line_median2.5371177922208488
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.015095468961031212
agent_compute-ego0_mean0.015095468961031212
agent_compute-ego0_median0.015095468961031212
agent_compute-ego0_min0.015095468961031212
complete-iteration_max0.27315417614507237
complete-iteration_mean0.27315417614507237
complete-iteration_median0.27315417614507237
complete-iteration_min0.27315417614507237
deviation-center-line_max2.5371177922208488
deviation-center-line_mean2.5371177922208488
deviation-center-line_min2.5371177922208488
deviation-heading_max10.61793751679483
deviation-heading_mean10.61793751679483
deviation-heading_median10.61793751679483
deviation-heading_min10.61793751679483
driven_any_max28.312330489822703
driven_any_mean28.312330489822703
driven_any_median28.312330489822703
driven_any_min28.312330489822703
driven_lanedir_consec_max27.703008560768232
driven_lanedir_consec_mean27.703008560768232
driven_lanedir_consec_min27.703008560768232
driven_lanedir_max27.703008560768232
driven_lanedir_mean27.703008560768232
driven_lanedir_median27.703008560768232
driven_lanedir_min27.703008560768232
get_duckie_state_max1.883526626574209e-06
get_duckie_state_mean1.883526626574209e-06
get_duckie_state_median1.883526626574209e-06
get_duckie_state_min1.883526626574209e-06
get_robot_state_max0.004168723643967551
get_robot_state_mean0.004168723643967551
get_robot_state_median0.004168723643967551
get_robot_state_min0.004168723643967551
get_state_dump_max0.005208460913411188
get_state_dump_mean0.005208460913411188
get_state_dump_median0.005208460913411188
get_state_dump_min0.005208460913411188
get_ui_image_max0.035676666937898734
get_ui_image_mean0.035676666937898734
get_ui_image_median0.035676666937898734
get_ui_image_min0.035676666937898734
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-techtrack-000-ego0": {"driven_any": 28.312330489822703, "get_ui_image": 0.035676666937898734, "step_physics": 0.1895806638525487, "survival_time": 59.99999999999873, "driven_lanedir": 27.703008560768232, "get_state_dump": 0.005208460913411188, "get_robot_state": 0.004168723643967551, "sim_render-ego0": 0.004241229691771445, "get_duckie_state": 1.883526626574209e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.61793751679483, "agent_compute-ego0": 0.015095468961031212, "complete-iteration": 0.27315417614507237, "set_robot_commands": 0.002550222395262452, "deviation-center-line": 2.5371177922208488, "driven_lanedir_consec": 27.703008560768232, "sim_compute_sim_state": 0.014192144837010217, "sim_compute_performance-ego0": 0.002336661682637109}}
set_robot_commands_max0.002550222395262452
set_robot_commands_mean0.002550222395262452
set_robot_commands_median0.002550222395262452
set_robot_commands_min0.002550222395262452
sim_compute_performance-ego0_max0.002336661682637109
sim_compute_performance-ego0_mean0.002336661682637109
sim_compute_performance-ego0_median0.002336661682637109
sim_compute_performance-ego0_min0.002336661682637109
sim_compute_sim_state_max0.014192144837010217
sim_compute_sim_state_mean0.014192144837010217
sim_compute_sim_state_median0.014192144837010217
sim_compute_sim_state_min0.014192144837010217
sim_render-ego0_max0.004241229691771445
sim_render-ego0_mean0.004241229691771445
sim_render-ego0_median0.004241229691771445
sim_render-ego0_min0.004241229691771445
simulation-passed1
step_physics_max0.1895806638525487
step_physics_mean0.1895806638525487
step_physics_median0.1895806638525487
step_physics_min0.1895806638525487
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6607513534András Kalapos 🇭🇺3090aido-LF-sim-testingsim-1of4failednogpu-production-spot-3-010:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 268, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1365, in _do_call
              ||     return fn(*args)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1349, in _run_fn
              ||     return self._call_tf_sessionrun(options, feed_dict, fetch_list,
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1441, in _call_tf_sessionrun
              ||     return tf_session.TF_SessionRun_wrapper(self._session, options, feed_dict,
              || tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found.
              ||   (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || 	 [[{{node default_policy/functional_1_1/conv_value_1/Relu}}]]
              || 	 [[default_policy/strided_slice_1/_3]]
              ||   (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || 	 [[{{node default_policy/functional_1_1/conv_value_1/Relu}}]]
              || 0 successful operations.
              || 0 derived errors ignored.
              ||
              || During handling of the above exception, another exception occurred:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 29, in init
              ||     self.model = RLlibModel(SEED,experiment_idx=0,checkpoint_idx=0,logger=context)
              ||   File "/submission/model.py", line 55, in __init__
              ||     self.model = PPOTrainer(config=config["rllib_config"])
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 90, in __init__
              ||     Trainer.__init__(self, config, env, logger_creator)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 455, in __init__
              ||     super().__init__(config, logger_creator)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/tune/trainable.py", line 174, in __init__
              ||     self._setup(copy.deepcopy(self.config))
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 596, in _setup
              ||     self._init(self.config, self.env_creator)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 115, in _init
              ||     self.workers = self._make_workers(env_creator, self._policy,
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 662, in _make_workers
              ||     return WorkerSet(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 61, in __init__
              ||     self._local_worker = self._make_worker(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 237, in _make_worker
              ||     worker = cls(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 360, in __init__
              ||     self._build_policy_map(policy_dict, policy_config)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 842, in _build_policy_map
              ||     policy_map[name] = cls(obs_space, act_space, merged_conf)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 129, in __init__
              ||     DynamicTFPolicy.__init__(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 237, in __init__
              ||     self._initialize_loss()
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 324, in _initialize_loss
              ||     postprocessed_batch = self.postprocess_trajectory(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 155, in postprocess_trajectory
              ||     return postprocess_fn(self, sample_batch, other_agent_batches,
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/ppo/ppo_tf_policy.py", line 182, in postprocess_ppo_gae
              ||     last_r = policy._value(sample_batch[SampleBatch.NEXT_OBS][-1],
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/utils/tf_ops.py", line 86, in call
              ||     return session_or_none.run(symbolic_out[0], feed_dict)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 957, in run
              ||     result = self._run(None, fetches, feed_dict, options_ptr,
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1180, in _run
              ||     results = self._do_run(handle, final_targets, final_fetches,
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1358, in _do_run
              ||     return self._do_call(_run_fn, feeds, fetches, targets, options,
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1384, in _do_call
              ||     raise type(e)(node_def, op, message)
              || tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found.
              ||   (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || 	 [[node default_policy/functional_1_1/conv_value_1/Relu (defined at /usr/local/lib/python3.8/dist-packages/ray/rllib/models/tf/visionnet_v2.py:103) ]]
              || 	 [[default_policy/strided_slice_1/_3]]
              ||   (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || 	 [[node default_policy/functional_1_1/conv_value_1/Relu (defined at /usr/local/lib/python3.8/dist-packages/ray/rllib/models/tf/visionnet_v2.py:103) ]]
              || 0 successful operations.
              || 0 derived errors ignored.
              ||
              || Original stack trace for 'default_policy/functional_1_1/conv_value_1/Relu':
              ||   File "solution.py", line 126, in <module>
              ||     main()
              ||   File "solution.py", line 122, in main
              ||     wrap_direct(node=node, protocol=protocol)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/interface.py", line 24, in wrap_direct
              ||     run_loop(node, protocol, args)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 243, in run_loop
              ||     loop(node_name, fi, fo, node, protocol, tin, tout, config=config, fi_desc=fin, fo_desc=fout)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 29, in init
              ||     self.model = RLlibModel(SEED,experiment_idx=0,checkpoint_idx=0,logger=context)
              ||   File "/submission/model.py", line 55, in __init__
              ||     self.model = PPOTrainer(config=config["rllib_config"])
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 90, in __init__
              ||     Trainer.__init__(self, config, env, logger_creator)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 455, in __init__
              ||     super().__init__(config, logger_creator)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/tune/trainable.py", line 174, in __init__
              ||     self._setup(copy.deepcopy(self.config))
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 596, in _setup
              ||     self._init(self.config, self.env_creator)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 115, in _init
              ||     self.workers = self._make_workers(env_creator, self._policy,
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 662, in _make_workers
              ||     return WorkerSet(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 61, in __init__
              ||     self._local_worker = self._make_worker(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 237, in _make_worker
              ||     worker = cls(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 360, in __init__
              ||     self._build_policy_map(policy_dict, policy_config)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 842, in _build_policy_map
              ||     policy_map[name] = cls(obs_space, act_space, merged_conf)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 129, in __init__
              ||     DynamicTFPolicy.__init__(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 237, in __init__
              ||     self._initialize_loss()
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 324, in _initialize_loss
              ||     postprocessed_batch = self.postprocess_trajectory(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 155, in postprocess_trajectory
              ||     return postprocess_fn(self, sample_batch, other_agent_batches,
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/ppo/ppo_tf_policy.py", line 182, in postprocess_ppo_gae
              ||     last_r = policy._value(sample_batch[SampleBatch.NEXT_OBS][-1],
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/utils/tf_ops.py", line 84, in call
              ||     symbolic_out[0] = fn(*placeholders)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/ppo/ppo_tf_policy.py", line 235, in value
              ||     model_out, _ = self.model({
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/models/modelv2.py", line 150, in __call__
              ||     res = self.forward(restored, state or [], seq_lens)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/models/tf/visionnet_v2.py", line 103, in forward
              ||     model_out, self._value_out = self.base_model(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_v1.py", line 776, in __call__
              ||     outputs = call_fn(cast_inputs, *args, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/functional.py", line 385, in call
              ||     return self._run_internal_graph(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/functional.py", line 508, in _run_internal_graph
              ||     outputs = node.layer(*args, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_v1.py", line 776, in __call__
              ||     outputs = call_fn(cast_inputs, *args, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/convolutional.py", line 269, in call
              ||     return self.activation(outputs)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_nn_ops.py", line 10435, in relu
              ||     _, _, _op, _outputs = _op_def_library._apply_op_helper(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/op_def_library.py", line 742, in _apply_op_helper
              ||     op = g._create_op_internal(op_type_name, inputs, dtypes=None,
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 3477, in _create_op_internal
              ||     ret = Operation(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 1949, in __init__
              ||     self._traceback = tf_stack.extract_stack()
              ||
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 339, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1365, in _do_call
              || |     return fn(*args)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1349, in _run_fn
              || |     return self._call_tf_sessionrun(options, feed_dict, fetch_list,
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1441, in _call_tf_sessionrun
              || |     return tf_session.TF_SessionRun_wrapper(self._session, options, feed_dict,
              || | tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found.
              || |   (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || | 	 [[{{node default_policy/functional_1_1/conv_value_1/Relu}}]]
              || | 	 [[default_policy/strided_slice_1/_3]]
              || |   (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || | 	 [[{{node default_policy/functional_1_1/conv_value_1/Relu}}]]
              || | 0 successful operations.
              || | 0 derived errors ignored.
              || |
              || | During handling of the above exception, another exception occurred:
              || |
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 29, in init
              || |     self.model = RLlibModel(SEED,experiment_idx=0,checkpoint_idx=0,logger=context)
              || |   File "/submission/model.py", line 55, in __init__
              || |     self.model = PPOTrainer(config=config["rllib_config"])
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 90, in __init__
              || |     Trainer.__init__(self, config, env, logger_creator)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 455, in __init__
              || |     super().__init__(config, logger_creator)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/tune/trainable.py", line 174, in __init__
              || |     self._setup(copy.deepcopy(self.config))
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 596, in _setup
              || |     self._init(self.config, self.env_creator)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 115, in _init
              || |     self.workers = self._make_workers(env_creator, self._policy,
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 662, in _make_workers
              || |     return WorkerSet(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 61, in __init__
              || |     self._local_worker = self._make_worker(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 237, in _make_worker
              || |     worker = cls(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 360, in __init__
              || |     self._build_policy_map(policy_dict, policy_config)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 842, in _build_policy_map
              || |     policy_map[name] = cls(obs_space, act_space, merged_conf)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 129, in __init__
              || |     DynamicTFPolicy.__init__(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 237, in __init__
              || |     self._initialize_loss()
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 324, in _initialize_loss
              || |     postprocessed_batch = self.postprocess_trajectory(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 155, in postprocess_trajectory
              || |     return postprocess_fn(self, sample_batch, other_agent_batches,
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/ppo/ppo_tf_policy.py", line 182, in postprocess_ppo_gae
              || |     last_r = policy._value(sample_batch[SampleBatch.NEXT_OBS][-1],
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/utils/tf_ops.py", line 86, in call
              || |     return session_or_none.run(symbolic_out[0], feed_dict)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 957, in run
              || |     result = self._run(None, fetches, feed_dict, options_ptr,
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1180, in _run
              || |     results = self._do_run(handle, final_targets, final_fetches,
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1358, in _do_run
              || |     return self._do_call(_run_fn, feeds, fetches, targets, options,
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1384, in _do_call
              || |     raise type(e)(node_def, op, message)
              || | tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found.
              || |   (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || | 	 [[node default_policy/functional_1_1/conv_value_1/Relu (defined at /usr/local/lib/python3.8/dist-packages/ray/rllib/models/tf/visionnet_v2.py:103) ]]
              || | 	 [[default_policy/strided_slice_1/_3]]
              || |   (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || | 	 [[node default_policy/functional_1_1/conv_value_1/Relu (defined at /usr/local/lib/python3.8/dist-packages/ray/rllib/models/tf/visionnet_v2.py:103) ]]
              || | 0 successful operations.
              || | 0 derived errors ignored.
              || |
              || | Original stack trace for 'default_policy/functional_1_1/conv_value_1/Relu':
              || |   File "solution.py", line 126, in <module>
              || |     main()
              || |   File "solution.py", line 122, in main
              || |     wrap_direct(node=node, protocol=protocol)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/interface.py", line 24, in wrap_direct
              || |     run_loop(node, protocol, args)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 243, in run_loop
              || |     loop(node_name, fi, fo, node, protocol, tin, tout, config=config, fi_desc=fin, fo_desc=fout)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 29, in init
              || |     self.model = RLlibModel(SEED,experiment_idx=0,checkpoint_idx=0,logger=context)
              || |   File "/submission/model.py", line 55, in __init__
              || |     self.model = PPOTrainer(config=config["rllib_config"])
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 90, in __init__
              || |     Trainer.__init__(self, config, env, logger_creator)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 455, in __init__
              || |     super().__init__(config, logger_creator)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/tune/trainable.py", line 174, in __init__
              || |     self._setup(copy.deepcopy(self.config))
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 596, in _setup
              || |     self._init(self.config, self.env_creator)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 115, in _init
              || |     self.workers = self._make_workers(env_creator, self._policy,
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 662, in _make_workers
              || |     return WorkerSet(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 61, in __init__
              || |     self._local_worker = self._make_worker(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 237, in _make_worker
              || |     worker = cls(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 360, in __init__
              || |     self._build_policy_map(policy_dict, policy_config)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 842, in _build_policy_map
              || |     policy_map[name] = cls(obs_space, act_space, merged_conf)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 129, in __init__
              || |     DynamicTFPolicy.__init__(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 237, in __init__
              || |     self._initialize_loss()
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 324, in _initialize_loss
              || |     postprocessed_batch = self.postprocess_trajectory(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 155, in postprocess_trajectory
              || |     return postprocess_fn(self, sample_batch, other_agent_batches,
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/ppo/ppo_tf_policy.py", line 182, in postprocess_ppo_gae
              || |     last_r = policy._value(sample_batch[SampleBatch.NEXT_OBS][-1],
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/utils/tf_ops.py", line 84, in call
              || |     symbolic_out[0] = fn(*placeholders)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/ppo/ppo_tf_policy.py", line 235, in value
              || |     model_out, _ = self.model({
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/models/modelv2.py", line 150, in __call__
              || |     res = self.forward(restored, state or [], seq_lens)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/models/tf/visionnet_v2.py", line 103, in forward
              || |     model_out, self._value_out = self.base_model(
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_v1.py", line 776, in __call__
              || |     outputs = call_fn(cast_inputs, *args, **kwargs)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/functional.py", line 385, in call
              || |     return self._run_internal_graph(
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/functional.py", line 508, in _run_internal_graph
              || |     outputs = node.layer(*args, **kwargs)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_v1.py", line 776, in __call__
              || |     outputs = call_fn(cast_inputs, *args, **kwargs)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/convolutional.py", line 269, in call
              || |     return self.activation(outputs)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_nn_ops.py", line 10435, in relu
              || |     _, _, _op, _outputs = _op_def_library._apply_op_helper(
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/op_def_library.py", line 742, in _apply_op_helper
              || |     op = g._create_op_internal(op_type_name, inputs, dtypes=None,
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 3477, in _create_op_internal
              || |     ret = Operation(
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 1949, in __init__
              || |     self._traceback = tf_stack.extract_stack()
              || |
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 275, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6607013572Márton Tim 🇭🇺3626aido-LFV-sim-validationsim-3of4failednogpu-production-spot-3-010:01:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 589, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 90, in on_received_get_commands
              ||     pwm_left, pwm_right = self.compute_action(self.current_image)
              ||   File "solution.py", line 84, in compute_action
              ||     action = self.model.predict(observation)
              ||   File "/submission/model.py", line 71, in predict
              ||     observation = wrapper.observation(observation)
              ||   File "/submission/duckietown_utils/wrappers/SegmentObsWrapper.py", line 56, in observation
              ||     _, pred = torch.max(self.model.forward(obs_prep), 1)
              ||   File "/submission/duckietown_utils/wrappers/my_models/tiramisu.py", line 145, in forward
              ||     x = self.featureExtractor(x)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/submission/duckietown_utils/wrappers/my_models/tiramisu.py", line 96, in forward
              ||     out = self.transDownBlocks[i](out)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/submission/duckietown_utils/wrappers/my_models/layers.py", line 55, in forward
              ||     return super().forward(x)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/container.py", line 117, in forward
              ||     input = module(input)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/conv.py", line 423, in forward
              ||     return self._conv_forward(input, self.weight)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/conv.py", line 419, in _conv_forward
              ||     return F.conv2d(input, weight, self.bias, self.stride,
              || RuntimeError: CUDA out of memory. Tried to allocate 20.00 MiB (GPU 0; 14.76 GiB total capacity; 100.10 MiB already allocated; 27.75 MiB free; 118.00 MiB reserved in total by PyTorch)
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 312, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 593, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6604613572Márton Tim 🇭🇺3626aido-LFV-sim-validationsim-3of4successnogpu-production-spot-3-010:04:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.649999999999981
in-drivable-lane_median0.09999999999999964
driven_lanedir_consec_median3.0161225461064096
deviation-center-line_median0.61470527381291


other stats
agent_compute-ego0_max0.048033561025347025
agent_compute-ego0_mean0.048033561025347025
agent_compute-ego0_median0.048033561025347025
agent_compute-ego0_min0.048033561025347025
agent_compute-npc0_max0.04373133492160153
agent_compute-npc0_mean0.04373133492160153
agent_compute-npc0_median0.04373133492160153
agent_compute-npc0_min0.04373133492160153
agent_compute-npc1_max0.044529049427478345
agent_compute-npc1_mean0.044529049427478345
agent_compute-npc1_median0.044529049427478345
agent_compute-npc1_min0.044529049427478345
agent_compute-npc2_max0.0442297210941067
agent_compute-npc2_mean0.0442297210941067
agent_compute-npc2_median0.0442297210941067
agent_compute-npc2_min0.0442297210941067
agent_compute-npc3_max0.0449032752544849
agent_compute-npc3_mean0.0449032752544849
agent_compute-npc3_median0.0449032752544849
agent_compute-npc3_min0.0449032752544849
complete-iteration_max0.8818483693259103
complete-iteration_mean0.8818483693259103
complete-iteration_median0.8818483693259103
complete-iteration_min0.8818483693259103
deviation-center-line_max0.61470527381291
deviation-center-line_mean0.61470527381291
deviation-center-line_min0.61470527381291
deviation-heading_max2.0136355108793818
deviation-heading_mean2.0136355108793818
deviation-heading_median2.0136355108793818
deviation-heading_min2.0136355108793818
driven_any_max3.2167934226966253
driven_any_mean3.2167934226966253
driven_any_median3.2167934226966253
driven_any_min3.2167934226966253
driven_lanedir_consec_max3.0161225461064096
driven_lanedir_consec_mean3.0161225461064096
driven_lanedir_consec_min3.0161225461064096
driven_lanedir_max3.0161225461064096
driven_lanedir_mean3.0161225461064096
driven_lanedir_median3.0161225461064096
driven_lanedir_min3.0161225461064096
get_duckie_state_max1.6983453329507407e-06
get_duckie_state_mean1.6983453329507407e-06
get_duckie_state_median1.6983453329507407e-06
get_duckie_state_min1.6983453329507407e-06
get_robot_state_max0.0193974460874285
get_robot_state_mean0.0193974460874285
get_robot_state_median0.0193974460874285
get_robot_state_min0.0193974460874285
get_state_dump_max0.01201184539051799
get_state_dump_mean0.01201184539051799
get_state_dump_median0.01201184539051799
get_state_dump_min0.01201184539051799
get_ui_image_max0.05763390002312598
get_ui_image_mean0.05763390002312598
get_ui_image_median0.05763390002312598
get_ui_image_min0.05763390002312598
in-drivable-lane_max0.09999999999999964
in-drivable-lane_mean0.09999999999999964
in-drivable-lane_min0.09999999999999964
per-episodes
details{"LFV-norm-techtrack-000-ego0": {"driven_any": 3.2167934226966253, "get_ui_image": 0.05763390002312598, "step_physics": 0.46037268174159063, "survival_time": 7.649999999999981, "driven_lanedir": 3.0161225461064096, "get_state_dump": 0.01201184539051799, "get_robot_state": 0.0193974460874285, "sim_render-ego0": 0.004146719907785391, "sim_render-npc0": 0.004247670049791212, "sim_render-npc1": 0.004316853238390638, "sim_render-npc2": 0.004344497408185687, "sim_render-npc3": 0.004298697818409313, "get_duckie_state": 1.6983453329507407e-06, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 2.0136355108793818, "agent_compute-ego0": 0.048033561025347025, "agent_compute-npc0": 0.04373133492160153, "agent_compute-npc1": 0.044529049427478345, "agent_compute-npc2": 0.0442297210941067, "agent_compute-npc3": 0.0449032752544849, "complete-iteration": 0.8818483693259103, "set_robot_commands": 0.0026837835064182033, "deviation-center-line": 0.61470527381291, "driven_lanedir_consec": 3.0161225461064096, "sim_compute_sim_state": 0.06048869777035404, "sim_compute_performance-ego0": 0.002248791905192586, "sim_compute_performance-npc0": 0.0022933483123779297, "sim_compute_performance-npc1": 0.0023294176374162945, "sim_compute_performance-npc2": 0.0024008812842431005, "sim_compute_performance-npc3": 0.002361189235340465}}
set_robot_commands_max0.0026837835064182033
set_robot_commands_mean0.0026837835064182033
set_robot_commands_median0.0026837835064182033
set_robot_commands_min0.0026837835064182033
sim_compute_performance-ego0_max0.002248791905192586
sim_compute_performance-ego0_mean0.002248791905192586
sim_compute_performance-ego0_median0.002248791905192586
sim_compute_performance-ego0_min0.002248791905192586
sim_compute_performance-npc0_max0.0022933483123779297
sim_compute_performance-npc0_mean0.0022933483123779297
sim_compute_performance-npc0_median0.0022933483123779297
sim_compute_performance-npc0_min0.0022933483123779297
sim_compute_performance-npc1_max0.0023294176374162945
sim_compute_performance-npc1_mean0.0023294176374162945
sim_compute_performance-npc1_median0.0023294176374162945
sim_compute_performance-npc1_min0.0023294176374162945
sim_compute_performance-npc2_max0.0024008812842431005
sim_compute_performance-npc2_mean0.0024008812842431005
sim_compute_performance-npc2_median0.0024008812842431005
sim_compute_performance-npc2_min0.0024008812842431005
sim_compute_performance-npc3_max0.002361189235340465
sim_compute_performance-npc3_mean0.002361189235340465
sim_compute_performance-npc3_median0.002361189235340465
sim_compute_performance-npc3_min0.002361189235340465
sim_compute_sim_state_max0.06048869777035404
sim_compute_sim_state_mean0.06048869777035404
sim_compute_sim_state_median0.06048869777035404
sim_compute_sim_state_min0.06048869777035404
sim_render-ego0_max0.004146719907785391
sim_render-ego0_mean0.004146719907785391
sim_render-ego0_median0.004146719907785391
sim_render-ego0_min0.004146719907785391
sim_render-npc0_max0.004247670049791212
sim_render-npc0_mean0.004247670049791212
sim_render-npc0_median0.004247670049791212
sim_render-npc0_min0.004247670049791212
sim_render-npc1_max0.004316853238390638
sim_render-npc1_mean0.004316853238390638
sim_render-npc1_median0.004316853238390638
sim_render-npc1_min0.004316853238390638
sim_render-npc2_max0.004344497408185687
sim_render-npc2_mean0.004344497408185687
sim_render-npc2_median0.004344497408185687
sim_render-npc2_min0.004344497408185687
sim_render-npc3_max0.004298697818409313
sim_render-npc3_mean0.004298697818409313
sim_render-npc3_median0.004298697818409313
sim_render-npc3_min0.004298697818409313
simulation-passed1
step_physics_max0.46037268174159063
step_physics_mean0.46037268174159063
step_physics_median0.46037268174159063
step_physics_min0.46037268174159063
survival_time_max7.649999999999981
survival_time_mean7.649999999999981
survival_time_min7.649999999999981
No reset possible
6604313585Andras Beres202-1aido-LFP-sim-testingsim-1of4successnogpu-production-spot-3-010:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.399999999999996
in-drivable-lane_median0.04999999999999982
driven_lanedir_consec_median1.0219284228948626
deviation-center-line_median0.27282646356978324


other stats
agent_compute-ego0_max0.018442907195160355
agent_compute-ego0_mean0.018442907195160355
agent_compute-ego0_median0.018442907195160355
agent_compute-ego0_min0.018442907195160355
complete-iteration_max0.21293368201324905
complete-iteration_mean0.21293368201324905
complete-iteration_median0.21293368201324905
complete-iteration_min0.21293368201324905
deviation-center-line_max0.27282646356978324
deviation-center-line_mean0.27282646356978324
deviation-center-line_min0.27282646356978324
deviation-heading_max0.7949776221221727
deviation-heading_mean0.7949776221221727
deviation-heading_median0.7949776221221727
deviation-heading_min0.7949776221221727
driven_any_max1.0756985682170948
driven_any_mean1.0756985682170948
driven_any_median1.0756985682170948
driven_any_min1.0756985682170948
driven_lanedir_consec_max1.0219284228948626
driven_lanedir_consec_mean1.0219284228948626
driven_lanedir_consec_min1.0219284228948626
driven_lanedir_max1.0219284228948626
driven_lanedir_mean1.0219284228948626
driven_lanedir_median1.0219284228948626
driven_lanedir_min1.0219284228948626
get_duckie_state_max0.004988535590793776
get_duckie_state_mean0.004988535590793776
get_duckie_state_median0.004988535590793776
get_duckie_state_min0.004988535590793776
get_robot_state_max0.00448627057282821
get_robot_state_mean0.00448627057282821
get_robot_state_median0.00448627057282821
get_robot_state_min0.00448627057282821
get_state_dump_max0.006674130757649739
get_state_dump_mean0.006674130757649739
get_state_dump_median0.006674130757649739
get_state_dump_min0.006674130757649739
get_ui_image_max0.028944291930267776
get_ui_image_mean0.028944291930267776
get_ui_image_median0.028944291930267776
get_ui_image_min0.028944291930267776
in-drivable-lane_max0.04999999999999982
in-drivable-lane_mean0.04999999999999982
in-drivable-lane_min0.04999999999999982
per-episodes
details{"LFP-norm-small_loop-000-ego0": {"driven_any": 1.0756985682170948, "get_ui_image": 0.028944291930267776, "step_physics": 0.13353577904079272, "survival_time": 3.399999999999996, "driven_lanedir": 1.0219284228948626, "get_state_dump": 0.006674130757649739, "get_robot_state": 0.00448627057282821, "sim_render-ego0": 0.004361028256623641, "get_duckie_state": 0.004988535590793776, "in-drivable-lane": 0.04999999999999982, "deviation-heading": 0.7949776221221727, "agent_compute-ego0": 0.018442907195160355, "complete-iteration": 0.21293368201324905, "set_robot_commands": 0.0026821779168170433, "deviation-center-line": 0.27282646356978324, "driven_lanedir_consec": 1.0219284228948626, "sim_compute_sim_state": 0.006402357764866041, "sim_compute_performance-ego0": 0.0023167375205219655}}
set_robot_commands_max0.0026821779168170433
set_robot_commands_mean0.0026821779168170433
set_robot_commands_median0.0026821779168170433
set_robot_commands_min0.0026821779168170433
sim_compute_performance-ego0_max0.0023167375205219655
sim_compute_performance-ego0_mean0.0023167375205219655
sim_compute_performance-ego0_median0.0023167375205219655
sim_compute_performance-ego0_min0.0023167375205219655
sim_compute_sim_state_max0.006402357764866041
sim_compute_sim_state_mean0.006402357764866041
sim_compute_sim_state_median0.006402357764866041
sim_compute_sim_state_min0.006402357764866041
sim_render-ego0_max0.004361028256623641
sim_render-ego0_mean0.004361028256623641
sim_render-ego0_median0.004361028256623641
sim_render-ego0_min0.004361028256623641
simulation-passed1
step_physics_max0.13353577904079272
step_physics_mean0.13353577904079272
step_physics_median0.13353577904079272
step_physics_min0.13353577904079272
survival_time_max3.399999999999996
survival_time_mean3.399999999999996
survival_time_min3.399999999999996
No reset possible
6604113585Andras Beres202-1aido-LFP-sim-testingsim-1of4successnogpu-production-spot-3-010:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.399999999999996
in-drivable-lane_median0.0
driven_lanedir_consec_median1.0391680149273512
deviation-center-line_median0.26951316236511963


other stats
agent_compute-ego0_max0.01889540838158649
agent_compute-ego0_mean0.01889540838158649
agent_compute-ego0_median0.01889540838158649
agent_compute-ego0_min0.01889540838158649
complete-iteration_max0.20486870019332223
complete-iteration_mean0.20486870019332223
complete-iteration_median0.20486870019332223
complete-iteration_min0.20486870019332223
deviation-center-line_max0.26951316236511963
deviation-center-line_mean0.26951316236511963
deviation-center-line_min0.26951316236511963
deviation-heading_max0.8333188815240385
deviation-heading_mean0.8333188815240385
deviation-heading_median0.8333188815240385
deviation-heading_min0.8333188815240385
driven_any_max1.077793591345877
driven_any_mean1.077793591345877
driven_any_median1.077793591345877
driven_any_min1.077793591345877
driven_lanedir_consec_max1.0391680149273512
driven_lanedir_consec_mean1.0391680149273512
driven_lanedir_consec_min1.0391680149273512
driven_lanedir_max1.0391680149273512
driven_lanedir_mean1.0391680149273512
driven_lanedir_median1.0391680149273512
driven_lanedir_min1.0391680149273512
get_duckie_state_max0.004592183707416922
get_duckie_state_mean0.004592183707416922
get_duckie_state_median0.004592183707416922
get_duckie_state_min0.004592183707416922
get_robot_state_max0.003995228504789048
get_robot_state_mean0.003995228504789048
get_robot_state_median0.003995228504789048
get_robot_state_min0.003995228504789048
get_state_dump_max0.00586611637170764
get_state_dump_mean0.00586611637170764
get_state_dump_median0.00586611637170764
get_state_dump_min0.00586611637170764
get_ui_image_max0.029459549033123512
get_ui_image_mean0.029459549033123512
get_ui_image_median0.029459549033123512
get_ui_image_min0.029459549033123512
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-small_loop-000-ego0": {"driven_any": 1.077793591345877, "get_ui_image": 0.029459549033123512, "step_physics": 0.12665493246437848, "survival_time": 3.399999999999996, "driven_lanedir": 1.0391680149273512, "get_state_dump": 0.00586611637170764, "get_robot_state": 0.003995228504789048, "sim_render-ego0": 0.004124161125957102, "get_duckie_state": 0.004592183707416922, "in-drivable-lane": 0.0, "deviation-heading": 0.8333188815240385, "agent_compute-ego0": 0.01889540838158649, "complete-iteration": 0.20486870019332223, "set_robot_commands": 0.0025597724361696105, "deviation-center-line": 0.26951316236511963, "driven_lanedir_consec": 1.0391680149273512, "sim_compute_sim_state": 0.006430781405905019, "sim_compute_performance-ego0": 0.002193019010018611}}
set_robot_commands_max0.0025597724361696105
set_robot_commands_mean0.0025597724361696105
set_robot_commands_median0.0025597724361696105
set_robot_commands_min0.0025597724361696105
sim_compute_performance-ego0_max0.002193019010018611
sim_compute_performance-ego0_mean0.002193019010018611
sim_compute_performance-ego0_median0.002193019010018611
sim_compute_performance-ego0_min0.002193019010018611
sim_compute_sim_state_max0.006430781405905019
sim_compute_sim_state_mean0.006430781405905019
sim_compute_sim_state_median0.006430781405905019
sim_compute_sim_state_min0.006430781405905019
sim_render-ego0_max0.004124161125957102
sim_render-ego0_mean0.004124161125957102
sim_render-ego0_median0.004124161125957102
sim_render-ego0_min0.004124161125957102
simulation-passed1
step_physics_max0.12665493246437848
step_physics_mean0.12665493246437848
step_physics_median0.12665493246437848
step_physics_min0.12665493246437848
survival_time_max3.399999999999996
survival_time_mean3.399999999999996
survival_time_min3.399999999999996
No reset possible
6603313964YU CHENCBC Net v2 test - APR 3 BC TFdata + mar 28 anomalyaido-LF-sim-validationsim-1of4successnogpu-production-spot-3-010:05:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.563828589941284
survival_time_median25.05000000000022
deviation-center-line_median1.055419224585311
in-drivable-lane_median12.0000000000001


other stats
agent_compute-ego0_max0.09492162736763517
agent_compute-ego0_mean0.09492162736763517
agent_compute-ego0_median0.09492162736763517
agent_compute-ego0_min0.09492162736763517
complete-iteration_max0.32217970644810284
complete-iteration_mean0.32217970644810284
complete-iteration_median0.32217970644810284
complete-iteration_min0.32217970644810284
deviation-center-line_max1.055419224585311
deviation-center-line_mean1.055419224585311
deviation-center-line_min1.055419224585311
deviation-heading_max3.695525362968006
deviation-heading_mean3.695525362968006
deviation-heading_median3.695525362968006
deviation-heading_min3.695525362968006
driven_any_max8.83774614006461
driven_any_mean8.83774614006461
driven_any_median8.83774614006461
driven_any_min8.83774614006461
driven_lanedir_consec_max4.563828589941284
driven_lanedir_consec_mean4.563828589941284
driven_lanedir_consec_min4.563828589941284
driven_lanedir_max4.563828589941284
driven_lanedir_mean4.563828589941284
driven_lanedir_median4.563828589941284
driven_lanedir_min4.563828589941284
get_duckie_state_max1.373044048172544e-06
get_duckie_state_mean1.373044048172544e-06
get_duckie_state_median1.373044048172544e-06
get_duckie_state_min1.373044048172544e-06
get_robot_state_max0.0041021450582253505
get_robot_state_mean0.0041021450582253505
get_robot_state_median0.0041021450582253505
get_robot_state_min0.0041021450582253505
get_state_dump_max0.005010439580180256
get_state_dump_mean0.005010439580180256
get_state_dump_median0.005010439580180256
get_state_dump_min0.005010439580180256
get_ui_image_max0.03669246686882232
get_ui_image_mean0.03669246686882232
get_ui_image_median0.03669246686882232
get_ui_image_min0.03669246686882232
in-drivable-lane_max12.0000000000001
in-drivable-lane_mean12.0000000000001
in-drivable-lane_min12.0000000000001
per-episodes
details{"LF-norm-techtrack-000-ego0": {"driven_any": 8.83774614006461, "get_ui_image": 0.03669246686882232, "step_physics": 0.15814942145252608, "survival_time": 25.05000000000022, "driven_lanedir": 4.563828589941284, "get_state_dump": 0.005010439580180256, "get_robot_state": 0.0041021450582253505, "sim_render-ego0": 0.0042183684162884596, "get_duckie_state": 1.373044048172544e-06, "in-drivable-lane": 12.0000000000001, "deviation-heading": 3.695525362968006, "agent_compute-ego0": 0.09492162736763517, "complete-iteration": 0.32217970644810284, "set_robot_commands": 0.0025907811890560316, "deviation-center-line": 1.055419224585311, "driven_lanedir_consec": 4.563828589941284, "sim_compute_sim_state": 0.014166509962651834, "sim_compute_performance-ego0": 0.002236918624178822}}
set_robot_commands_max0.0025907811890560316
set_robot_commands_mean0.0025907811890560316
set_robot_commands_median0.0025907811890560316
set_robot_commands_min0.0025907811890560316
sim_compute_performance-ego0_max0.002236918624178822
sim_compute_performance-ego0_mean0.002236918624178822
sim_compute_performance-ego0_median0.002236918624178822
sim_compute_performance-ego0_min0.002236918624178822
sim_compute_sim_state_max0.014166509962651834
sim_compute_sim_state_mean0.014166509962651834
sim_compute_sim_state_median0.014166509962651834
sim_compute_sim_state_min0.014166509962651834
sim_render-ego0_max0.0042183684162884596
sim_render-ego0_mean0.0042183684162884596
sim_render-ego0_median0.0042183684162884596
sim_render-ego0_min0.0042183684162884596
simulation-passed1
step_physics_max0.15814942145252608
step_physics_mean0.15814942145252608
step_physics_median0.15814942145252608
step_physics_min0.15814942145252608
survival_time_max25.05000000000022
survival_time_mean25.05000000000022
survival_time_min25.05000000000022
No reset possible
6600813993Frank (Chude) Qian 🇨🇦CBC Net - MixTraining - Expert LF Human LFP - Best Lossaido-LF-sim-validationsim-2of4successnogpu-production-spot-3-010:06:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.838676142735125
survival_time_median33.500000000000234
deviation-center-line_median1.7013645670599975
in-drivable-lane_median11.050000000000011


other stats
agent_compute-ego0_max0.055193004238623264
agent_compute-ego0_mean0.055193004238623264
agent_compute-ego0_median0.055193004238623264
agent_compute-ego0_min0.055193004238623264
complete-iteration_max0.23677970115900396
complete-iteration_mean0.23677970115900396
complete-iteration_median0.23677970115900396
complete-iteration_min0.23677970115900396
deviation-center-line_max1.7013645670599975
deviation-center-line_mean1.7013645670599975
deviation-center-line_min1.7013645670599975
deviation-heading_max10.035980397395644
deviation-heading_mean10.035980397395644
deviation-heading_median10.035980397395644
deviation-heading_min10.035980397395644
driven_any_max15.901691827377654
driven_any_mean15.901691827377654
driven_any_median15.901691827377654
driven_any_min15.901691827377654
driven_lanedir_consec_max9.838676142735125
driven_lanedir_consec_mean9.838676142735125
driven_lanedir_consec_min9.838676142735125
driven_lanedir_max9.838676142735125
driven_lanedir_mean9.838676142735125
driven_lanedir_median9.838676142735125
driven_lanedir_min9.838676142735125
get_duckie_state_max1.4027966472324423e-06
get_duckie_state_mean1.4027966472324423e-06
get_duckie_state_median1.4027966472324423e-06
get_duckie_state_min1.4027966472324423e-06
get_robot_state_max0.003951844799536352
get_robot_state_mean0.003951844799536352
get_robot_state_median0.003951844799536352
get_robot_state_min0.003951844799536352
get_state_dump_max0.004836684012377493
get_state_dump_mean0.004836684012377493
get_state_dump_median0.004836684012377493
get_state_dump_min0.004836684012377493
get_ui_image_max0.027827208159399815
get_ui_image_mean0.027827208159399815
get_ui_image_median0.027827208159399815
get_ui_image_min0.027827208159399815
in-drivable-lane_max11.050000000000011
in-drivable-lane_mean11.050000000000011
in-drivable-lane_min11.050000000000011
per-episodes
details{"LF-norm-small_loop-000-ego0": {"driven_any": 15.901691827377654, "get_ui_image": 0.027827208159399815, "step_physics": 0.12992312655896615, "survival_time": 33.500000000000234, "driven_lanedir": 9.838676142735125, "get_state_dump": 0.004836684012377493, "get_robot_state": 0.003951844799536352, "sim_render-ego0": 0.004019530093083616, "get_duckie_state": 1.4027966472324423e-06, "in-drivable-lane": 11.050000000000011, "deviation-heading": 10.035980397395644, "agent_compute-ego0": 0.055193004238623264, "complete-iteration": 0.23677970115900396, "set_robot_commands": 0.0025053329865729933, "deviation-center-line": 1.7013645670599975, "driven_lanedir_consec": 9.838676142735125, "sim_compute_sim_state": 0.006307540458645088, "sim_compute_performance-ego0": 0.002124477960668982}}
set_robot_commands_max0.0025053329865729933
set_robot_commands_mean0.0025053329865729933
set_robot_commands_median0.0025053329865729933
set_robot_commands_min0.0025053329865729933
sim_compute_performance-ego0_max0.002124477960668982
sim_compute_performance-ego0_mean0.002124477960668982
sim_compute_performance-ego0_median0.002124477960668982
sim_compute_performance-ego0_min0.002124477960668982
sim_compute_sim_state_max0.006307540458645088
sim_compute_sim_state_mean0.006307540458645088
sim_compute_sim_state_median0.006307540458645088
sim_compute_sim_state_min0.006307540458645088
sim_render-ego0_max0.004019530093083616
sim_render-ego0_mean0.004019530093083616
sim_render-ego0_median0.004019530093083616
sim_render-ego0_min0.004019530093083616
simulation-passed1
step_physics_max0.12992312655896615
step_physics_mean0.12992312655896615
step_physics_median0.12992312655896615
step_physics_min0.12992312655896615
survival_time_max33.500000000000234
survival_time_mean33.500000000000234
survival_time_min33.500000000000234
No reset possible
6588513564Márton Tim 🇭🇺3626aido-LF-sim-validationsim-1of4successnogpu-production-spot-3-010:22:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median25.385482315111368
survival_time_median59.99999999999873
deviation-center-line_median3.696408735522395
in-drivable-lane_median3.6999999999999513


other stats
agent_compute-ego0_max0.04676358785160773
agent_compute-ego0_mean0.04676358785160773
agent_compute-ego0_median0.04676358785160773
agent_compute-ego0_min0.04676358785160773
complete-iteration_max0.30690595966691675
complete-iteration_mean0.30690595966691675
complete-iteration_median0.30690595966691675
complete-iteration_min0.30690595966691675
deviation-center-line_max3.696408735522395
deviation-center-line_mean3.696408735522395
deviation-center-line_min3.696408735522395
deviation-heading_max13.908692065422294
deviation-heading_mean13.908692065422294
deviation-heading_median13.908692065422294
deviation-heading_min13.908692065422294
driven_any_max28.307903428358724
driven_any_mean28.307903428358724
driven_any_median28.307903428358724
driven_any_min28.307903428358724
driven_lanedir_consec_max25.385482315111368
driven_lanedir_consec_mean25.385482315111368
driven_lanedir_consec_min25.385482315111368
driven_lanedir_max25.385482315111368
driven_lanedir_mean25.385482315111368
driven_lanedir_median25.385482315111368
driven_lanedir_min25.385482315111368
get_duckie_state_max2.0939543483457794e-06
get_duckie_state_mean2.0939543483457794e-06
get_duckie_state_median2.0939543483457794e-06
get_duckie_state_min2.0939543483457794e-06
get_robot_state_max0.004128590511541184
get_robot_state_mean0.004128590511541184
get_robot_state_median0.004128590511541184
get_robot_state_min0.004128590511541184
get_state_dump_max0.005047280425136036
get_state_dump_mean0.005047280425136036
get_state_dump_median0.005047280425136036
get_state_dump_min0.005047280425136036
get_ui_image_max0.0360791315941092
get_ui_image_mean0.0360791315941092
get_ui_image_median0.0360791315941092
get_ui_image_min0.0360791315941092
in-drivable-lane_max3.6999999999999513
in-drivable-lane_mean3.6999999999999513
in-drivable-lane_min3.6999999999999513
per-episodes
details{"LF-norm-techtrack-000-ego0": {"driven_any": 28.307903428358724, "get_ui_image": 0.0360791315941092, "step_physics": 0.19154771102854456, "survival_time": 59.99999999999873, "driven_lanedir": 25.385482315111368, "get_state_dump": 0.005047280425136036, "get_robot_state": 0.004128590511541184, "sim_render-ego0": 0.0042632674297424875, "get_duckie_state": 2.0939543483457794e-06, "in-drivable-lane": 3.6999999999999513, "deviation-heading": 13.908692065422294, "agent_compute-ego0": 0.04676358785160773, "complete-iteration": 0.30690595966691675, "set_robot_commands": 0.002632218336284806, "deviation-center-line": 3.696408735522395, "driven_lanedir_consec": 25.385482315111368, "sim_compute_sim_state": 0.014046152465845722, "sim_compute_performance-ego0": 0.002307021349891834}}
set_robot_commands_max0.002632218336284806
set_robot_commands_mean0.002632218336284806
set_robot_commands_median0.002632218336284806
set_robot_commands_min0.002632218336284806
sim_compute_performance-ego0_max0.002307021349891834
sim_compute_performance-ego0_mean0.002307021349891834
sim_compute_performance-ego0_median0.002307021349891834
sim_compute_performance-ego0_min0.002307021349891834
sim_compute_sim_state_max0.014046152465845722
sim_compute_sim_state_mean0.014046152465845722
sim_compute_sim_state_median0.014046152465845722
sim_compute_sim_state_min0.014046152465845722
sim_render-ego0_max0.0042632674297424875
sim_render-ego0_mean0.0042632674297424875
sim_render-ego0_median0.0042632674297424875
sim_render-ego0_min0.0042632674297424875
simulation-passed1
step_physics_max0.19154771102854456
step_physics_mean0.19154771102854456
step_physics_median0.19154771102854456
step_physics_min0.19154771102854456
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible