Duckietown Challenges Home Challenges Submissions

Evaluator 4860

ID4860
evaluatornogpu-prod-07
ownerI don't have one 😀
machinenogpu-prod_662c5fe9894d
processnogpu-prod-07_662c5fe9894d
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success16 53961
# timeout1 57521
# failed9 54667
# error1 53932
# aborted
# host-error33 54631
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5752110904Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutyesnogpu-prod-07----No reset possible
5749511426Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-testingLFP-simhost-erroryesnogpu-prod-070:04:27
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5744411313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-070:02:26
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5739410937Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:09:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.40601344496691794
survival_time_median14.250000000000068
deviation-center-line_median0.23265837341402928
in-drivable-lane_median11.750000000000052


other stats
agent_compute-ego0_max0.012897633958136898
agent_compute-ego0_mean0.01235289076202642
agent_compute-ego0_median0.012288207869264172
agent_compute-ego0_min0.011937513351440427
complete-iteration_max0.2273728902312531
complete-iteration_mean0.17509278473205717
complete-iteration_median0.16022201494173816
complete-iteration_min0.15255421881349931
deviation-center-line_max0.6167974319904138
deviation-center-line_mean0.29574482273908137
deviation-center-line_min0.10086511213785292
deviation-heading_max3.189141788998328
deviation-heading_mean1.52450913385101
deviation-heading_median1.1746536519710118
deviation-heading_min0.5595874424636882
driven_any_max5.326965564064293
driven_any_mean2.887280606992334
driven_any_median2.7693675108186433
driven_any_min0.683421842267755
driven_lanedir_consec_max1.048980079594361
driven_lanedir_consec_mean0.5275759931851943
driven_lanedir_consec_min0.24929700321258053
driven_lanedir_max1.048980079594361
driven_lanedir_mean0.5275759931851943
driven_lanedir_median0.40601344496691794
driven_lanedir_min0.24929700321258053
get_duckie_state_max1.4238357543945311e-06
get_duckie_state_mean1.3111260162912084e-06
get_duckie_state_median1.295429740922647e-06
get_duckie_state_min1.2298088289250088e-06
get_robot_state_max0.003628827029873866
get_robot_state_mean0.0035358048024134265
get_robot_state_median0.0035474942141565783
get_robot_state_min0.003419403751466683
get_state_dump_max0.004558755003887674
get_state_dump_mean0.004449652769634535
get_state_dump_median0.004431399487901009
get_state_dump_min0.004377057098848447
get_ui_image_max0.03467502539185272
get_ui_image_mean0.029235849266439674
get_ui_image_median0.02813373753894296
get_ui_image_min0.026000896596020052
in-drivable-lane_max20.100000000000176
in-drivable-lane_mean11.550000000000068
in-drivable-lane_min2.5999999999999917
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.3920281611030054, "get_ui_image": 0.027043901443481445, "step_physics": 0.08925051403045654, "survival_time": 12.450000000000042, "driven_lanedir": 0.5557930768646577, "get_state_dump": 0.004408517837524414, "get_robot_state": 0.003519827842712402, "sim_render-ego0": 0.003733363151550293, "get_duckie_state": 1.4238357543945311e-06, "in-drivable-lane": 9.100000000000012, "deviation-heading": 1.5806243135377462, "agent_compute-ego0": 0.011937513351440427, "complete-iteration": 0.1531226644515991, "set_robot_commands": 0.0020853967666625978, "deviation-center-line": 0.34470264053894073, "driven_lanedir_consec": 0.5557930768646577, "sim_compute_sim_state": 0.0091739559173584, "sim_compute_performance-ego0": 0.001885913848876953}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.683421842267755, "get_ui_image": 0.03467502539185272, "step_physics": 0.15360754385761832, "survival_time": 4.299999999999993, "driven_lanedir": 0.25623381306917814, "get_state_dump": 0.004454281138277602, "get_robot_state": 0.0035751605856007545, "sim_render-ego0": 0.0038056318787322648, "get_duckie_state": 1.2551230945806394e-06, "in-drivable-lane": 2.5999999999999917, "deviation-heading": 0.7686829904042772, "agent_compute-ego0": 0.012897633958136898, "complete-iteration": 0.2273728902312531, "set_robot_commands": 0.002173352515560457, "deviation-center-line": 0.12061410628911784, "driven_lanedir_consec": 0.25623381306917814, "sim_compute_sim_state": 0.010192449065460556, "sim_compute_performance-ego0": 0.0019052795980168485}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.326965564064293, "get_ui_image": 0.029223573634404473, "step_physics": 0.10013136621248923, "survival_time": 26.50000000000024, "driven_lanedir": 1.048980079594361, "get_state_dump": 0.004377057098848447, "get_robot_state": 0.003419403751466683, "sim_render-ego0": 0.003555798036679485, "get_duckie_state": 1.2298088289250088e-06, "in-drivable-lane": 20.100000000000176, "deviation-heading": 3.189141788998328, "agent_compute-ego0": 0.011959815429428877, "complete-iteration": 0.16732136543187717, "set_robot_commands": 0.001962134169095429, "deviation-center-line": 0.6167974319904138, "driven_lanedir_consec": 1.048980079594361, "sim_compute_sim_state": 0.010844916273645089, "sim_compute_performance-ego0": 0.0017670799334394954}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.1467068605342816, "get_ui_image": 0.026000896596020052, "step_physics": 0.09256209275737312, "survival_time": 16.050000000000093, "driven_lanedir": 0.24929700321258053, "get_state_dump": 0.004558755003887674, "get_robot_state": 0.003628827029873866, "sim_render-ego0": 0.003878414260674708, "get_duckie_state": 1.3357363872646543e-06, "in-drivable-lane": 14.400000000000093, "deviation-heading": 0.5595874424636882, "agent_compute-ego0": 0.01261660030909947, "complete-iteration": 0.15255421881349931, "set_robot_commands": 0.002187378658270984, "deviation-center-line": 0.10086511213785292, "driven_lanedir_consec": 0.24929700321258053, "sim_compute_sim_state": 0.00507621365304319, "sim_compute_performance-ego0": 0.0019602857021071155}}
set_robot_commands_max0.002187378658270984
set_robot_commands_mean0.0021020655273973673
set_robot_commands_median0.002129374641111527
set_robot_commands_min0.001962134169095429
sim_compute_performance-ego0_max0.0019602857021071155
sim_compute_performance-ego0_mean0.001879639770610103
sim_compute_performance-ego0_median0.0018955967234469007
sim_compute_performance-ego0_min0.0017670799334394954
sim_compute_sim_state_max0.010844916273645089
sim_compute_sim_state_mean0.008821883727376809
sim_compute_sim_state_median0.009683202491409476
sim_compute_sim_state_min0.00507621365304319
sim_render-ego0_max0.003878414260674708
sim_render-ego0_mean0.003743301831909187
sim_render-ego0_median0.0037694975151412783
sim_render-ego0_min0.003555798036679485
simulation-passed1
step_physics_max0.15360754385761832
step_physics_mean0.10888787921448433
step_physics_median0.09634672948493118
step_physics_min0.08925051403045654
survival_time_max26.50000000000024
survival_time_mean14.825000000000092
survival_time_min4.299999999999993
No reset possible
5728510967Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:23:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8368794545298
survival_time_median46.04999999999952
deviation-center-line_median1.2995865254315442
in-drivable-lane_median23.874999999999854


other stats
agent_compute-ego0_max0.012577181099732965
agent_compute-ego0_mean0.01231371085824685
agent_compute-ego0_median0.012343945875241014
agent_compute-ego0_min0.011989770582772412
complete-iteration_max0.23733915175710404
complete-iteration_mean0.1930119741099382
complete-iteration_median0.18831909596329943
complete-iteration_min0.15807055275604984
deviation-center-line_max2.020046918401504
deviation-center-line_mean1.175526020622776
deviation-center-line_min0.08288411322651167
deviation-heading_max13.140095874894836
deviation-heading_mean6.4833402399754645
deviation-heading_median5.994672611966602
deviation-heading_min0.8039198610738181
driven_any_max12.827441305671126
driven_any_mean7.824808090338662
driven_any_median9.07574198011844
driven_any_min0.32030709544664515
driven_lanedir_consec_max6.140333079141504
driven_lanedir_consec_mean2.995200633559376
driven_lanedir_consec_min0.16671054603639934
driven_lanedir_max6.153391161251218
driven_lanedir_mean3.259323055174291
driven_lanedir_median3.358595256704774
driven_lanedir_min0.16671054603639934
get_duckie_state_max1.2217561712902776e-06
get_duckie_state_mean1.1822147178115385e-06
get_duckie_state_median1.1811283917436706e-06
get_duckie_state_min1.1448459164685354e-06
get_robot_state_max0.003624590892999391
get_robot_state_mean0.0035421696841758015
get_robot_state_median0.0035610287314549174
get_robot_state_min0.00342203038079398
get_state_dump_max0.004693708375304891
get_state_dump_mean0.004443019054677054
get_state_dump_median0.004393071854342827
get_state_dump_min0.004292224134717669
get_ui_image_max0.033402485506875176
get_ui_image_mean0.029185315154361378
get_ui_image_median0.029380494958598066
get_ui_image_min0.024577785193374217
in-drivable-lane_max44.64999999999907
in-drivable-lane_mean23.449999999999697
in-drivable-lane_min1.3999999999999977
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.988894278043963, "get_ui_image": 0.027714213761163693, "step_physics": 0.11278313244510749, "survival_time": 59.99999999999873, "driven_lanedir": 3.2846344723478493, "get_state_dump": 0.004432469780101665, "get_robot_state": 0.0035655512400808976, "sim_render-ego0": 0.00379748804980174, "get_duckie_state": 1.2127386342476646e-06, "in-drivable-lane": 44.64999999999907, "deviation-heading": 7.040930229310931, "agent_compute-ego0": 0.012263086415845883, "complete-iteration": 0.17935771489520552, "set_robot_commands": 0.0021483703616457517, "deviation-center-line": 1.3058754984413543, "driven_lanedir_consec": 2.2412028679979015, "sim_compute_sim_state": 0.01059491191676614, "sim_compute_performance-ego0": 0.001971217615221263}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.32030709544664515, "get_ui_image": 0.033402485506875176, "step_physics": 0.16707286664417811, "survival_time": 2.7499999999999982, "driven_lanedir": 0.16671054603639934, "get_state_dump": 0.004292224134717669, "get_robot_state": 0.00342203038079398, "sim_render-ego0": 0.00388288072177342, "get_duckie_state": 1.1495181492396765e-06, "in-drivable-lane": 1.3999999999999977, "deviation-heading": 0.8039198610738181, "agent_compute-ego0": 0.012424805334636144, "complete-iteration": 0.23733915175710404, "set_robot_commands": 0.0022125584738595144, "deviation-center-line": 0.08288411322651167, "driven_lanedir_consec": 0.16671054603639934, "sim_compute_sim_state": 0.008600256272724696, "sim_compute_performance-ego0": 0.0019462832382747103}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.162589682192915, "get_ui_image": 0.03104677615603244, "step_physics": 0.12579678080130144, "survival_time": 32.100000000000314, "driven_lanedir": 3.432556041061699, "get_state_dump": 0.004693708375304891, "get_robot_state": 0.003624590892999391, "sim_render-ego0": 0.003853486077410993, "get_duckie_state": 1.2217561712902776e-06, "in-drivable-lane": 15.700000000000216, "deviation-heading": 4.948414994622274, "agent_compute-ego0": 0.012577181099732965, "complete-iteration": 0.19728047703139337, "set_robot_commands": 0.002159661119499622, "deviation-center-line": 1.293297552421734, "driven_lanedir_consec": 3.432556041061699, "sim_compute_sim_state": 0.011459126257414395, "sim_compute_performance-ego0": 0.0019773780650706907}, "LF-norm-small_loop-000-ego0": {"driven_any": 12.827441305671126, "get_ui_image": 0.024577785193374217, "step_physics": 0.09985755424912426, "survival_time": 59.99999999999873, "driven_lanedir": 6.153391161251218, "get_state_dump": 0.004353673928583988, "get_robot_state": 0.0035565062228289372, "sim_render-ego0": 0.003666218472559387, "get_duckie_state": 1.1448459164685354e-06, "in-drivable-lane": 32.04999999999949, "deviation-heading": 13.140095874894836, "agent_compute-ego0": 0.011989770582772412, "complete-iteration": 0.15807055275604984, "set_robot_commands": 0.0020737358175844673, "deviation-center-line": 2.020046918401504, "driven_lanedir_consec": 6.140333079141504, "sim_compute_sim_state": 0.00603010314985874, "sim_compute_performance-ego0": 0.001879435395519501}}
set_robot_commands_max0.0022125584738595144
set_robot_commands_mean0.002148581443147339
set_robot_commands_median0.002154015740572687
set_robot_commands_min0.0020737358175844673
sim_compute_performance-ego0_max0.0019773780650706907
sim_compute_performance-ego0_mean0.0019435785785215415
sim_compute_performance-ego0_median0.0019587504267479868
sim_compute_performance-ego0_min0.001879435395519501
sim_compute_sim_state_max0.011459126257414395
sim_compute_sim_state_mean0.009171099399190991
sim_compute_sim_state_median0.009597584094745416
sim_compute_sim_state_min0.00603010314985874
sim_render-ego0_max0.00388288072177342
sim_render-ego0_mean0.003800018330386385
sim_render-ego0_median0.0038254870636063665
sim_render-ego0_min0.003666218472559387
simulation-passed1
step_physics_max0.16707286664417811
step_physics_mean0.1263775835349278
step_physics_median0.11928995662320446
step_physics_min0.09985755424912426
survival_time_max59.99999999999873
survival_time_mean38.71249999999944
survival_time_min2.7499999999999982
No reset possible
5710411020Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:43:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012999858983251872
agent_compute-ego0_mean0.012346239163417006
agent_compute-ego0_median0.012250248637425711
agent_compute-ego0_min0.01188460039556473
complete-iteration_max0.3607970090035495
complete-iteration_mean0.30247670923244147
complete-iteration_median0.3038259937205382
complete-iteration_min0.24145784048514005
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.5736420287577735e-06
get_duckie_state_mean1.487932435479589e-06
get_duckie_state_median1.4858976391134017e-06
get_duckie_state_min1.4062924349337791e-06
get_robot_state_max0.0039464696857157
get_robot_state_mean0.0039109581713871
get_robot_state_median0.003904414018127543
get_robot_state_min0.0038885349635776134
get_state_dump_max0.005071621354076884
get_state_dump_mean0.004944874285460511
get_state_dump_median0.004931608902028359
get_state_dump_min0.004844657983708442
get_ui_image_max0.03686492885776999
get_ui_image_mean0.03152971521801595
get_ui_image_median0.031186838332659797
get_ui_image_min0.026880255348974223
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02941390120119576, "step_physics": 0.22258047914624116, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.005071621354076884, "get_robot_state": 0.0038931463084351903, "sim_render-ego0": 0.004048353428646091, "get_duckie_state": 1.4438120947590875e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.011997081953520382, "complete-iteration": 0.2903040029127135, "set_robot_commands": 0.0023597096721893742, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008743974787309506, "sim_compute_performance-ego0": 0.0021040654003769035}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03686492885776999, "step_physics": 0.2811703128084156, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004976167567663645, "get_robot_state": 0.0038885349635776134, "sim_render-ego0": 0.004153626646030753, "get_duckie_state": 1.5279831834677156e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.012999858983251872, "complete-iteration": 0.3607970090035495, "set_robot_commands": 0.0022999976298691926, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.012206804940940737, "sim_compute_performance-ego0": 0.0021452113651018356}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03295977546412383, "step_physics": 0.24585837666736257, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004887050236393073, "get_robot_state": 0.003915681727819895, "sim_render-ego0": 0.00411687226815585, "get_duckie_state": 1.4062924349337791e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.01188460039556473, "complete-iteration": 0.3173479845283629, "set_robot_commands": 0.002412906594320102, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009027768928343609, "sim_compute_performance-ego0": 0.002191777431796135}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.026880255348974223, "step_physics": 0.17834353605773823, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004844657983708442, "get_robot_state": 0.0039464696857157, "sim_render-ego0": 0.004049172905660688, "get_duckie_state": 1.5736420287577735e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.01250341532133104, "complete-iteration": 0.24145784048514005, "set_robot_commands": 0.002360266114551757, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006282948931488367, "sim_compute_performance-ego0": 0.0021578151915690783}}
set_robot_commands_max0.002412906594320102
set_robot_commands_mean0.0023582200027326065
set_robot_commands_median0.002359987893370566
set_robot_commands_min0.0022999976298691926
sim_compute_performance-ego0_max0.002191777431796135
sim_compute_performance-ego0_mean0.002149717347210988
sim_compute_performance-ego0_median0.002151513278335457
sim_compute_performance-ego0_min0.0021040654003769035
sim_compute_sim_state_max0.012206804940940737
sim_compute_sim_state_mean0.009065374397020556
sim_compute_sim_state_median0.008885871857826556
sim_compute_sim_state_min0.006282948931488367
sim_render-ego0_max0.004153626646030753
sim_render-ego0_mean0.004092006312123346
sim_render-ego0_median0.004083022586908269
sim_render-ego0_min0.004048353428646091
simulation-passed1
step_physics_max0.2811703128084156
step_physics_mean0.2319881761699394
step_physics_median0.23421942790680184
step_physics_min0.17834353605773823
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5690011058Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:40:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013527625605625275
agent_compute-ego0_mean0.012556648522392102
agent_compute-ego0_median0.01255413703775525
agent_compute-ego0_min0.01159069440843263
complete-iteration_max0.3308563992740907
complete-iteration_mean0.2776751676070303
complete-iteration_median0.27669460698031667
complete-iteration_min0.22645505719339715
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.2613752303175089e-06
get_duckie_state_mean1.228173309122891e-06
get_duckie_state_median1.227825904865249e-06
get_duckie_state_min1.1956661964435562e-06
get_robot_state_max0.0036434366939268343
get_robot_state_mean0.003576973346151182
get_robot_state_median0.0035742481582667013
get_robot_state_min0.0035159603741444913
get_state_dump_max0.004620622139389965
get_state_dump_mean0.004528364918809648
get_state_dump_median0.004520372189054084
get_state_dump_min0.004452093157740457
get_ui_image_max0.03397155264632887
get_ui_image_mean0.029134562122732473
get_ui_image_median0.028690829165869212
get_ui_image_min0.025185037512862617
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02642767018422199, "step_physics": 0.1933382720772571, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.0045635261503881855, "get_robot_state": 0.0035712361633529473, "sim_render-ego0": 0.00374678985760869, "get_duckie_state": 1.2613752303175089e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.01159069440843263, "complete-iteration": 0.25540506671012986, "set_robot_commands": 0.002133522700707581, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008002580155143135, "sim_compute_performance-ego0": 0.0019441581983351889}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03397155264632887, "step_physics": 0.2560830638370943, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004620622139389965, "get_robot_state": 0.003577260153180455, "sim_render-ego0": 0.003774704286002001, "get_duckie_state": 1.2474790600118392e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013527625605625275, "complete-iteration": 0.3308563992740907, "set_robot_commands": 0.0021436939033044567, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.01115209931239399, "sim_compute_performance-ego0": 0.001922887925998456}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.030953988147516435, "step_physics": 0.22978112878251533, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004452093157740457, "get_robot_state": 0.0036434366939268343, "sim_render-ego0": 0.0038229335257651703, "get_duckie_state": 1.1956661964435562e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012433008389310178, "complete-iteration": 0.29798414725050343, "set_robot_commands": 0.0022207749674064132, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008591174285278828, "sim_compute_performance-ego0": 0.0020035438791699057}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.025185037512862617, "step_physics": 0.16708521263287723, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.0044772182277199825, "get_robot_state": 0.0035159603741444913, "sim_render-ego0": 0.003669233941515717, "get_duckie_state": 1.208172749718659e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.012675265686200322, "complete-iteration": 0.22645505719339715, "set_robot_commands": 0.0020902937000538287, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00582380755358592, "sim_compute_performance-ego0": 0.001852176866364618}}
set_robot_commands_max0.0022207749674064132
set_robot_commands_mean0.00214707131786807
set_robot_commands_median0.002138608302006019
set_robot_commands_min0.0020902937000538287
sim_compute_performance-ego0_max0.0020035438791699057
sim_compute_performance-ego0_mean0.001930691717467042
sim_compute_performance-ego0_median0.0019335230621668224
sim_compute_performance-ego0_min0.001852176866364618
sim_compute_sim_state_max0.01115209931239399
sim_compute_sim_state_mean0.00839241532660047
sim_compute_sim_state_median0.008296877220210983
sim_compute_sim_state_min0.00582380755358592
sim_render-ego0_max0.0038229335257651703
sim_render-ego0_mean0.0037534154027228945
sim_render-ego0_median0.0037607470718053456
sim_render-ego0_min0.003669233941515717
simulation-passed1
step_physics_max0.2560830638370943
step_physics_mean0.21157191933243596
step_physics_median0.2115597004298862
step_physics_min0.16708521263287723
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5687911425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-070:01:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5684411427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-070:02:30
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5677711082Fernanda Custodio Pereira do Carmo 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.430360480579914
survival_time_median11.375000000000028
deviation-center-line_median0.41781679267649385
in-drivable-lane_median4.150000000000022


other stats
agent_compute-ego0_max0.013211755191578583
agent_compute-ego0_mean0.012266096948723458
agent_compute-ego0_median0.01220509229654771
agent_compute-ego0_min0.01144244801021983
complete-iteration_max0.21533527014390477
complete-iteration_mean0.17164085826056247
complete-iteration_median0.16229616380759676
complete-iteration_min0.14663583528315163
deviation-center-line_max1.3321792233431589
deviation-center-line_mean0.5765671983237982
deviation-center-line_min0.13845598459904623
deviation-heading_max2.7143405739773057
deviation-heading_mean1.422859778216981
deviation-heading_median1.1038546753460896
deviation-heading_min0.7693891881984395
driven_any_max7.539053811131636
driven_any_mean3.0726262439318877
driven_any_median1.9405663428031097
driven_any_min0.8703184789896964
driven_lanedir_consec_max3.6206345735510337
driven_lanedir_consec_mean1.731338891963692
driven_lanedir_consec_min0.4440000331439069
driven_lanedir_max3.6206345735510337
driven_lanedir_mean1.731338891963692
driven_lanedir_median1.430360480579914
driven_lanedir_min0.4440000331439069
get_duckie_state_max1.2955575619103773e-06
get_duckie_state_mean1.2085093024417175e-06
get_duckie_state_median1.201294821601944e-06
get_duckie_state_min1.1358900046526054e-06
get_robot_state_max0.003619450443195847
get_robot_state_mean0.00350724066073812
get_robot_state_median0.003505322814569782
get_robot_state_min0.00339886657061707
get_state_dump_max0.004527254431855445
get_state_dump_mean0.004438073135326595
get_state_dump_median0.004453465183608545
get_state_dump_min0.0043181077422338445
get_ui_image_max0.03421099006005053
get_ui_image_mean0.029143123797548444
get_ui_image_median0.028915093269476017
get_ui_image_min0.024531318591191217
in-drivable-lane_max22.34999999999973
in-drivable-lane_mean8.137499999999942
in-drivable-lane_min1.8999999999999944
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4427040361164676, "get_ui_image": 0.026539962753476833, "step_physics": 0.0903813085066, "survival_time": 12.600000000000044, "driven_lanedir": 2.154291092988411, "get_state_dump": 0.00440097891766092, "get_robot_state": 0.003455060272819911, "sim_render-ego0": 0.003720042262623904, "get_duckie_state": 1.1543982584957078e-06, "in-drivable-lane": 2.050000000000029, "deviation-heading": 1.16848443817702, "agent_compute-ego0": 0.011858795942525148, "complete-iteration": 0.153392197115148, "set_robot_commands": 0.002068004118124016, "deviation-center-line": 0.43252047390130755, "driven_lanedir_consec": 2.154291092988411, "sim_compute_sim_state": 0.009031202482140585, "sim_compute_performance-ego0": 0.0018553045898558123}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.8703184789896964, "get_ui_image": 0.03421099006005053, "step_physics": 0.14235976732002115, "survival_time": 5.249999999999989, "driven_lanedir": 0.4440000331439069, "get_state_dump": 0.004505951449556171, "get_robot_state": 0.003619450443195847, "sim_render-ego0": 0.0038309592121052297, "get_duckie_state": 1.2955575619103773e-06, "in-drivable-lane": 1.8999999999999944, "deviation-heading": 1.0392249125151594, "agent_compute-ego0": 0.012551388650570277, "complete-iteration": 0.21533527014390477, "set_robot_commands": 0.002218295943062261, "deviation-center-line": 0.4031131114516802, "driven_lanedir_consec": 0.4440000331439069, "sim_compute_sim_state": 0.009941935539245604, "sim_compute_performance-ego0": 0.0020087485043507702}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4384286494897516, "get_ui_image": 0.03129022378547519, "step_physics": 0.10139082226098751, "survival_time": 10.15000000000001, "driven_lanedir": 0.7064298681714172, "get_state_dump": 0.004527254431855445, "get_robot_state": 0.0035555853563196517, "sim_render-ego0": 0.0039227745112250835, "get_duckie_state": 1.2481913847081802e-06, "in-drivable-lane": 6.250000000000015, "deviation-heading": 0.7693891881984395, "agent_compute-ego0": 0.013211755191578583, "complete-iteration": 0.17120013050004548, "set_robot_commands": 0.002145074161828733, "deviation-center-line": 0.13845598459904623, "driven_lanedir_consec": 0.7064298681714172, "sim_compute_sim_state": 0.009128463034536323, "sim_compute_performance-ego0": 0.0019413419798308728}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.539053811131636, "get_ui_image": 0.024531318591191217, "step_physics": 0.08946504427244882, "survival_time": 40.24999999999985, "driven_lanedir": 3.6206345735510337, "get_state_dump": 0.0043181077422338445, "get_robot_state": 0.00339886657061707, "sim_render-ego0": 0.0035716691620592445, "get_duckie_state": 1.1358900046526054e-06, "in-drivable-lane": 22.34999999999973, "deviation-heading": 2.7143405739773057, "agent_compute-ego0": 0.01144244801021983, "complete-iteration": 0.14663583528315163, "set_robot_commands": 0.0020096414438252413, "deviation-center-line": 1.3321792233431589, "driven_lanedir_consec": 3.6206345735510337, "sim_compute_sim_state": 0.006007492098559813, "sim_compute_performance-ego0": 0.0018114922360214349}}
set_robot_commands_max0.002218295943062261
set_robot_commands_mean0.0021102539167100628
set_robot_commands_median0.0021065391399763744
set_robot_commands_min0.0020096414438252413
sim_compute_performance-ego0_max0.0020087485043507702
sim_compute_performance-ego0_mean0.0019042218275147223
sim_compute_performance-ego0_median0.0018983232848433424
sim_compute_performance-ego0_min0.0018114922360214349
sim_compute_sim_state_max0.009941935539245604
sim_compute_sim_state_mean0.00852727328862058
sim_compute_sim_state_median0.009079832758338454
sim_compute_sim_state_min0.006007492098559813
sim_render-ego0_max0.0039227745112250835
sim_render-ego0_mean0.003761361287003365
sim_render-ego0_median0.0037755007373645663
sim_render-ego0_min0.0035716691620592445
simulation-passed1
step_physics_max0.14235976732002115
step_physics_mean0.10589923559001438
step_physics_median0.09588606538379375
step_physics_min0.08946504427244882
survival_time_max40.24999999999985
survival_time_mean17.06249999999997
survival_time_min5.249999999999989
No reset possible
5656011103Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:34:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.592026320053075
survival_time_median59.99999999999873
deviation-center-line_median2.229111833394008
in-drivable-lane_median1.5249999999999453


other stats
agent_compute-ego0_max0.03317497135896071
agent_compute-ego0_mean0.027271200278518003
agent_compute-ego0_median0.0319933170680698
agent_compute-ego0_min0.011923195618971698
complete-iteration_max0.1936060302362752
complete-iteration_mean0.1823736593983354
complete-iteration_median0.18487677645623735
complete-iteration_min0.16613505444459176
deviation-center-line_max2.725659602018888
deviation-center-line_mean2.217184832544449
deviation-center-line_min1.6848560613708918
deviation-heading_max11.755097385961458
deviation-heading_mean10.5246708643877
deviation-heading_median11.417285373262349
deviation-heading_min7.509015325064652
driven_any_max7.769748086217007
driven_any_mean7.491595180134986
driven_any_median7.449721225915836
driven_any_min7.297190182491267
driven_lanedir_consec_max7.274317054551279
driven_lanedir_consec_mean6.617410313643481
driven_lanedir_consec_min6.011271559916494
driven_lanedir_max7.274317054551279
driven_lanedir_mean7.104387767184705
driven_lanedir_median7.099926179287584
driven_lanedir_min6.943381655612372
get_duckie_state_max1.8553372525255643e-06
get_duckie_state_mean1.7747890939323432e-06
get_duckie_state_median1.812953933093272e-06
get_duckie_state_min1.6179112570172643e-06
get_robot_state_max0.003621250068416802
get_robot_state_mean0.003457095650808698
get_robot_state_median0.0034445750524757504
get_robot_state_min0.003317982429866489
get_state_dump_max0.004513405046296258
get_state_dump_mean0.004362327917529383
get_state_dump_median0.004408552088804984
get_state_dump_min0.004118802446211308
get_ui_image_max0.03164302558327198
get_ui_image_mean0.02871722985465362
get_ui_image_median0.029492500521161973
get_ui_image_min0.024240892793018554
in-drivable-lane_max2.150000000000018
in-drivable-lane_mean1.2999999999999772
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.769748086217007, "get_ui_image": 0.027503831698237412, "step_physics": 0.0951346245336096, "survival_time": 59.99999999999873, "driven_lanedir": 7.197739789037454, "get_state_dump": 0.004513405046296258, "get_robot_state": 0.0034570279069784577, "sim_render-ego0": 0.0036874754442759697, "get_duckie_state": 1.8553372525255643e-06, "in-drivable-lane": 2.149999999999878, "deviation-heading": 11.366201826895765, "agent_compute-ego0": 0.03145103331509478, "complete-iteration": 0.1794205611194798, "set_robot_commands": 0.002142227261787053, "deviation-center-line": 2.158452038481336, "driven_lanedir_consec": 6.240670984493779, "sim_compute_sim_state": 0.009582977906353369, "sim_compute_performance-ego0": 0.001862689914751013}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.526618323588721, "get_ui_image": 0.03148116934408653, "step_physics": 0.1020214938799805, "survival_time": 59.99999999999873, "driven_lanedir": 7.002112569537713, "get_state_dump": 0.004118802446211308, "get_robot_state": 0.003317982429866489, "sim_render-ego0": 0.003482223847426542, "get_duckie_state": 1.6179112570172643e-06, "in-drivable-lane": 2.150000000000018, "deviation-heading": 11.468368919628931, "agent_compute-ego0": 0.03253560082104482, "complete-iteration": 0.1936060302362752, "set_robot_commands": 0.00197068638448215, "deviation-center-line": 2.29977162830668, "driven_lanedir_consec": 6.011271559916494, "sim_compute_sim_state": 0.012793967765534946, "sim_compute_performance-ego0": 0.0018068999672412472}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.297190182491267, "get_ui_image": 0.03164302558327198, "step_physics": 0.1177879854800997, "survival_time": 59.99999999999873, "driven_lanedir": 6.943381655612372, "get_state_dump": 0.004506629670688651, "get_robot_state": 0.003621250068416802, "sim_render-ego0": 0.0037806931383703073, "get_duckie_state": 1.8070976898930256e-06, "in-drivable-lane": 0.9000000000000128, "deviation-heading": 11.755097385961458, "agent_compute-ego0": 0.011923195618971698, "complete-iteration": 0.19033299179299487, "set_robot_commands": 0.0021538248070074456, "deviation-center-line": 2.725659602018888, "driven_lanedir_consec": 6.943381655612372, "sim_compute_sim_state": 0.012906234329884296, "sim_compute_performance-ego0": 0.0019278828051564696}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.37282412824295, "get_ui_image": 0.024240892793018554, "step_physics": 0.0877360096581274, "survival_time": 59.99999999999873, "driven_lanedir": 7.274317054551279, "get_state_dump": 0.004310474506921316, "get_robot_state": 0.0034321221979730435, "sim_render-ego0": 0.003522492765288468, "get_duckie_state": 1.8188101762935184e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.509015325064652, "agent_compute-ego0": 0.03317497135896071, "complete-iteration": 0.16613505444459176, "set_robot_commands": 0.0020464058224108693, "deviation-center-line": 1.6848560613708918, "driven_lanedir_consec": 7.274317054551279, "sim_compute_sim_state": 0.005807236966046564, "sim_compute_performance-ego0": 0.001780287014455422}}
set_robot_commands_max0.0021538248070074456
set_robot_commands_mean0.002078286068921879
set_robot_commands_median0.002094316542098961
set_robot_commands_min0.00197068638448215
sim_compute_performance-ego0_max0.0019278828051564696
sim_compute_performance-ego0_mean0.001844439925401038
sim_compute_performance-ego0_median0.0018347949409961305
sim_compute_performance-ego0_min0.001780287014455422
sim_compute_sim_state_max0.012906234329884296
sim_compute_sim_state_mean0.010272604241954792
sim_compute_sim_state_median0.011188472835944156
sim_compute_sim_state_min0.005807236966046564
sim_render-ego0_max0.0037806931383703073
sim_render-ego0_mean0.003618221298840322
sim_render-ego0_median0.003604984104782219
sim_render-ego0_min0.003482223847426542
simulation-passed1
step_physics_max0.1177879854800997
step_physics_mean0.10067002838795427
step_physics_median0.09857805920679504
step_physics_min0.0877360096581274
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5651711117Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:04:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5646211126Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:02:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5639511133Mo Kleit 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:02:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5637211280Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:01:14
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5630711127Bhavya Patwa 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:02:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5628011429Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-070:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5624511430Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV-sim-validationLFVv-simhost-erroryesnogpu-prod-070:00:57
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5622211303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5620211286Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5618511281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5612311299Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:05:18
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5609311309Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:00:51
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5605711302Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:15
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5602511285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5599611282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:12
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5596611308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:01:39
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5594211308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:01:31
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5592911310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5590111284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5589211290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5586511289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5579211301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5574811291Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:01:13
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5572611305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5562511163Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:02:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5555311311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5553211450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-070:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5549111307Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:55
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5542411225Charlie Gauthier 🇨🇦template-rosaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:02:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5539011278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:59
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5527611424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:16
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5523011283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:01:05
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5519511296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:22
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5515811287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:14
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5509411436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:57
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5481411454Cliff Chandler 🇺🇸baseline-duckietownaido5-LF-sim-testingLFt-simsuccessyesnogpu-prod-070:29:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.303059911994449
survival_time_median59.99999999999873
deviation-center-line_median2.431552895559361
in-drivable-lane_median9.52500000000004


other stats
agent_compute-ego0_max0.03495895070866797
agent_compute-ego0_mean0.020541631590744132
agent_compute-ego0_median0.01750522946239411
agent_compute-ego0_min0.012197116729520344
complete-iteration_max0.20234308353967215
complete-iteration_mean0.18300459119762785
complete-iteration_median0.18186738629748833
complete-iteration_min0.16594050865586257
deviation-center-line_max3.882450225338613
deviation-center-line_mean2.265128936291379
deviation-center-line_min0.3149597287081813
deviation-heading_max9.412600900404652
deviation-heading_mean5.45343157209105
deviation-heading_median5.651399489654302
deviation-heading_min1.0983264086509412
driven_any_max7.921042191468144
driven_any_mean6.777539491681237
driven_any_median7.917689127105305
driven_any_min3.353737521046193
driven_lanedir_consec_max7.036209147263095
driven_lanedir_consec_mean4.114975831023135
driven_lanedir_consec_min0.8175743528405478
driven_lanedir_max7.036209147263095
driven_lanedir_mean4.114975831023135
driven_lanedir_median4.303059911994449
driven_lanedir_min0.8175743528405478
get_duckie_state_max1.3965651157198104e-06
get_duckie_state_mean1.3524268821261855e-06
get_duckie_state_median1.3508070120704264e-06
get_duckie_state_min1.3115283886440791e-06
get_robot_state_max0.0038075180162288657
get_robot_state_mean0.0036392782422671657
get_robot_state_median0.00361690751519628
get_robot_state_min0.0035157799224472363
get_state_dump_max0.005638466388043687
get_state_dump_mean0.004943852916566353
get_state_dump_median0.004845606794365241
get_state_dump_min0.00444573168949124
get_ui_image_max0.03382890905369132
get_ui_image_mean0.02951749282037254
get_ui_image_median0.029246205394214436
get_ui_image_min0.02574865143936997
in-drivable-lane_max53.24999999999875
in-drivable-lane_mean19.26249999999967
in-drivable-lane_min4.749999999999858
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.920866229918887, "get_ui_image": 0.02673893903911759, "step_physics": 0.10229385464912052, "survival_time": 59.99999999999873, "driven_lanedir": 0.8175743528405478, "get_state_dump": 0.00444573168949124, "get_robot_state": 0.003539645006813475, "sim_render-ego0": 0.0037593847508235936, "get_duckie_state": 1.3965651157198104e-06, "in-drivable-lane": 53.24999999999875, "deviation-heading": 1.0983264086509412, "agent_compute-ego0": 0.012197116729520344, "complete-iteration": 0.16594050865586257, "set_robot_commands": 0.0021143912474976094, "deviation-center-line": 0.3149597287081813, "driven_lanedir_consec": 0.8175743528405478, "sim_compute_sim_state": 0.008846990274052934, "sim_compute_performance-ego0": 0.0019187980845607787}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.921042191468144, "get_ui_image": 0.03382890905369132, "step_physics": 0.1173839666364989, "survival_time": 59.99999999999873, "driven_lanedir": 7.009785619606203, "get_state_dump": 0.0050073313177078594, "get_robot_state": 0.0035157799224472363, "sim_render-ego0": 0.00386710865710002, "get_duckie_state": 1.3846541126006648e-06, "in-drivable-lane": 5.599999999999898, "deviation-heading": 8.950575713661244, "agent_compute-ego0": 0.022719431876342164, "complete-iteration": 0.20234308353967215, "set_robot_commands": 0.002206842667057949, "deviation-center-line": 3.882450225338613, "driven_lanedir_consec": 7.009785619606203, "sim_compute_sim_state": 0.011755175832705533, "sim_compute_performance-ego0": 0.001969523076510846}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.914512024291724, "get_ui_image": 0.031753471749311285, "step_physics": 0.1122017256127706, "survival_time": 59.99999999999873, "driven_lanedir": 7.036209147263095, "get_state_dump": 0.004683882271022622, "get_robot_state": 0.0036941700235790854, "sim_render-ego0": 0.003735155388278627, "get_duckie_state": 1.316959911540188e-06, "in-drivable-lane": 4.749999999999858, "deviation-heading": 9.412600900404652, "agent_compute-ego0": 0.012291027048446056, "complete-iteration": 0.1868393468817108, "set_robot_commands": 0.002152328785015681, "deviation-center-line": 3.819833547393939, "driven_lanedir_consec": 7.036209147263095, "sim_compute_sim_state": 0.014239094835038388, "sim_compute_performance-ego0": 0.0019991215222284857}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.353737521046193, "get_ui_image": 0.02574865143936997, "step_physics": 0.0921944296111192, "survival_time": 26.30000000000024, "driven_lanedir": 1.5963342043826954, "get_state_dump": 0.005638466388043687, "get_robot_state": 0.0038075180162288657, "sim_render-ego0": 0.003987369320198074, "get_duckie_state": 1.3115283886440791e-06, "in-drivable-lane": 13.45000000000018, "deviation-heading": 2.352223265647359, "agent_compute-ego0": 0.03495895070866797, "complete-iteration": 0.17689542571326586, "set_robot_commands": 0.002321191711715322, "deviation-center-line": 1.0432722437247826, "driven_lanedir_consec": 1.5963342043826954, "sim_compute_sim_state": 0.006152430340732524, "sim_compute_performance-ego0": 0.001998914939402629}}
set_robot_commands_max0.002321191711715322
set_robot_commands_mean0.002198688602821641
set_robot_commands_median0.0021795857260368152
set_robot_commands_min0.0021143912474976094
sim_compute_performance-ego0_max0.0019991215222284857
sim_compute_performance-ego0_mean0.001971589405675685
sim_compute_performance-ego0_median0.0019842190079567374
sim_compute_performance-ego0_min0.0019187980845607787
sim_compute_sim_state_max0.014239094835038388
sim_compute_sim_state_mean0.010248422820632343
sim_compute_sim_state_median0.010301083053379234
sim_compute_sim_state_min0.006152430340732524
sim_render-ego0_max0.003987369320198074
sim_render-ego0_mean0.003837254529100079
sim_render-ego0_median0.0038132467039618066
sim_render-ego0_min0.003735155388278627
simulation-passed1
step_physics_max0.1173839666364989
step_physics_mean0.10601849412737732
step_physics_median0.10724779013094556
step_physics_min0.0921944296111192
survival_time_max59.99999999999873
survival_time_mean51.57499999999911
survival_time_min26.30000000000024
No reset possible
5473311383Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:14:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9452087176057188
survival_time_median22.22500000000002
deviation-center-line_median0.356176402162386
in-drivable-lane_median6.5999999999999375


other stats
agent_compute-ego0_max0.012178425254356052
agent_compute-ego0_mean0.011628785611054395
agent_compute-ego0_median0.011711139905676196
agent_compute-ego0_min0.010914437378509136
complete-iteration_max0.197999583014959
complete-iteration_mean0.17452971276754248
complete-iteration_median0.17503417445548447
complete-iteration_min0.1500509191442419
deviation-center-line_max1.374501006946726
deviation-center-line_mean0.5535178002044605
deviation-center-line_min0.12721738954634382
deviation-heading_max6.465992526192443
deviation-heading_mean2.7145666394097843
deviation-heading_median1.9307315904973736
deviation-heading_min0.530810850451946
driven_any_max9.798514156589288
driven_any_mean5.3564231321001285
driven_any_median5.14765808454329
driven_any_min1.3318622027246447
driven_lanedir_consec_max6.107015236218544
driven_lanedir_consec_mean2.1730326636580295
driven_lanedir_consec_min0.6946979832021363
driven_lanedir_max6.213253238764639
driven_lanedir_mean2.1995921642945535
driven_lanedir_median0.9452087176057188
driven_lanedir_min0.6946979832021363
get_duckie_state_max1.4008745369186148e-06
get_duckie_state_mean1.2710695874127684e-06
get_duckie_state_median1.2456554586123229e-06
get_duckie_state_min1.1920928955078125e-06
get_robot_state_max0.003656575735348311
get_robot_state_mean0.00349987140939698
get_robot_state_median0.003474781575978034
get_robot_state_min0.003393346750283543
get_state_dump_max0.00471740266459102
get_state_dump_mean0.004478965106161988
get_state_dump_median0.00445528526844886
get_state_dump_min0.0042878872231592105
get_ui_image_max0.031946183759954914
get_ui_image_mean0.02830141187409139
get_ui_image_median0.028249620209190657
get_ui_image_min0.024760223318029333
in-drivable-lane_max39.59999999999954
in-drivable-lane_mean14.03749999999985
in-drivable-lane_min3.349999999999988
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.668134777052645, "get_ui_image": 0.02608302670644055, "step_physics": 0.09959844872863688, "survival_time": 36.60000000000006, "driven_lanedir": 6.213253238764639, "get_state_dump": 0.004372205773284621, "get_robot_state": 0.0034212825405646476, "sim_render-ego0": 0.0034629670854805276, "get_duckie_state": 1.1950202723317062e-06, "in-drivable-lane": 9.24999999999989, "deviation-heading": 6.465992526192443, "agent_compute-ego0": 0.011591063352431314, "complete-iteration": 0.16102949008447248, "set_robot_commands": 0.0020242527757465107, "deviation-center-line": 1.374501006946726, "driven_lanedir_consec": 6.107015236218544, "sim_compute_sim_state": 0.008586464930036059, "sim_compute_performance-ego0": 0.0018145979507883444}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3318622027246447, "get_ui_image": 0.031946183759954914, "step_physics": 0.13097425201271154, "survival_time": 7.84999999999998, "driven_lanedir": 0.8214326392477782, "get_state_dump": 0.0042878872231592105, "get_robot_state": 0.003393346750283543, "sim_render-ego0": 0.003486541253101977, "get_duckie_state": 1.1920928955078125e-06, "in-drivable-lane": 3.349999999999988, "deviation-heading": 1.364744443943402, "agent_compute-ego0": 0.010914437378509136, "complete-iteration": 0.197999583014959, "set_robot_commands": 0.002019431017622163, "deviation-center-line": 0.3163751533699139, "driven_lanedir_consec": 0.8214326392477782, "sim_compute_sim_state": 0.009093412870093236, "sim_compute_performance-ego0": 0.0018096362488179264}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.798514156589288, "get_ui_image": 0.03041621371194075, "step_physics": 0.1168824242434147, "survival_time": 44.99999999999958, "driven_lanedir": 1.0689847959636596, "get_state_dump": 0.00471740266459102, "get_robot_state": 0.003656575735348311, "sim_render-ego0": 0.003822635466462367, "get_duckie_state": 1.4008745369186148e-06, "in-drivable-lane": 39.59999999999954, "deviation-heading": 2.496718737051345, "agent_compute-ego0": 0.012178425254356052, "complete-iteration": 0.1890388588264965, "set_robot_commands": 0.0023976036499396016, "deviation-center-line": 0.3959776509548581, "driven_lanedir_consec": 1.0689847959636596, "sim_compute_sim_state": 0.01276754221561614, "sim_compute_performance-ego0": 0.0021093704062746577}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.627181392033936, "get_ui_image": 0.024760223318029333, "step_physics": 0.09289052927935564, "survival_time": 6.699999999999984, "driven_lanedir": 0.6946979832021363, "get_state_dump": 0.0045383647636131, "get_robot_state": 0.0035282806113914205, "sim_render-ego0": 0.003628109119556568, "get_duckie_state": 1.2962906448929395e-06, "in-drivable-lane": 3.949999999999986, "deviation-heading": 0.530810850451946, "agent_compute-ego0": 0.01183121645892108, "complete-iteration": 0.1500509191442419, "set_robot_commands": 0.0020480579800075953, "deviation-center-line": 0.12721738954634382, "driven_lanedir_consec": 0.6946979832021363, "sim_compute_sim_state": 0.004869782483136212, "sim_compute_performance-ego0": 0.0018775286497893155}}
set_robot_commands_max0.0023976036499396016
set_robot_commands_mean0.0021223363558289677
set_robot_commands_median0.002036155377877053
set_robot_commands_min0.002019431017622163
sim_compute_performance-ego0_max0.0021093704062746577
sim_compute_performance-ego0_mean0.0019027833139175611
sim_compute_performance-ego0_median0.00184606330028883
sim_compute_performance-ego0_min0.0018096362488179264
sim_compute_sim_state_max0.01276754221561614
sim_compute_sim_state_mean0.008829300624720413
sim_compute_sim_state_median0.008839938900064648
sim_compute_sim_state_min0.004869782483136212
sim_render-ego0_max0.003822635466462367
sim_render-ego0_mean0.00360006323115036
sim_render-ego0_median0.0035573251863292724
sim_render-ego0_min0.0034629670854805276
simulation-passed1
step_physics_max0.13097425201271154
step_physics_mean0.11008641356602968
step_physics_median0.10824043648602578
step_physics_min0.09289052927935564
survival_time_max44.99999999999958
survival_time_mean24.037499999999905
survival_time_min6.699999999999984
No reset possible
5469211387Charlie Gauthier 🇨🇦template-rpl-rosaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:03:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5466711398Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:02:21
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5463111402Marton Moro 🇭🇺template-randomaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:41
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1178, in run_one
    stats = container.stats(stream=False)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 418, in stats
    return self.client.api.stats(self.id, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 1125, in stats
    return self._result(self._get(url, params={'stream': False}),
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5451511476Raphael Jeansim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:33:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.74920637353492
survival_time_median59.99999999999873
deviation-center-line_median2.576890388448972
in-drivable-lane_median5.649999999999878


other stats
agent_compute-ego0_max0.046890656153361
agent_compute-ego0_mean0.02133298603455424
agent_compute-ego0_median0.012961453343311218
agent_compute-ego0_min0.012518381298233528
complete-iteration_max0.23337732802620537
complete-iteration_mean0.21060283071950517
complete-iteration_median0.2119976248979649
complete-iteration_min0.18503874505588555
deviation-center-line_max2.9587611204624538
deviation-center-line_mean2.148695502039604
deviation-center-line_min0.4822401107980181
deviation-heading_max12.268870868615846
deviation-heading_mean9.173384297375314
deviation-heading_median10.617144284900297
deviation-heading_min3.190377751084814
driven_any_max14.716043368673873
driven_any_mean11.142327390792294
driven_any_median12.082819933954507
driven_any_min5.687626326586289
driven_lanedir_consec_max14.403559559030002
driven_lanedir_consec_mean9.325440558454982
driven_lanedir_consec_min1.3997899277200756
driven_lanedir_max14.403559559030002
driven_lanedir_mean9.332543378836991
driven_lanedir_median10.74920637353492
driven_lanedir_min1.4282012092481169
get_duckie_state_max1.5559740407977075e-06
get_duckie_state_mean1.4319310432852124e-06
get_duckie_state_median1.4241589396124974e-06
get_duckie_state_min1.323432253118147e-06
get_robot_state_max0.004106579573327159
get_robot_state_mean0.003965551660026647
get_robot_state_median0.0039777835143992146
get_robot_state_min0.003800060037981
get_state_dump_max0.005797159462644343
get_state_dump_mean0.005281471342393859
get_state_dump_median0.005118999949700628
get_state_dump_min0.005090726007529837
get_ui_image_max0.036358579410105125
get_ui_image_mean0.03146672908612388
get_ui_image_median0.03163115269536281
get_ui_image_min0.02624603154366477
in-drivable-lane_max20.750000000000274
in-drivable-lane_mean8.012500000000006
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.716043368673873, "get_ui_image": 0.029540187214733064, "step_physics": 0.11481213926971208, "survival_time": 59.99999999999873, "driven_lanedir": 14.403559559030002, "get_state_dump": 0.005140179896930374, "get_robot_state": 0.003876503460810246, "sim_render-ego0": 0.003971305516836149, "get_duckie_state": 1.5559740407977075e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.083029118296098, "agent_compute-ego0": 0.012934235907117096, "complete-iteration": 0.18503874505588555, "set_robot_commands": 0.002348947088287633, "deviation-center-line": 2.3401283612050228, "driven_lanedir_consec": 14.403559559030002, "sim_compute_sim_state": 0.010175163005412768, "sim_compute_performance-ego0": 0.0021471151404337126}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.714295880246292, "get_ui_image": 0.036358579410105125, "step_physics": 0.151828386702208, "survival_time": 59.99999999999873, "driven_lanedir": 11.35288186222704, "get_state_dump": 0.005090726007529837, "get_robot_state": 0.004106579573327159, "sim_render-ego0": 0.004161176832391261, "get_duckie_state": 1.379095644478397e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.268870868615846, "agent_compute-ego0": 0.012518381298233528, "complete-iteration": 0.23337732802620537, "set_robot_commands": 0.002433010977968189, "deviation-center-line": 2.9587611204624538, "driven_lanedir_consec": 11.35288186222704, "sim_compute_sim_state": 0.014448659604633976, "sim_compute_performance-ego0": 0.00233668808536069}, "LF-norm-techtrack-000-ego0": {"driven_any": 12.451343987662725, "get_ui_image": 0.03372211817599256, "step_physics": 0.1382628146258123, "survival_time": 59.99999999999873, "driven_lanedir": 10.145530884842804, "get_state_dump": 0.005097820002470882, "get_robot_state": 0.004079063567988183, "sim_render-ego0": 0.004189314790609774, "get_duckie_state": 1.469222234746598e-06, "in-drivable-lane": 11.299999999999756, "deviation-heading": 11.151259451504496, "agent_compute-ego0": 0.01298867077950534, "complete-iteration": 0.216644059212182, "set_robot_commands": 0.0024743778918009814, "deviation-center-line": 2.813652415692921, "driven_lanedir_consec": 10.145530884842804, "sim_compute_sim_state": 0.013409781118515231, "sim_compute_performance-ego0": 0.0023267497428747933}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.687626326586289, "get_ui_image": 0.02624603154366477, "step_physics": 0.10976497792361076, "survival_time": 28.45000000000027, "driven_lanedir": 1.4282012092481169, "get_state_dump": 0.005797159462644343, "get_robot_state": 0.003800060037981, "sim_render-ego0": 0.0038999185227511224, "get_duckie_state": 1.323432253118147e-06, "in-drivable-lane": 20.750000000000274, "deviation-heading": 3.190377751084814, "agent_compute-ego0": 0.046890656153361, "complete-iteration": 0.20735119058374776, "set_robot_commands": 0.002548016581618995, "deviation-center-line": 0.4822401107980181, "driven_lanedir_consec": 1.3997899277200756, "sim_compute_sim_state": 0.006359918912251791, "sim_compute_performance-ego0": 0.001956771131147418}}
set_robot_commands_max0.002548016581618995
set_robot_commands_mean0.0024510881349189494
set_robot_commands_median0.002453694434884585
set_robot_commands_min0.002348947088287633
sim_compute_performance-ego0_max0.00233668808536069
sim_compute_performance-ego0_mean0.0021918310249541533
sim_compute_performance-ego0_median0.0022369324416542527
sim_compute_performance-ego0_min0.001956771131147418
sim_compute_sim_state_max0.014448659604633976
sim_compute_sim_state_mean0.011098380660203442
sim_compute_sim_state_median0.011792472061963998
sim_compute_sim_state_min0.006359918912251791
sim_render-ego0_max0.004189314790609774
sim_render-ego0_mean0.004055428915647077
sim_render-ego0_median0.004066241174613705
sim_render-ego0_min0.0038999185227511224
simulation-passed1
step_physics_max0.151828386702208
step_physics_mean0.12866707963033577
step_physics_median0.12653747694776218
step_physics_min0.10976497792361076
survival_time_max59.99999999999873
survival_time_mean52.11249999999912
survival_time_min28.45000000000027
No reset possible
5446111534Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:23:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.844678501228016
survival_time_median41.29999999999946
deviation-center-line_median2.251232419482648
in-drivable-lane_median4.349999999999913


other stats
agent_compute-ego0_max0.01270348944906461
agent_compute-ego0_mean0.012432293902622757
agent_compute-ego0_median0.012500703086662452
agent_compute-ego0_min0.012024279988101513
complete-iteration_max0.28854715622077554
complete-iteration_mean0.22168207070853235
complete-iteration_median0.20740726220287695
complete-iteration_min0.18336660220759993
deviation-center-line_max4.001028877056521
deviation-center-line_mean2.224462990299917
deviation-center-line_min0.39435824517785056
deviation-heading_max13.083172591551923
deviation-heading_mean7.594810785977051
deviation-heading_median7.484974548709073
deviation-heading_min2.326121454938139
driven_any_max17.766143403723873
driven_any_mean10.607947963466096
driven_any_median11.800159778911906
driven_any_min1.0653288923167028
driven_lanedir_consec_max11.038106441886423
driven_lanedir_consec_mean5.890310662173978
driven_lanedir_consec_min0.8337792043534589
driven_lanedir_max15.32959882898601
driven_lanedir_mean8.572921442488967
driven_lanedir_median9.0641538683082
driven_lanedir_min0.8337792043534589
get_duckie_state_max1.59627293468415e-06
get_duckie_state_mean1.4656162664204542e-06
get_duckie_state_median1.449158022906639e-06
get_duckie_state_min1.3678760851843883e-06
get_robot_state_max0.004034579346122392
get_robot_state_mean0.003920729531242084
get_robot_state_median0.0039550206234548
get_robot_state_min0.0037382975319363424
get_state_dump_max0.005240903062335515
get_state_dump_mean0.00507463513779603
get_state_dump_median0.005066737445764597
get_state_dump_min0.004924162597319411
get_ui_image_max0.0383548332472979
get_ui_image_mean0.03191578276166401
get_ui_image_median0.031060777733103617
get_ui_image_min0.027186742333150923
in-drivable-lane_max14.799999999999343
in-drivable-lane_mean6.112499999999791
in-drivable-lane_min0.9499999999999966
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.030996521248615, "get_ui_image": 0.02889352813198603, "step_physics": 0.12783940475244923, "survival_time": 22.600000000000183, "driven_lanedir": 5.808982987103228, "get_state_dump": 0.004924162597319411, "get_robot_state": 0.0037382975319363424, "sim_render-ego0": 0.003904056338548134, "get_duckie_state": 1.4126169234185293e-06, "in-drivable-lane": 4.0500000000000576, "deviation-heading": 4.52464771720031, "agent_compute-ego0": 0.012024279988101513, "complete-iteration": 0.19570194017018705, "set_robot_commands": 0.0022460282769950547, "deviation-center-line": 1.5207203388616075, "driven_lanedir_consec": 5.808982987103228, "sim_compute_sim_state": 0.00991507713368397, "sim_compute_performance-ego0": 0.0021256784729610217}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.0653288923167028, "get_ui_image": 0.0383548332472979, "step_physics": 0.2093513193777052, "survival_time": 5.849999999999987, "driven_lanedir": 0.8337792043534589, "get_state_dump": 0.005240903062335515, "get_robot_state": 0.003980628514693955, "sim_render-ego0": 0.004100856134447001, "get_duckie_state": 1.3678760851843883e-06, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 2.326121454938139, "agent_compute-ego0": 0.01270348944906461, "complete-iteration": 0.28854715622077554, "set_robot_commands": 0.0023020202830686407, "deviation-center-line": 0.39435824517785056, "driven_lanedir_consec": 0.8337792043534589, "sim_compute_sim_state": 0.01024080333063158, "sim_compute_performance-ego0": 0.0021745229171494305}, "LF-norm-techtrack-000-ego0": {"driven_any": 16.5693230365752, "get_ui_image": 0.0332280273342212, "step_physics": 0.14168164573243813, "survival_time": 59.99999999999873, "driven_lanedir": 12.319324749513177, "get_state_dump": 0.005064289933140331, "get_robot_state": 0.003929412732215646, "sim_render-ego0": 0.0039757544750178685, "get_duckie_state": 1.4856991223947491e-06, "in-drivable-lane": 14.799999999999343, "deviation-heading": 10.445301380217836, "agent_compute-ego0": 0.012473548083976346, "complete-iteration": 0.21911258423556693, "set_robot_commands": 0.002288266879930583, "deviation-center-line": 2.9817445001036886, "driven_lanedir_consec": 11.038106441886423, "sim_compute_sim_state": 0.014201236704207776, "sim_compute_performance-ego0": 0.0021706842363724403}, "LF-norm-small_loop-000-ego0": {"driven_any": 17.766143403723873, "get_ui_image": 0.027186742333150923, "step_physics": 0.11907182942818444, "survival_time": 59.99999999999873, "driven_lanedir": 15.32959882898601, "get_state_dump": 0.005069184958388863, "get_robot_state": 0.004034579346122392, "sim_render-ego0": 0.004051311327754012, "get_duckie_state": 1.59627293468415e-06, "in-drivable-lane": 4.649999999999768, "deviation-heading": 13.083172591551923, "agent_compute-ego0": 0.012527858089348556, "complete-iteration": 0.18336660220759993, "set_robot_commands": 0.002432280039410111, "deviation-center-line": 4.001028877056521, "driven_lanedir_consec": 5.880374015352804, "sim_compute_sim_state": 0.00669275553002147, "sim_compute_performance-ego0": 0.002204870999008293}}
set_robot_commands_max0.002432280039410111
set_robot_commands_mean0.002317148869851097
set_robot_commands_median0.002295143581499612
set_robot_commands_min0.0022460282769950547
sim_compute_performance-ego0_max0.002204870999008293
sim_compute_performance-ego0_mean0.0021689391563727966
sim_compute_performance-ego0_median0.0021726035767609354
sim_compute_performance-ego0_min0.0021256784729610217
sim_compute_sim_state_max0.014201236704207776
sim_compute_sim_state_mean0.0102624681746362
sim_compute_sim_state_median0.010077940232157774
sim_compute_sim_state_min0.00669275553002147
sim_render-ego0_max0.004100856134447001
sim_render-ego0_mean0.004007994568941754
sim_render-ego0_median0.00401353290138594
sim_render-ego0_min0.003904056338548134
simulation-passed1
step_physics_max0.2093513193777052
step_physics_mean0.14948604982269426
step_physics_median0.1347605252424437
step_physics_min0.11907182942818444
survival_time_max59.99999999999873
survival_time_mean37.11249999999941
survival_time_min5.849999999999987
No reset possible
5440711552Himanshu Arora 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:22:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0614340646808813
survival_time_median36.87499999999939
deviation-center-line_median2.164689240240502
in-drivable-lane_median10.699999999999712


other stats
agent_compute-ego0_max0.01291346327166691
agent_compute-ego0_mean0.012387284907964338
agent_compute-ego0_median0.012321448826790144
agent_compute-ego0_min0.011992778706610151
complete-iteration_max0.21083196791681424
complete-iteration_mean0.19264160686253523
complete-iteration_median0.19548877088321193
complete-iteration_min0.16875691776690277
deviation-center-line_max4.367551585062542
deviation-center-line_mean2.197158898900628
deviation-center-line_min0.09170553005896714
deviation-heading_max15.591283674524092
deviation-heading_mean8.08827776386047
deviation-heading_median7.933272968221055
deviation-heading_min0.895281444475679
driven_any_max17.826805572625638
driven_any_mean8.272459165141338
driven_any_median6.7817179531959875
driven_any_min1.6995951815477424
driven_lanedir_consec_max14.280914991766174
driven_lanedir_consec_mean5.128777261762024
driven_lanedir_consec_min0.11132592592015844
driven_lanedir_max14.525746620743494
driven_lanedir_mean6.004560339162782
driven_lanedir_median4.6905844049937375
driven_lanedir_min0.11132592592015844
get_duckie_state_max1.9021656202233357e-06
get_duckie_state_mean1.8636141332518904e-06
get_duckie_state_median1.8622737420756743e-06
get_duckie_state_min1.8277434286328777e-06
get_robot_state_max0.0037592269372248993
get_robot_state_mean0.0036920580111095658
get_robot_state_median0.003688363618279351
get_robot_state_min0.0036322778706546622
get_state_dump_max0.0047620301661284075
get_state_dump_mean0.004652776098787451
get_state_dump_median0.0046281623154985525
get_state_dump_min0.004592749598024291
get_ui_image_max0.03515358153826787
get_ui_image_mean0.030576550954200497
get_ui_image_median0.03001219874551467
get_ui_image_min0.027128224787504776
in-drivable-lane_max12.35000000000006
in-drivable-lane_mean10.537499999999875
in-drivable-lane_min8.400000000000016
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 17.826805572625638, "get_ui_image": 0.02774276364157341, "step_physics": 0.1225362127766224, "survival_time": 59.99999999999873, "driven_lanedir": 14.525746620743494, "get_state_dump": 0.004592749598024291, "get_robot_state": 0.0036322778706546622, "sim_render-ego0": 0.00365176208807368, "get_duckie_state": 1.882931076418252e-06, "in-drivable-lane": 10.749999999999648, "deviation-heading": 14.968975714154242, "agent_compute-ego0": 0.012128965542973527, "complete-iteration": 0.18770671426803243, "set_robot_commands": 0.002114266976031733, "deviation-center-line": 4.17469418711152, "driven_lanedir_consec": 14.280914991766174, "sim_compute_sim_state": 0.00929995659090498, "sim_compute_performance-ego0": 0.001924836169075311}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.67529486924557, "get_ui_image": 0.03515358153826787, "step_physics": 0.13635979842186768, "survival_time": 59.99999999999873, "driven_lanedir": 8.827996385009971, "get_state_dump": 0.0046050945586904105, "get_robot_state": 0.003644531712146921, "sim_render-ego0": 0.003697016157774405, "get_duckie_state": 1.8277434286328777e-06, "in-drivable-lane": 10.649999999999777, "deviation-heading": 15.591283674524092, "agent_compute-ego0": 0.011992778706610151, "complete-iteration": 0.21083196791681424, "set_robot_commands": 0.00210155277426892, "deviation-center-line": 4.367551585062542, "driven_lanedir_consec": 5.577434721736097, "sim_compute_sim_state": 0.011235194837520958, "sim_compute_performance-ego0": 0.0019596738680316248}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.6995951815477424, "get_ui_image": 0.03228163384945593, "step_physics": 0.13331385862047426, "survival_time": 10.650000000000016, "driven_lanedir": 0.5531724249775042, "get_state_dump": 0.0046512300723066955, "get_robot_state": 0.0037321955244117807, "sim_render-ego0": 0.0038035528682102662, "get_duckie_state": 1.8416164077330973e-06, "in-drivable-lane": 8.400000000000016, "deviation-heading": 0.895281444475679, "agent_compute-ego0": 0.01291346327166691, "complete-iteration": 0.2032708274983914, "set_robot_commands": 0.0022204111669665186, "deviation-center-line": 0.15468429336948347, "driven_lanedir_consec": 0.5454334076256656, "sim_compute_sim_state": 0.008284864024581196, "sim_compute_performance-ego0": 0.0019851410500357084}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8881410371464045, "get_ui_image": 0.027128224787504776, "step_physics": 0.10710737411526666, "survival_time": 13.75000000000006, "driven_lanedir": 0.11132592592015844, "get_state_dump": 0.0047620301661284075, "get_robot_state": 0.0037592269372248993, "sim_render-ego0": 0.003853099933568982, "get_duckie_state": 1.9021656202233357e-06, "in-drivable-lane": 12.35000000000006, "deviation-heading": 0.8975702222878674, "agent_compute-ego0": 0.01251393211060676, "complete-iteration": 0.16875691776690277, "set_robot_commands": 0.002281616563382356, "deviation-center-line": 0.09170553005896714, "driven_lanedir_consec": 0.11132592592015844, "sim_compute_sim_state": 0.005269232867420584, "sim_compute_performance-ego0": 0.0019951877386673636}}
set_robot_commands_max0.002281616563382356
set_robot_commands_mean0.002179461870162382
set_robot_commands_median0.002167339071499126
set_robot_commands_min0.00210155277426892
sim_compute_performance-ego0_max0.0019951877386673636
sim_compute_performance-ego0_mean0.001966209706452502
sim_compute_performance-ego0_median0.001972407459033667
sim_compute_performance-ego0_min0.001924836169075311
sim_compute_sim_state_max0.011235194837520958
sim_compute_sim_state_mean0.00852231208010693
sim_compute_sim_state_median0.008792410307743088
sim_compute_sim_state_min0.005269232867420584
sim_render-ego0_max0.003853099933568982
sim_render-ego0_mean0.003751357761906833
sim_render-ego0_median0.003750284512992336
sim_render-ego0_min0.00365176208807368
simulation-passed1
step_physics_max0.13635979842186768
step_physics_mean0.12482931098355776
step_physics_median0.12792503569854835
step_physics_min0.10710737411526666
survival_time_max59.99999999999873
survival_time_mean36.09999999999938
survival_time_min10.650000000000016
No reset possible
5426411609Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:37:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.993826419774638
survival_time_median59.99999999999873
deviation-center-line_median3.7040799656238974
in-drivable-lane_median5.249999999999957


other stats
agent_compute-ego0_max0.012359680085257629
agent_compute-ego0_mean0.011933855271954818
agent_compute-ego0_median0.0118878637126443
agent_compute-ego0_min0.011600013577273048
complete-iteration_max0.23194793439923872
complete-iteration_mean0.20676607826568008
complete-iteration_median0.2061713917070781
complete-iteration_min0.18277359524932532
deviation-center-line_max4.053051332055755
deviation-center-line_mean3.734912071863428
deviation-center-line_min3.4784370241501645
deviation-heading_max17.556629761282167
deviation-heading_mean16.996072585927106
deviation-heading_median17.08696589790685
deviation-heading_min16.253728786612555
driven_any_max12.456377619150649
driven_any_mean12.138403065837265
driven_any_median12.17392782214001
driven_any_min11.749378999918385
driven_lanedir_consec_max11.071105884668688
driven_lanedir_consec_mean8.58477736247021
driven_lanedir_consec_min3.2803507256628732
driven_lanedir_max11.071105884668688
driven_lanedir_mean10.155745041961373
driven_lanedir_median10.316534557247298
driven_lanedir_min8.918805168682205
get_duckie_state_max1.3564647385520203e-06
get_duckie_state_mean1.2963638019799988e-06
get_duckie_state_median1.3203346957572793e-06
get_duckie_state_min1.1883210778534164e-06
get_robot_state_max0.00384251164159211
get_robot_state_mean0.003720794043671976
get_robot_state_median0.003741284095675225
get_robot_state_min0.003558096341745343
get_state_dump_max0.0048423266033645876
get_state_dump_mean0.004751697517652297
get_state_dump_median0.004743661908285505
get_state_dump_min0.0046771396506735926
get_ui_image_max0.03475341808786003
get_ui_image_mean0.030338591034465987
get_ui_image_median0.030105350317307857
get_ui_image_min0.0263902454153882
in-drivable-lane_max11.59999999999934
in-drivable-lane_mean6.1499999999997845
in-drivable-lane_min2.4999999999998828
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.28195426510724, "get_ui_image": 0.02814648292344575, "step_physics": 0.12924830443059077, "survival_time": 59.99999999999873, "driven_lanedir": 11.06884767086707, "get_state_dump": 0.0046771396506735926, "get_robot_state": 0.003723181256842951, "sim_render-ego0": 0.003700155302646456, "get_duckie_state": 1.3447522521515277e-06, "in-drivable-lane": 2.4999999999998828, "deviation-heading": 17.424442577345317, "agent_compute-ego0": 0.012021306948697538, "complete-iteration": 0.1952251558200604, "set_robot_commands": 0.0022068339323223283, "deviation-center-line": 3.4784370241501645, "driven_lanedir_consec": 11.06884767086707, "sim_compute_sim_state": 0.009429584633400797, "sim_compute_performance-ego0": 0.0019803473991120884}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.06590137917278, "get_ui_image": 0.03475341808786003, "step_physics": 0.1554904109135357, "survival_time": 59.99999999999873, "driven_lanedir": 8.918805168682205, "get_state_dump": 0.0048423266033645876, "get_robot_state": 0.003558096341745343, "sim_render-ego0": 0.003663637755216905, "get_duckie_state": 1.1883210778534164e-06, "in-drivable-lane": 11.59999999999934, "deviation-heading": 16.253728786612555, "agent_compute-ego0": 0.011754420476591062, "complete-iteration": 0.23194793439923872, "set_robot_commands": 0.002188018319211733, "deviation-center-line": 3.5441261237792157, "driven_lanedir_consec": 8.918805168682205, "sim_compute_sim_state": 0.013626955430970204, "sim_compute_performance-ego0": 0.0019833223706578135}, "LF-norm-techtrack-000-ego0": {"driven_any": 12.456377619150649, "get_ui_image": 0.032064217711169955, "step_physics": 0.14319847962143617, "survival_time": 59.99999999999873, "driven_lanedir": 11.071105884668688, "get_state_dump": 0.004798328350426057, "get_robot_state": 0.00384251164159211, "sim_render-ego0": 0.003815248149519261, "get_duckie_state": 1.3564647385520203e-06, "in-drivable-lane": 2.799999999999841, "deviation-heading": 16.749489218468387, "agent_compute-ego0": 0.012359680085257629, "complete-iteration": 0.21711762759409575, "set_robot_commands": 0.0023123910286146636, "deviation-center-line": 4.053051332055755, "driven_lanedir_consec": 11.071105884668688, "sim_compute_sim_state": 0.012554815865674682, "sim_compute_performance-ego0": 0.002073766984709296}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.749378999918385, "get_ui_image": 0.0263902454153882, "step_physics": 0.12200395669865668, "survival_time": 59.99999999999873, "driven_lanedir": 9.564221443627527, "get_state_dump": 0.004688995466144952, "get_robot_state": 0.0037593869345074983, "sim_render-ego0": 0.003814390954328119, "get_duckie_state": 1.2959171393630309e-06, "in-drivable-lane": 7.700000000000074, "deviation-heading": 17.556629761282167, "agent_compute-ego0": 0.011600013577273048, "complete-iteration": 0.18277359524932532, "set_robot_commands": 0.0022580240489441985, "deviation-center-line": 3.8640338074685783, "driven_lanedir_consec": 3.2803507256628732, "sim_compute_sim_state": 0.006163777161597411, "sim_compute_performance-ego0": 0.0020053003550965422}}
set_robot_commands_max0.0023123910286146636
set_robot_commands_mean0.002241316832273231
set_robot_commands_median0.0022324289906332636
set_robot_commands_min0.002188018319211733
sim_compute_performance-ego0_max0.002073766984709296
sim_compute_performance-ego0_mean0.002010684277393934
sim_compute_performance-ego0_median0.001994311362877178
sim_compute_performance-ego0_min0.0019803473991120884
sim_compute_sim_state_max0.013626955430970204
sim_compute_sim_state_mean0.010443783272910772
sim_compute_sim_state_median0.010992200249537738
sim_compute_sim_state_min0.006163777161597411
sim_render-ego0_max0.003815248149519261
sim_render-ego0_mean0.0037483580404276858
sim_render-ego0_median0.003757273128487287
sim_render-ego0_min0.003663637755216905
simulation-passed1
step_physics_max0.1554904109135357
step_physics_mean0.13748528791605483
step_physics_median0.13622339202601347
step_physics_min0.12200395669865668
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5420311632Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:17:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9498442288890112
survival_time_median24.10000000000001
deviation-center-line_median1.0193370548384688
in-drivable-lane_median5.5249999999999915


other stats
agent_compute-ego0_max0.012687220751682174
agent_compute-ego0_mean0.012406894437849142
agent_compute-ego0_median0.012355836864203884
agent_compute-ego0_min0.012228683271306629
complete-iteration_max0.25049626270187236
complete-iteration_mean0.22565577734677833
complete-iteration_median0.2262338965771608
complete-iteration_min0.19965905353091937
deviation-center-line_max1.9858224336242607
deviation-center-line_mean1.0447512366598264
deviation-center-line_min0.15450840333810711
deviation-heading_max10.068534275366934
deviation-heading_mean5.252190146980613
deviation-heading_median4.681586442824552
deviation-heading_min1.5770534269064125
driven_any_max7.919985742354164
driven_any_mean3.720150232663293
driven_any_median3.0581289010414836
driven_any_min0.8443573862160387
driven_lanedir_consec_max2.5089059004238425
driven_lanedir_consec_mean1.1948825286512004
driven_lanedir_consec_min0.37093575640293586
driven_lanedir_max4.167445901180306
driven_lanedir_mean1.7645301935879978
driven_lanedir_median1.2598695583843746
driven_lanedir_min0.37093575640293586
get_duckie_state_max2.1413998441037092e-06
get_duckie_state_mean2.0417840402189472e-06
get_duckie_state_median2.070394714823488e-06
get_duckie_state_min1.884946887125105e-06
get_robot_state_max0.003699421248537429
get_robot_state_mean0.0036490070215994454
get_robot_state_median0.003662371447681012
get_robot_state_min0.0035718639424983287
get_state_dump_max0.004620239002122967
get_state_dump_mean0.0045650429022028385
get_state_dump_median0.004558254856313287
get_state_dump_min0.004523422894061812
get_ui_image_max0.03472338106808246
get_ui_image_mean0.030339902776768297
get_ui_image_median0.030084222592198603
get_ui_image_min0.02646778485459352
in-drivable-lane_max40.3499999999989
in-drivable-lane_mean13.624999999999718
in-drivable-lane_min3.099999999999989
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.847127716194219, "get_ui_image": 0.028855404638229533, "step_physics": 0.14151229725239126, "survival_time": 37.55, "driven_lanedir": 4.167445901180306, "get_state_dump": 0.004564885129319861, "get_robot_state": 0.003699421248537429, "sim_render-ego0": 0.003797371653800315, "get_duckie_state": 2.07189549791052e-06, "in-drivable-lane": 4.299999999999962, "deviation-heading": 7.584328298484033, "agent_compute-ego0": 0.012228683271306629, "complete-iteration": 0.20833496876219484, "set_robot_commands": 0.0022803881066910765, "deviation-center-line": 1.9858224336242607, "driven_lanedir_consec": 2.5089059004238425, "sim_compute_sim_state": 0.00928726411880331, "sim_compute_performance-ego0": 0.0020255129388038148}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.8443573862160387, "get_ui_image": 0.03472338106808246, "step_physics": 0.17074702730114827, "survival_time": 7.399999999999982, "driven_lanedir": 0.466690016473708, "get_state_dump": 0.004523422894061812, "get_robot_state": 0.0035718639424983287, "sim_render-ego0": 0.003621299794856334, "get_duckie_state": 1.884946887125105e-06, "in-drivable-lane": 3.099999999999989, "deviation-heading": 1.5770534269064125, "agent_compute-ego0": 0.012248082448972152, "complete-iteration": 0.24413282439212672, "set_robot_commands": 0.0022251766000018023, "deviation-center-line": 0.15450840333810711, "driven_lanedir_consec": 0.466690016473708, "sim_compute_sim_state": 0.01051373129723056, "sim_compute_performance-ego0": 0.0018776055150384072}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.269130085888748, "get_ui_image": 0.031313040546167674, "step_physics": 0.1811982215007889, "survival_time": 10.650000000000016, "driven_lanedir": 0.37093575640293586, "get_state_dump": 0.0045516245833067135, "get_robot_state": 0.003682586634270499, "sim_render-ego0": 0.003744161017587252, "get_duckie_state": 2.068893931736456e-06, "in-drivable-lane": 6.750000000000022, "deviation-heading": 1.7788445871650722, "agent_compute-ego0": 0.012687220751682174, "complete-iteration": 0.25049626270187236, "set_robot_commands": 0.002206763374471219, "deviation-center-line": 0.16464007821411605, "driven_lanedir_consec": 0.37093575640293586, "sim_compute_sim_state": 0.009048815085509114, "sim_compute_performance-ego0": 0.0019790045568876175}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.919985742354164, "get_ui_image": 0.02646778485459352, "step_physics": 0.1382263923664077, "survival_time": 59.99999999999873, "driven_lanedir": 2.0530491002950413, "get_state_dump": 0.004620239002122967, "get_robot_state": 0.003642156261091526, "sim_render-ego0": 0.0037458651667332072, "get_duckie_state": 2.1413998441037092e-06, "in-drivable-lane": 40.3499999999989, "deviation-heading": 10.068534275366934, "agent_compute-ego0": 0.012463591279435617, "complete-iteration": 0.19965905353091937, "set_robot_commands": 0.0021918524711157855, "deviation-center-line": 1.8740340314628217, "driven_lanedir_consec": 1.4329984413043146, "sim_compute_sim_state": 0.006273297445660924, "sim_compute_performance-ego0": 0.0019435785295167235}}
set_robot_commands_max0.0022803881066910765
set_robot_commands_mean0.0022260451380699707
set_robot_commands_median0.0022159699872365103
set_robot_commands_min0.0021918524711157855
sim_compute_performance-ego0_max0.0020255129388038148
sim_compute_performance-ego0_mean0.001956425385061641
sim_compute_performance-ego0_median0.0019612915432021703
sim_compute_performance-ego0_min0.0018776055150384072
sim_compute_sim_state_max0.01051373129723056
sim_compute_sim_state_mean0.008780776986800977
sim_compute_sim_state_median0.009168039602156211
sim_compute_sim_state_min0.006273297445660924
sim_render-ego0_max0.003797371653800315
sim_render-ego0_mean0.0037271744082442776
sim_render-ego0_median0.0037450130921602297
sim_render-ego0_min0.003621299794856334
simulation-passed1
step_physics_max0.1811982215007889
step_physics_mean0.15792098460518403
step_physics_median0.15612966227676978
step_physics_min0.1382263923664077
survival_time_max59.99999999999873
survival_time_mean28.89999999999968
survival_time_min7.399999999999982
No reset possible
5414311650Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:24:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.395397614713782
survival_time_median33.65000000000014
deviation-center-line_median0.9547754197006124
in-drivable-lane_median19.07499999999973


other stats
agent_compute-ego0_max0.013253329980252969
agent_compute-ego0_mean0.01296570346542608
agent_compute-ego0_median0.013015140772421156
agent_compute-ego0_min0.012579202336609047
complete-iteration_max0.22871336936950684
complete-iteration_mean0.20362583692731445
complete-iteration_median0.20592928327251847
complete-iteration_min0.17393141179471402
deviation-center-line_max3.4320981389804843
deviation-center-line_mean1.365382107581564
deviation-center-line_min0.11987945194454697
deviation-heading_max12.744702381046904
deviation-heading_mean5.067366691204627
deviation-heading_median3.396978178809034
deviation-heading_min0.7308080261535341
driven_any_max11.528730341013798
driven_any_mean7.197107396669091
driven_any_median6.652331512889855
driven_any_min3.955036219882856
driven_lanedir_consec_max8.222422165580886
driven_lanedir_consec_mean3.9216598036871866
driven_lanedir_consec_min0.6734218197402968
driven_lanedir_max8.222422165580886
driven_lanedir_mean3.9216598036871866
driven_lanedir_median3.395397614713782
driven_lanedir_min0.6734218197402968
get_duckie_state_max2.316754273693971e-06
get_duckie_state_mean2.294124059077944e-06
get_duckie_state_median2.3105344631872035e-06
get_duckie_state_min2.2386730362433973e-06
get_robot_state_max0.003927636869025953
get_robot_state_mean0.003885814761656815
get_robot_state_median0.003886432342566103
get_robot_state_min0.0038427574924691016
get_state_dump_max0.005105276290423467
get_state_dump_mean0.004971285180678834
get_state_dump_median0.005023898053134846
get_state_dump_min0.0047320683260221735
get_ui_image_max0.0370855422738589
get_ui_image_mean0.03190220002004223
get_ui_image_median0.031493199614162
get_ui_image_min0.02753685857798602
in-drivable-lane_max26.500000000000288
in-drivable-lane_mean18.83749999999987
in-drivable-lane_min10.699999999999743
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.921532157302704, "get_ui_image": 0.028548825670171668, "step_physics": 0.11660712295108372, "survival_time": 37.74999999999999, "driven_lanedir": 6.115983790340672, "get_state_dump": 0.0049573807489304315, "get_robot_state": 0.0038427574924691016, "sim_render-ego0": 0.003927215697273376, "get_duckie_state": 2.312597143586981e-06, "in-drivable-lane": 10.699999999999743, "deviation-heading": 6.004835707350993, "agent_compute-ego0": 0.012579202336609047, "complete-iteration": 0.1847796288747636, "set_robot_commands": 0.0022667744172313225, "deviation-center-line": 1.7667155876748808, "driven_lanedir_consec": 6.115983790340672, "sim_compute_sim_state": 0.00983834771252183, "sim_compute_performance-ego0": 0.002116363515298833}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.528730341013798, "get_ui_image": 0.0370855422738589, "step_physics": 0.14533148975197618, "survival_time": 59.99999999999873, "driven_lanedir": 8.222422165580886, "get_state_dump": 0.005105276290423467, "get_robot_state": 0.0039118344738124115, "sim_render-ego0": 0.003950082888511893, "get_duckie_state": 2.2386730362433973e-06, "in-drivable-lane": 16.449999999999232, "deviation-heading": 12.744702381046904, "agent_compute-ego0": 0.01290309875831318, "complete-iteration": 0.22707893767027337, "set_robot_commands": 0.0022694060050081353, "deviation-center-line": 3.4320981389804843, "driven_lanedir_consec": 8.222422165580886, "sim_compute_sim_state": 0.014213939590517626, "sim_compute_performance-ego0": 0.002210701435035115}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.955036219882856, "get_ui_image": 0.03443757355815232, "step_physics": 0.15185275752134997, "survival_time": 24.700000000000216, "driven_lanedir": 0.6734218197402968, "get_state_dump": 0.0050904153573392615, "get_robot_state": 0.003927636869025953, "sim_render-ego0": 0.004093742852259164, "get_duckie_state": 2.316754273693971e-06, "in-drivable-lane": 21.70000000000022, "deviation-heading": 0.7308080261535341, "agent_compute-ego0": 0.013253329980252969, "complete-iteration": 0.22871336936950684, "set_robot_commands": 0.0023212837450432055, "deviation-center-line": 0.1428352517263441, "driven_lanedir_consec": 0.6734218197402968, "sim_compute_sim_state": 0.011442042842055812, "sim_compute_performance-ego0": 0.002194528387050436}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.383130868477005, "get_ui_image": 0.02753685857798602, "step_physics": 0.10959074626097808, "survival_time": 29.550000000000285, "driven_lanedir": 0.6748114390868918, "get_state_dump": 0.0047320683260221735, "get_robot_state": 0.0038610302113197942, "sim_render-ego0": 0.003937678965362343, "get_duckie_state": 2.308471782787426e-06, "in-drivable-lane": 26.500000000000288, "deviation-heading": 0.7891206502670758, "agent_compute-ego0": 0.01312718278652913, "complete-iteration": 0.17393141179471402, "set_robot_commands": 0.002360443811158876, "deviation-center-line": 0.11987945194454697, "driven_lanedir_consec": 0.6748114390868918, "sim_compute_sim_state": 0.006604897814827996, "sim_compute_performance-ego0": 0.002091433550860431}}
set_robot_commands_max0.002360443811158876
set_robot_commands_mean0.0023044769946103847
set_robot_commands_median0.0022953448750256704
set_robot_commands_min0.0022667744172313225
sim_compute_performance-ego0_max0.002210701435035115
sim_compute_performance-ego0_mean0.0021532567220612035
sim_compute_performance-ego0_median0.0021554459511746345
sim_compute_performance-ego0_min0.002091433550860431
sim_compute_sim_state_max0.014213939590517626
sim_compute_sim_state_mean0.010524806989980815
sim_compute_sim_state_median0.010640195277288822
sim_compute_sim_state_min0.006604897814827996
sim_render-ego0_max0.004093742852259164
sim_render-ego0_mean0.003977180100851694
sim_render-ego0_median0.003943880926937118
sim_render-ego0_min0.003927215697273376
simulation-passed1
step_physics_max0.15185275752134997
step_physics_mean0.13084552912134698
step_physics_median0.13096930635152995
step_physics_min0.10959074626097808
survival_time_max59.99999999999873
survival_time_mean37.99999999999981
survival_time_min24.700000000000216
No reset possible
5406611677Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:27:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.714012509869949
survival_time_median45.049999999999514
deviation-center-line_median2.6274719805104243
in-drivable-lane_median13.799999999999848


other stats
agent_compute-ego0_max0.012926517236687453
agent_compute-ego0_mean0.012259341206164516
agent_compute-ego0_median0.012056066516478014
agent_compute-ego0_min0.01199871455501458
complete-iteration_max0.23682213738980776
complete-iteration_mean0.2096073520008089
complete-iteration_median0.21144714866223907
complete-iteration_min0.17871297328894978
deviation-center-line_max4.08839900910265
deviation-center-line_mean2.740582389663242
deviation-center-line_min1.6189865885294692
deviation-heading_max18.30388465505664
deviation-heading_mean12.031210093339435
deviation-heading_median10.55907531093908
deviation-heading_min8.702805096422946
driven_any_max18.164477775815666
driven_any_mean12.9454040349516
driven_any_median12.94144116682174
driven_any_min7.734256030347257
driven_lanedir_consec_max7.7108647191443
driven_lanedir_consec_mean4.981581842130219
driven_lanedir_consec_min2.7874376296366794
driven_lanedir_max10.444642149528644
driven_lanedir_mean7.634924914693509
driven_lanedir_median7.923577000801656
driven_lanedir_min4.247903507642084
get_duckie_state_max1.3979547327503773e-06
get_duckie_state_mean1.35143293204475e-06
get_duckie_state_median1.3530514356123355e-06
get_duckie_state_min1.301674124203951e-06
get_robot_state_max0.003889557931751359
get_robot_state_mean0.0037765126283863535
get_robot_state_median0.003777369970668735
get_robot_state_min0.0036617526404565818
get_state_dump_max0.004883432862770498
get_state_dump_mean0.0047351653807227246
get_state_dump_median0.004713066290068808
get_state_dump_min0.004631096079982786
get_ui_image_max0.034841916652065805
get_ui_image_mean0.03109775680359711
get_ui_image_median0.03145429785763974
get_ui_image_min0.026640514847043155
in-drivable-lane_max22.69999999999956
in-drivable-lane_mean14.212499999999835
in-drivable-lane_min6.550000000000081
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 18.164477775815666, "get_ui_image": 0.028304212198567137, "step_physics": 0.12284756619964016, "survival_time": 59.99999999999873, "driven_lanedir": 10.10070100034224, "get_state_dump": 0.004631096079982786, "get_robot_state": 0.0036617526404565818, "sim_render-ego0": 0.003751150277333891, "get_duckie_state": 1.301674124203951e-06, "in-drivable-lane": 22.69999999999956, "deviation-heading": 12.10774104924549, "agent_compute-ego0": 0.01199871455501458, "complete-iteration": 0.1883532353781542, "set_robot_commands": 0.002242640392865666, "deviation-center-line": 3.4023058947404654, "driven_lanedir_consec": 7.7108647191443, "sim_compute_sim_state": 0.008823408473044213, "sim_compute_performance-ego0": 0.0020073575838519373}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.734256030347257, "get_ui_image": 0.03460438351671235, "step_physics": 0.15839505836743267, "survival_time": 29.700000000000287, "driven_lanedir": 4.247903507642084, "get_state_dump": 0.0047315417217607255, "get_robot_state": 0.003757433931366736, "sim_render-ego0": 0.003705980397072159, "get_duckie_state": 1.3167116822314863e-06, "in-drivable-lane": 10.450000000000124, "deviation-heading": 8.702805096422946, "agent_compute-ego0": 0.012015599563342182, "complete-iteration": 0.23454106194632393, "set_robot_commands": 0.002166899512795841, "deviation-center-line": 1.6189865885294692, "driven_lanedir_consec": 3.049322386503147, "sim_compute_sim_state": 0.013083249580960314, "sim_compute_performance-ego0": 0.001993664172517151}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.886522363708078, "get_ui_image": 0.034841916652065805, "step_physics": 0.16046726011715917, "survival_time": 30.100000000000293, "driven_lanedir": 5.746453001261069, "get_state_dump": 0.004883432862770498, "get_robot_state": 0.003889557931751359, "sim_render-ego0": 0.003926740159245075, "get_duckie_state": 1.389391188993185e-06, "in-drivable-lane": 6.550000000000081, "deviation-heading": 9.01040957263267, "agent_compute-ego0": 0.012926517236687453, "complete-iteration": 0.23682213738980776, "set_robot_commands": 0.002374918702032238, "deviation-center-line": 1.8526380662803832, "driven_lanedir_consec": 2.7874376296366794, "sim_compute_sim_state": 0.01125143614179064, "sim_compute_performance-ego0": 0.0021688376690815535}, "LF-norm-small_loop-000-ego0": {"driven_any": 17.9963599699354, "get_ui_image": 0.026640514847043155, "step_physics": 0.11689872447894475, "survival_time": 59.99999999999873, "driven_lanedir": 10.444642149528644, "get_state_dump": 0.00469459085837689, "get_robot_state": 0.003797306009970735, "sim_render-ego0": 0.003856312325356108, "get_duckie_state": 1.3979547327503773e-06, "in-drivable-lane": 17.149999999999572, "deviation-heading": 18.30388465505664, "agent_compute-ego0": 0.012096533469613844, "complete-iteration": 0.17871297328894978, "set_robot_commands": 0.0023116485760869034, "deviation-center-line": 4.08839900910265, "driven_lanedir_consec": 6.378702633236752, "sim_compute_sim_state": 0.0062901396040713955, "sim_compute_performance-ego0": 0.0020408920205502983}}
set_robot_commands_max0.002374918702032238
set_robot_commands_mean0.002274026795945162
set_robot_commands_median0.0022771444844762847
set_robot_commands_min0.002166899512795841
sim_compute_performance-ego0_max0.0021688376690815535
sim_compute_performance-ego0_mean0.002052687861500235
sim_compute_performance-ego0_median0.0020241248022011176
sim_compute_performance-ego0_min0.001993664172517151
sim_compute_sim_state_max0.013083249580960314
sim_compute_sim_state_mean0.00986205844996664
sim_compute_sim_state_median0.010037422307417426
sim_compute_sim_state_min0.0062901396040713955
sim_render-ego0_max0.003926740159245075
sim_render-ego0_mean0.003810045789751808
sim_render-ego0_median0.003803731301345
sim_render-ego0_min0.003705980397072159
simulation-passed1
step_physics_max0.16046726011715917
step_physics_mean0.1396521522907942
step_physics_median0.1406213122835364
step_physics_min0.11689872447894475
survival_time_max59.99999999999873
survival_time_mean44.94999999999951
survival_time_min29.700000000000287
No reset possible
5396111314Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:47:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3307258136570805
survival_time_median59.99999999999873
deviation-center-line_median1.1505637429024578
in-drivable-lane_median46.69999999999865


other stats
agent_compute-ego0_max0.06727865038068964
agent_compute-ego0_mean0.06345351441118938
agent_compute-ego0_median0.06399221404406749
agent_compute-ego0_min0.058550979175932896
complete-iteration_max0.37611720623521383
complete-iteration_mean0.33181089068531094
complete-iteration_median0.33919363593578733
complete-iteration_min0.27273908463445534
deviation-center-line_max10.278078473321797
deviation-center-line_mean3.2052091982888027
deviation-center-line_min0.24163083402849952
deviation-heading_max16.409868355895316
deviation-heading_mean7.358209012688837
deviation-heading_median5.877991484529253
deviation-heading_min1.2669847258015268
driven_any_max5.629267400776786
driven_any_mean3.1846305211608534
driven_any_median2.9997082193288076
driven_any_min1.1098382452090136
driven_lanedir_consec_max4.465989306447652
driven_lanedir_consec_mean2.5422020170776207
driven_lanedir_consec_min1.0413671345486706
driven_lanedir_max4.465989306447652
driven_lanedir_mean2.546221054280518
driven_lanedir_median2.338763888062875
driven_lanedir_min1.0413671345486706
get_duckie_state_max1.3487225865245758e-06
get_duckie_state_mean1.328672397940681e-06
get_duckie_state_median1.3266872307541566e-06
get_duckie_state_min1.3125925437298346e-06
get_robot_state_max0.0037731772954021263
get_robot_state_mean0.0036573056674420487
get_robot_state_median0.003626912460041285
get_robot_state_min0.003602220454283499
get_state_dump_max0.004753873310517908
get_state_dump_mean0.00465062357404647
get_state_dump_median0.004665928021954259
get_state_dump_min0.004516764941759451
get_ui_image_max0.03503699187533643
get_ui_image_mean0.03021908421798312
get_ui_image_median0.030120998000622193
get_ui_image_min0.02559734899535167
in-drivable-lane_max55.999999999998735
in-drivable-lane_mean37.62499999999901
in-drivable-lane_min1.1000000000000003
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.947182337995686, "get_ui_image": 0.02751688536358912, "step_physics": 0.19533332678598728, "survival_time": 59.99999999999873, "driven_lanedir": 1.449445712063376, "get_state_dump": 0.004516764941759451, "get_robot_state": 0.003602220454283499, "sim_render-ego0": 0.003699866659337535, "get_duckie_state": 1.3125925437298346e-06, "in-drivable-lane": 1.1000000000000003, "deviation-heading": 16.409868355895316, "agent_compute-ego0": 0.0653919445088662, "complete-iteration": 0.314994802681433, "set_robot_commands": 0.002132028068332847, "deviation-center-line": 10.278078473321797, "driven_lanedir_consec": 1.449445712063376, "sim_compute_sim_state": 0.01077412983261477, "sim_compute_performance-ego0": 0.00193970467426894}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.629267400776786, "get_ui_image": 0.03503699187533643, "step_physics": 0.24448661363492105, "survival_time": 59.99999999999873, "driven_lanedir": 4.465989306447652, "get_state_dump": 0.004650515580951522, "get_robot_state": 0.003630798722583984, "sim_render-ego0": 0.003792278574070863, "get_duckie_state": 1.3316501487204673e-06, "in-drivable-lane": 43.949999999998624, "deviation-heading": 7.788432576082212, "agent_compute-ego0": 0.06727865038068964, "complete-iteration": 0.37611720623521383, "set_robot_commands": 0.002188826877806804, "deviation-center-line": 1.5074359800714987, "driven_lanedir_consec": 4.465989306447652, "sim_compute_sim_state": 0.012963541342158004, "sim_compute_performance-ego0": 0.0019961511165672895}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.1098382452090136, "get_ui_image": 0.032725110637655264, "step_physics": 0.2447782128577824, "survival_time": 59.99999999999873, "driven_lanedir": 1.0413671345486706, "get_state_dump": 0.004753873310517908, "get_robot_state": 0.0037731772954021263, "sim_render-ego0": 0.003998326222962086, "get_duckie_state": 1.3487225865245758e-06, "in-drivable-lane": 55.999999999998735, "deviation-heading": 1.2669847258015268, "agent_compute-ego0": 0.058550979175932896, "complete-iteration": 0.3633924691901418, "set_robot_commands": 0.00228949450731873, "deviation-center-line": 0.24163083402849952, "driven_lanedir_consec": 1.0413671345486706, "sim_compute_sim_state": 0.01037564523809657, "sim_compute_performance-ego0": 0.0020501826029832317}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.052234100661929, "get_ui_image": 0.02559734899535167, "step_physics": 0.16172338504775377, "survival_time": 59.99999999999873, "driven_lanedir": 3.2280820640623737, "get_state_dump": 0.0046813404629569965, "get_robot_state": 0.0036230261974985857, "sim_render-ego0": 0.0037777402021803527, "get_duckie_state": 1.321724312787846e-06, "in-drivable-lane": 49.44999999999868, "deviation-heading": 3.967550392976293, "agent_compute-ego0": 0.06259248357926876, "complete-iteration": 0.27273908463445534, "set_robot_commands": 0.002174347663898452, "deviation-center-line": 0.7936915057334168, "driven_lanedir_consec": 3.2120059152507854, "sim_compute_sim_state": 0.006545875987641321, "sim_compute_performance-ego0": 0.0019342647206277077}}
set_robot_commands_max0.00228949450731873
set_robot_commands_mean0.0021961742793392084
set_robot_commands_median0.002181587270852628
set_robot_commands_min0.002132028068332847
sim_compute_performance-ego0_max0.0020501826029832317
sim_compute_performance-ego0_mean0.001980075778611792
sim_compute_performance-ego0_median0.001967927895418115
sim_compute_performance-ego0_min0.0019342647206277077
sim_compute_sim_state_max0.012963541342158004
sim_compute_sim_state_mean0.010164798100127666
sim_compute_sim_state_median0.01057488753535567
sim_compute_sim_state_min0.006545875987641321
sim_render-ego0_max0.003998326222962086
sim_render-ego0_mean0.00381705291463771
sim_render-ego0_median0.003785009388125608
sim_render-ego0_min0.003699866659337535
simulation-passed1
step_physics_max0.2447782128577824
step_physics_mean0.2115803845816111
step_physics_median0.21990997021045416
step_physics_min0.16172338504775377
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5393211716Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerroryesnogpu-prod-070:06:05
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible