Duckietown Challenges Home Challenges Submissions

Evaluator 4899

ID4899
evaluatornogpu-prod-04
ownerI don't have one 😀
machinenogpu-prod_c5a38529fe07
processnogpu-prod-04_c5a38529fe07
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success19 53954
# timeout1 57561
# failed8 54636
# error
# aborted2 57531
# host-error40 53936
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5756110893Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutyesnogpu-prod-04----No reset possible
5754511010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-040:03:00
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5753111012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-040:02:14
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5747510919Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:13:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0205158783526302
survival_time_median9.374999999999998
deviation-center-line_median0.3959608457174308
in-drivable-lane_median4.950000000000007


other stats
agent_compute-ego0_max0.03808654515967579
agent_compute-ego0_mean0.022715707526345615
agent_compute-ego0_median0.020336190284188115
agent_compute-ego0_min0.012103904377330431
complete-iteration_max0.25623914480209353
complete-iteration_mean0.20866116530570572
complete-iteration_median0.20377537508011773
complete-iteration_min0.1708547662604939
deviation-center-line_max2.9429110939472567
deviation-center-line_mean0.966230480907686
deviation-center-line_min0.1300891382486256
deviation-heading_max14.848183249575785
deviation-heading_mean4.753725676190616
deviation-heading_median1.566921267916356
deviation-heading_min1.0328769193539653
driven_any_max13.253724983973957
driven_any_mean4.42288344767309
driven_any_median1.8820778836877805
driven_any_min0.6736530393428456
driven_lanedir_consec_max10.06228504916547
driven_lanedir_consec_mean3.08845630991674
driven_lanedir_consec_min0.2505084337962318
driven_lanedir_max10.062243453410844
driven_lanedir_mean3.088445910978084
driven_lanedir_median1.0205158783526302
driven_lanedir_min0.2505084337962318
get_duckie_state_max1.4142556623979048e-06
get_duckie_state_mean1.3695062649789952e-06
get_duckie_state_median1.3888890470438337e-06
get_duckie_state_min1.2859913034304096e-06
get_robot_state_max0.003916659758458683
get_robot_state_mean0.0036857125323559456
get_robot_state_median0.003664090355468928
get_robot_state_min0.003498009660027244
get_state_dump_max0.004816657868190784
get_state_dump_mean0.004670733617034098
get_state_dump_median0.004645687460800095
get_state_dump_min0.00457490167834542
get_ui_image_max0.03689300775527954
get_ui_image_mean0.031288385534358684
get_ui_image_median0.03107694179924943
get_ui_image_min0.02610665078365634
in-drivable-lane_max15.399999999999718
in-drivable-lane_mean6.999999999999931
in-drivable-lane_min2.6999999999999904
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.8027020583485216, "get_ui_image": 0.0279060344804417, "step_physics": 0.10630778832869096, "survival_time": 8.74999999999999, "driven_lanedir": 0.939086770821679, "get_state_dump": 0.00457490167834542, "get_robot_state": 0.003498009660027244, "sim_render-ego0": 0.003744478930126537, "get_duckie_state": 1.4142556623979048e-06, "in-drivable-lane": 4.549999999999999, "deviation-heading": 1.3854866078043155, "agent_compute-ego0": 0.012103904377330431, "complete-iteration": 0.1708547662604939, "set_robot_commands": 0.0020784234458749943, "deviation-center-line": 0.4411826543740469, "driven_lanedir_consec": 0.939086770821679, "sim_compute_sim_state": 0.0086368742314252, "sim_compute_performance-ego0": 0.0019226114858280528}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6736530393428456, "get_ui_image": 0.03689300775527954, "step_physics": 0.16465172052383423, "survival_time": 4.94999999999999, "driven_lanedir": 0.2505084337962318, "get_state_dump": 0.004705202579498291, "get_robot_state": 0.003716902732849121, "sim_render-ego0": 0.003987674713134766, "get_duckie_state": 1.3875961303710938e-06, "in-drivable-lane": 2.6999999999999904, "deviation-heading": 1.0328769193539653, "agent_compute-ego0": 0.0272412371635437, "complete-iteration": 0.25623914480209353, "set_robot_commands": 0.002262399196624756, "deviation-center-line": 0.1300891382486256, "driven_lanedir_consec": 0.2505084337962318, "sim_compute_sim_state": 0.010590815544128418, "sim_compute_performance-ego0": 0.0021012425422668457}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.9614537090270392, "get_ui_image": 0.03424784911805717, "step_physics": 0.14321017265319824, "survival_time": 10.000000000000009, "driven_lanedir": 1.1019449858835817, "get_state_dump": 0.004816657868190784, "get_robot_state": 0.003916659758458683, "sim_render-ego0": 0.004122159967375039, "get_duckie_state": 1.3901819637165733e-06, "in-drivable-lane": 5.350000000000016, "deviation-heading": 1.7483559280283962, "agent_compute-ego0": 0.013431143404832526, "complete-iteration": 0.21833240214865007, "set_robot_commands": 0.002356416550441761, "deviation-center-line": 0.35073903706081466, "driven_lanedir_consec": 1.1019449858835817, "sim_compute_sim_state": 0.010010142824543057, "sim_compute_performance-ego0": 0.0021308310589387047}, "LF-norm-small_loop-000-ego0": {"driven_any": 13.253724983973957, "get_ui_image": 0.02610665078365634, "step_physics": 0.10274384103150888, "survival_time": 59.99999999999873, "driven_lanedir": 10.062243453410844, "get_state_dump": 0.004586172342101898, "get_robot_state": 0.0036112779780887345, "sim_render-ego0": 0.003788148235222581, "get_duckie_state": 1.2859913034304096e-06, "in-drivable-lane": 15.399999999999718, "deviation-heading": 14.848183249575785, "agent_compute-ego0": 0.03808654515967579, "complete-iteration": 0.1892183480115854, "set_robot_commands": 0.00223427827312587, "deviation-center-line": 2.9429110939472567, "driven_lanedir_consec": 10.06228504916547, "sim_compute_sim_state": 0.006055071590147248, "sim_compute_performance-ego0": 0.001921591214792218}}
set_robot_commands_max0.002356416550441761
set_robot_commands_mean0.002232879366516845
set_robot_commands_median0.0022483387348753133
set_robot_commands_min0.0020784234458749943
sim_compute_performance-ego0_max0.0021308310589387047
sim_compute_performance-ego0_mean0.0020190690754564554
sim_compute_performance-ego0_median0.002011927014047449
sim_compute_performance-ego0_min0.001921591214792218
sim_compute_sim_state_max0.010590815544128418
sim_compute_sim_state_mean0.00882322604756098
sim_compute_sim_state_median0.009323508527984128
sim_compute_sim_state_min0.006055071590147248
sim_render-ego0_max0.004122159967375039
sim_render-ego0_mean0.00391061546146473
sim_render-ego0_median0.003887911474178673
sim_render-ego0_min0.003744478930126537
simulation-passed1
step_physics_max0.16465172052383423
step_physics_mean0.12922838063430808
step_physics_median0.1247589804909446
step_physics_min0.10274384103150888
survival_time_max59.99999999999873
survival_time_mean20.924999999999677
survival_time_min4.94999999999999
No reset possible
5726910974Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:42:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012982687882638594
agent_compute-ego0_mean0.012280120341406575
agent_compute-ego0_median0.01213715415910122
agent_compute-ego0_min0.011863485164785264
complete-iteration_max0.3386231604265631
complete-iteration_mean0.28925925140873177
complete-iteration_median0.29349157474717924
complete-iteration_min0.2314306957140056
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.558951791577494e-06
get_duckie_state_mean1.4280300156262198e-06
get_duckie_state_median1.4229678393005829e-06
get_duckie_state_min1.307232592326219e-06
get_robot_state_max0.003744450735112809
get_robot_state_mean0.00369525213821246
get_robot_state_median0.003720535128241673
get_robot_state_min0.0035954875612536834
get_state_dump_max0.0048595600382275225
get_state_dump_mean0.0046984775179530255
get_state_dump_median0.004725802351691939
get_state_dump_min0.004482745330200703
get_ui_image_max0.03451009495470744
get_ui_image_mean0.030245057996564063
get_ui_image_median0.030421674698219013
get_ui_image_min0.025626787635110795
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02784732080915389, "step_physics": 0.20567746523714975, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004779164936024382, "get_robot_state": 0.003699275675066107, "sim_render-ego0": 0.003963452790996415, "get_duckie_state": 1.3820733952581833e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.012306881387664515, "complete-iteration": 0.270826008595793, "set_robot_commands": 0.0022027037919907645, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008359324028847318, "sim_compute_performance-ego0": 0.0019050779985845536}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03451009495470744, "step_physics": 0.2627662681322312, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004672439767359496, "get_robot_state": 0.003741794581417239, "sim_render-ego0": 0.0039738209221781935, "get_duckie_state": 1.558951791577494e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.012982687882638594, "complete-iteration": 0.3386231604265631, "set_robot_commands": 0.002209882752087392, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.0115988891785786, "sim_compute_performance-ego0": 0.002073552189619714}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.032996028587284135, "step_physics": 0.2451590886223227, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.0048595600382275225, "get_robot_state": 0.003744450735112809, "sim_render-ego0": 0.00402290358531485, "get_duckie_state": 1.4638622833429824e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.011863485164785264, "complete-iteration": 0.31615714089856556, "set_robot_commands": 0.0022488158509495057, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009105574975502084, "sim_compute_performance-ego0": 0.0020637944973477913}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.025626787635110795, "step_physics": 0.17187268430247693, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004482745330200703, "get_robot_state": 0.0035954875612536834, "sim_render-ego0": 0.003764352433191152, "get_duckie_state": 1.307232592326219e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.011967426930537926, "complete-iteration": 0.2314306957140056, "set_robot_commands": 0.0021292565764237403, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.005959048457784915, "sim_compute_performance-ego0": 0.0019500386605751107}}
set_robot_commands_max0.0022488158509495057
set_robot_commands_mean0.0021976647428628504
set_robot_commands_median0.0022062932720390786
set_robot_commands_min0.0021292565764237403
sim_compute_performance-ego0_max0.002073552189619714
sim_compute_performance-ego0_mean0.001998115836531793
sim_compute_performance-ego0_median0.002006916578961451
sim_compute_performance-ego0_min0.0019050779985845536
sim_compute_sim_state_max0.0115988891785786
sim_compute_sim_state_mean0.008755709160178229
sim_compute_sim_state_median0.008732449502174701
sim_compute_sim_state_min0.005959048457784915
sim_render-ego0_max0.00402290358531485
sim_render-ego0_mean0.003931132432920152
sim_render-ego0_median0.003968636856587304
sim_render-ego0_min0.003764352433191152
simulation-passed1
step_physics_max0.2627662681322312
step_physics_mean0.22136887657354515
step_physics_median0.22541827692973623
step_physics_min0.17187268430247693
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5725211312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-040:02:23
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5717410997Mo Kleit 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:24:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.353018415651777
survival_time_median44.4999999999995
deviation-center-line_median2.1034926496399295
in-drivable-lane_median12.050000000000145


other stats
agent_compute-ego0_max0.012709618845823096
agent_compute-ego0_mean0.012054851179579194
agent_compute-ego0_median0.012096150431605205
agent_compute-ego0_min0.01131748500928328
complete-iteration_max0.2127887164458966
complete-iteration_mean0.18086114796314176
complete-iteration_median0.17383516331100146
complete-iteration_min0.1629855487846676
deviation-center-line_max3.965551217762383
deviation-center-line_mean2.1762351742217687
deviation-center-line_min0.5324041798448321
deviation-heading_max9.856392589151264
deviation-heading_mean5.4472354263238545
deviation-heading_median5.196683246194546
deviation-heading_min1.539182623755062
driven_any_max6.367504642086778
driven_any_mean4.088595780444152
driven_any_median4.180946875053249
driven_any_min1.6249847295833295
driven_lanedir_consec_max6.196592360871419
driven_lanedir_consec_mean2.936878001336776
driven_lanedir_consec_min0.8448828131721307
driven_lanedir_max6.196592360871419
driven_lanedir_mean2.936878001336776
driven_lanedir_median2.353018415651777
driven_lanedir_min0.8448828131721307
get_duckie_state_max1.7551054437476469e-06
get_duckie_state_mean1.482059102772023e-06
get_duckie_state_median1.5042166895033337e-06
get_duckie_state_min1.1646975883337778e-06
get_robot_state_max0.00418480468927871
get_robot_state_mean0.003846229128851154
get_robot_state_median0.0038248495095335633
get_robot_state_min0.0035504128070587807
get_state_dump_max0.005055206999195108
get_state_dump_mean0.00474583643393952
get_state_dump_median0.004750909204427503
get_state_dump_min0.0044263203277079685
get_ui_image_max0.03757132720618978
get_ui_image_mean0.031145896337200496
get_ui_image_median0.029636434770245836
get_ui_image_min0.027739388602120538
in-drivable-lane_max27.79999999999942
in-drivable-lane_mean12.974999999999929
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.6249847295833295, "get_ui_image": 0.027739388602120538, "step_physics": 0.09891085131914784, "survival_time": 16.400000000000098, "driven_lanedir": 0.8448828131721307, "get_state_dump": 0.004541371731047935, "get_robot_state": 0.0035504128070587807, "sim_render-ego0": 0.003758757310073064, "get_duckie_state": 1.2863008446968798e-06, "in-drivable-lane": 11.350000000000108, "deviation-heading": 1.539182623755062, "agent_compute-ego0": 0.01131748500928328, "complete-iteration": 0.1629855487846676, "set_robot_commands": 0.002200530292777667, "deviation-center-line": 0.5324041798448321, "driven_lanedir_consec": 0.8448828131721307, "sim_compute_sim_state": 0.008954735874767361, "sim_compute_performance-ego0": 0.0019257010659910624}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.816633163667289, "get_ui_image": 0.03757132720618978, "step_physics": 0.13185336093278843, "survival_time": 29.000000000000277, "driven_lanedir": 1.2683250322747597, "get_state_dump": 0.004960446677807071, "get_robot_state": 0.004066344998174198, "sim_render-ego0": 0.004293774983969079, "get_duckie_state": 1.7551054437476469e-06, "in-drivable-lane": 12.75000000000018, "deviation-heading": 2.5098368298856055, "agent_compute-ego0": 0.012709618845823096, "complete-iteration": 0.2127887164458966, "set_robot_commands": 0.002465707299631352, "deviation-center-line": 1.4661037423883596, "driven_lanedir_consec": 1.2683250322747597, "sim_compute_sim_state": 0.012412163148443385, "sim_compute_performance-ego0": 0.002349558057144874}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.367504642086778, "get_ui_image": 0.03090565647312644, "step_physics": 0.1020494593271705, "survival_time": 59.99999999999873, "driven_lanedir": 6.196592360871419, "get_state_dump": 0.0044263203277079685, "get_robot_state": 0.0035833540208929284, "sim_render-ego0": 0.003805057492283957, "get_duckie_state": 1.1646975883337778e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.856392589151264, "agent_compute-ego0": 0.011598440729311163, "complete-iteration": 0.17265821674483503, "set_robot_commands": 0.002153296355502393, "deviation-center-line": 3.965551217762383, "driven_lanedir_consec": 6.196592360871419, "sim_compute_sim_state": 0.012093531102760943, "sim_compute_performance-ego0": 0.0019598727817837147}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.545260586439209, "get_ui_image": 0.02836721306736523, "step_physics": 0.10875203587629714, "survival_time": 59.99999999999873, "driven_lanedir": 3.437711799028795, "get_state_dump": 0.005055206999195108, "get_robot_state": 0.00418480468927871, "sim_render-ego0": 0.004331621698892484, "get_duckie_state": 1.7221325343097871e-06, "in-drivable-lane": 27.79999999999942, "deviation-heading": 7.883529662503486, "agent_compute-ego0": 0.01259386013389924, "complete-iteration": 0.1750121098771679, "set_robot_commands": 0.002487660248412578, "deviation-center-line": 2.7408815568915, "driven_lanedir_consec": 3.437711799028795, "sim_compute_sim_state": 0.006816535269985787, "sim_compute_performance-ego0": 0.00231136032981142}}
set_robot_commands_max0.002487660248412578
set_robot_commands_mean0.0023267985490809974
set_robot_commands_median0.00233311879620451
set_robot_commands_min0.002153296355502393
sim_compute_performance-ego0_max0.002349558057144874
sim_compute_performance-ego0_mean0.0021366230586827677
sim_compute_performance-ego0_median0.0021356165557975676
sim_compute_performance-ego0_min0.0019257010659910624
sim_compute_sim_state_max0.012412163148443385
sim_compute_sim_state_mean0.01006924134898937
sim_compute_sim_state_median0.010524133488764152
sim_compute_sim_state_min0.006816535269985787
sim_render-ego0_max0.004331621698892484
sim_render-ego0_mean0.004047302871304646
sim_render-ego0_median0.004049416238126518
sim_render-ego0_min0.003758757310073064
simulation-passed1
step_physics_max0.13185336093278843
step_physics_mean0.11039142686385098
step_physics_median0.10540074760173382
step_physics_min0.09891085131914784
survival_time_max59.99999999999873
survival_time_mean41.349999999999454
survival_time_min16.400000000000098
No reset possible
5698511048Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:29:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.65087758163692
survival_time_median56.9249999999989
deviation-center-line_median2.6065802376276084
in-drivable-lane_median13.874999999999735


other stats
agent_compute-ego0_max0.012757110905337644
agent_compute-ego0_mean0.01241373063181066
agent_compute-ego0_median0.012546723162034088
agent_compute-ego0_min0.011804365297836824
complete-iteration_max0.20004154821937292
complete-iteration_mean0.17579066425363432
complete-iteration_median0.17790825150629325
complete-iteration_min0.14730460578257792
deviation-center-line_max3.972614823948107
deviation-center-line_mean2.5888787581366306
deviation-center-line_min1.1697397333431971
deviation-heading_max10.651512605755816
deviation-heading_mean7.811418040887322
deviation-heading_median8.197776133476623
deviation-heading_min4.198607290840228
driven_any_max8.65747184386526
driven_any_mean6.989010429356419
driven_any_median7.079410326842693
driven_any_min5.139749219875032
driven_lanedir_consec_max8.47917790345171
driven_lanedir_consec_mean5.226179585804865
driven_lanedir_consec_min3.12378527649391
driven_lanedir_max8.47917790345171
driven_lanedir_mean5.226179585804865
driven_lanedir_median4.65087758163692
driven_lanedir_min3.12378527649391
get_duckie_state_max2.082601770178064e-06
get_duckie_state_mean1.8462638783205072e-06
get_duckie_state_median1.8497156199928165e-06
get_duckie_state_min1.6030225031183323e-06
get_robot_state_max0.003865567430273279
get_robot_state_mean0.0036202937425947167
get_robot_state_median0.0035728608526300063
get_robot_state_min0.0034698858348455753
get_state_dump_max0.00481385039044665
get_state_dump_mean0.004541373285316376
get_state_dump_median0.004520226295563397
get_state_dump_min0.004311190159692058
get_ui_image_max0.0356118935600946
get_ui_image_mean0.029946785751602617
get_ui_image_median0.029601385961649927
get_ui_image_min0.024972477523015995
in-drivable-lane_max35.049999999998676
in-drivable-lane_mean15.762499999999534
in-drivable-lane_min0.2499999999999858
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.139749219875032, "get_ui_image": 0.028919303572023068, "step_physics": 0.1073228981587794, "survival_time": 38.44999999999995, "driven_lanedir": 3.7528951239464834, "get_state_dump": 0.00481385039044665, "get_robot_state": 0.003865567430273279, "sim_render-ego0": 0.004055387323552912, "get_duckie_state": 2.082601770178064e-06, "in-drivable-lane": 14.099999999999742, "deviation-heading": 4.198607290840228, "agent_compute-ego0": 0.012757110905337644, "complete-iteration": 0.17765478623377812, "set_robot_commands": 0.00233304872141256, "deviation-center-line": 1.1697397333431971, "driven_lanedir_consec": 3.7528951239464834, "sim_compute_sim_state": 0.011332264194240818, "sim_compute_performance-ego0": 0.0021648759965772753}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.960038058911512, "get_ui_image": 0.0356118935600946, "step_physics": 0.12400631869215248, "survival_time": 53.84999999999908, "driven_lanedir": 5.548860039327358, "get_state_dump": 0.0045496141313400695, "get_robot_state": 0.0035824083441484836, "sim_render-ego0": 0.003859546719765176, "get_duckie_state": 1.9506974653764204e-06, "in-drivable-lane": 13.649999999999732, "deviation-heading": 10.651512605755816, "agent_compute-ego0": 0.01267538088372112, "complete-iteration": 0.20004154821937292, "set_robot_commands": 0.002157834111427774, "deviation-center-line": 2.958653552102892, "driven_lanedir_consec": 5.548860039327358, "sim_compute_sim_state": 0.011545893654973697, "sim_compute_performance-ego0": 0.001965104096011018}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.198782594773874, "get_ui_image": 0.03028346835127679, "step_physics": 0.10803835616322184, "survival_time": 59.99999999999873, "driven_lanedir": 3.12378527649391, "get_state_dump": 0.004311190159692058, "get_robot_state": 0.0034698858348455753, "sim_render-ego0": 0.00371279128882212, "get_duckie_state": 1.6030225031183323e-06, "in-drivable-lane": 35.049999999998676, "deviation-heading": 6.15484217223905, "agent_compute-ego0": 0.012418065440347051, "complete-iteration": 0.17816171677880838, "set_robot_commands": 0.002087126167291011, "deviation-center-line": 2.254506923152325, "driven_lanedir_consec": 3.12378527649391, "sim_compute_sim_state": 0.011874103228515828, "sim_compute_performance-ego0": 0.0018861678915158796}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.65747184386526, "get_ui_image": 0.024972477523015995, "step_physics": 0.08871041864876346, "survival_time": 59.99999999999873, "driven_lanedir": 8.47917790345171, "get_state_dump": 0.004490838459786726, "get_robot_state": 0.003563313361111529, "sim_render-ego0": 0.00372592436086129, "get_duckie_state": 1.7487337746092123e-06, "in-drivable-lane": 0.2499999999999858, "deviation-heading": 10.240710094714194, "agent_compute-ego0": 0.011804365297836824, "complete-iteration": 0.14730460578257792, "set_robot_commands": 0.0021392578487094494, "deviation-center-line": 3.972614823948107, "driven_lanedir_consec": 8.47917790345171, "sim_compute_sim_state": 0.005914799875264164, "sim_compute_performance-ego0": 0.0019006093872476872}}
set_robot_commands_max0.00233304872141256
set_robot_commands_mean0.0021793167122101985
set_robot_commands_median0.0021485459800686117
set_robot_commands_min0.002087126167291011
sim_compute_performance-ego0_max0.0021648759965772753
sim_compute_performance-ego0_mean0.0019791893428379656
sim_compute_performance-ego0_median0.0019328567416293531
sim_compute_performance-ego0_min0.0018861678915158796
sim_compute_sim_state_max0.011874103228515828
sim_compute_sim_state_mean0.010166765238248629
sim_compute_sim_state_median0.011439078924607255
sim_compute_sim_state_min0.005914799875264164
sim_render-ego0_max0.004055387323552912
sim_render-ego0_mean0.0038384124232503742
sim_render-ego0_median0.003792735540313233
sim_render-ego0_min0.00371279128882212
simulation-passed1
step_physics_max0.12400631869215248
step_physics_mean0.10701949791572928
step_physics_median0.1076806271610006
step_physics_min0.08871041864876346
survival_time_max59.99999999999873
survival_time_mean53.07499999999912
survival_time_min38.44999999999995
No reset possible
5696711313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-040:04:04
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5688511066Fernanda Custodio Pereira do Carmo 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:18:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.30634495450543
survival_time_median19.750000000000146
deviation-center-line_median0.7406120102098428
in-drivable-lane_median5.675000000000081


other stats
agent_compute-ego0_max0.013588988903871516
agent_compute-ego0_mean0.013152497015825902
agent_compute-ego0_median0.013294998093006872
agent_compute-ego0_min0.012431002973418351
complete-iteration_max0.20116837603030815
complete-iteration_mean0.17859243381324025
complete-iteration_median0.1800431302014045
complete-iteration_min0.15311509881984384
deviation-center-line_max3.163834829716317
deviation-center-line_mean1.2717855703354355
deviation-center-line_min0.4420834312057403
deviation-heading_max5.658263035058896
deviation-heading_mean2.78640652646875
deviation-heading_median1.9284414647678236
deviation-heading_min1.6304801412804573
driven_any_max11.190171302630043
driven_any_mean5.136233031123667
driven_any_median3.1824420219442753
driven_any_min2.989876777976075
driven_lanedir_consec_max10.763047647382946
driven_lanedir_consec_mean4.242778989247244
driven_lanedir_consec_min1.595378400595172
driven_lanedir_max10.763047647382946
driven_lanedir_mean4.242778989247244
driven_lanedir_median2.30634495450543
driven_lanedir_min1.595378400595172
get_duckie_state_max1.6216150264150088e-06
get_duckie_state_mean1.496859034298736e-06
get_duckie_state_median1.4984249094764062e-06
get_duckie_state_min1.368971291827123e-06
get_robot_state_max0.004158616680459878
get_robot_state_mean0.0038241934702330778
get_robot_state_median0.003785698298270753
get_robot_state_min0.0035667606039309283
get_state_dump_max0.005201262297089567
get_state_dump_mean0.004847677197975349
get_state_dump_median0.004789483287288907
get_state_dump_min0.004610479920234013
get_ui_image_max0.03487134510927861
get_ui_image_mean0.03027950562676546
get_ui_image_median0.02987797984666713
get_ui_image_min0.02649071770444897
in-drivable-lane_max10.55000000000015
in-drivable-lane_mean5.912500000000053
in-drivable-lane_min1.7499999999999003
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.190171302630043, "get_ui_image": 0.02649071770444897, "step_physics": 0.08936422274174241, "survival_time": 59.99999999999873, "driven_lanedir": 10.763047647382946, "get_state_dump": 0.004610479920234013, "get_robot_state": 0.0035667606039309283, "sim_render-ego0": 0.003711390554855309, "get_duckie_state": 1.368971291827123e-06, "in-drivable-lane": 1.7499999999999003, "deviation-heading": 5.658263035058896, "agent_compute-ego0": 0.012431002973418351, "complete-iteration": 0.15311509881984384, "set_robot_commands": 0.0020913678740184572, "deviation-center-line": 3.163834829716317, "driven_lanedir_consec": 10.763047647382946, "sim_compute_sim_state": 0.008852782594869773, "sim_compute_performance-ego0": 0.001906086463515308}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.0994220630177303, "get_ui_image": 0.03487134510927861, "step_physics": 0.1251566498586447, "survival_time": 20.15000000000015, "driven_lanedir": 1.595378400595172, "get_state_dump": 0.004938145675281487, "get_robot_state": 0.0038008973149970026, "sim_render-ego0": 0.00403843362732689, "get_duckie_state": 1.471231479455929e-06, "in-drivable-lane": 10.55000000000015, "deviation-heading": 1.976311203452356, "agent_compute-ego0": 0.013524921223668768, "complete-iteration": 0.20116837603030815, "set_robot_commands": 0.0021857330114534584, "deviation-center-line": 0.4420834312057403, "driven_lanedir_consec": 1.595378400595172, "sim_compute_sim_state": 0.01046745198788029, "sim_compute_performance-ego0": 0.002085442000096387}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.989876777976075, "get_ui_image": 0.03232119708764748, "step_physics": 0.11542236804962158, "survival_time": 18.250000000000124, "driven_lanedir": 2.356469429417749, "get_state_dump": 0.004640820899296328, "get_robot_state": 0.003770499281544503, "sim_render-ego0": 0.0040567194829221635, "get_duckie_state": 1.5256183394968837e-06, "in-drivable-lane": 4.850000000000069, "deviation-heading": 1.6304801412804573, "agent_compute-ego0": 0.013065074962344976, "complete-iteration": 0.1885011958294227, "set_robot_commands": 0.0022129185212765887, "deviation-center-line": 0.6539034797506258, "driven_lanedir_consec": 2.356469429417749, "sim_compute_sim_state": 0.010858047203939469, "sim_compute_performance-ego0": 0.002056182407941974}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.2654619808708203, "get_ui_image": 0.027434762605686776, "step_physics": 0.10509762014310384, "survival_time": 19.35000000000014, "driven_lanedir": 2.256220479593111, "get_state_dump": 0.005201262297089567, "get_robot_state": 0.004158616680459878, "sim_render-ego0": 0.0043749213218688965, "get_duckie_state": 1.6216150264150088e-06, "in-drivable-lane": 6.500000000000092, "deviation-heading": 1.8805717260832917, "agent_compute-ego0": 0.013588988903871516, "complete-iteration": 0.1715850645733863, "set_robot_commands": 0.0025226977682605233, "deviation-center-line": 0.8273205406690599, "driven_lanedir_consec": 2.256220479593111, "sim_compute_sim_state": 0.006770978883369682, "sim_compute_performance-ego0": 0.0023218805027991228}}
set_robot_commands_max0.0025226977682605233
set_robot_commands_mean0.002253179293752257
set_robot_commands_median0.002199325766365024
set_robot_commands_min0.0020913678740184572
sim_compute_performance-ego0_max0.0023218805027991228
sim_compute_performance-ego0_mean0.002092397843588198
sim_compute_performance-ego0_median0.002070812204019181
sim_compute_performance-ego0_min0.001906086463515308
sim_compute_sim_state_max0.010858047203939469
sim_compute_sim_state_mean0.009237315167514804
sim_compute_sim_state_median0.009660117291375033
sim_compute_sim_state_min0.006770978883369682
sim_render-ego0_max0.0043749213218688965
sim_render-ego0_mean0.004045366246743315
sim_render-ego0_median0.004047576555124527
sim_render-ego0_min0.003711390554855309
simulation-passed1
step_physics_max0.1251566498586447
step_physics_mean0.10876021519827814
step_physics_median0.11025999409636272
step_physics_min0.08936422274174241
survival_time_max59.99999999999873
survival_time_mean29.437499999999783
survival_time_min18.250000000000124
No reset possible
5685611074Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:05:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4269598473631031
survival_time_median6.824999999999983
deviation-center-line_median0.1250215673045997
in-drivable-lane_median5.074999999999984


other stats
agent_compute-ego0_max0.013984776776412435
agent_compute-ego0_mean0.013501869883881246
agent_compute-ego0_median0.01338681055103309
agent_compute-ego0_min0.013249081657046365
complete-iteration_max0.2022147226653643
complete-iteration_mean0.18222426514174145
complete-iteration_median0.1854995674557156
complete-iteration_min0.1556832029901702
deviation-center-line_max0.4812168239822914
deviation-center-line_mean0.20360062739798637
deviation-center-line_min0.08314255100045463
deviation-heading_max1.418304528247113
deviation-heading_mean0.8643845061636652
deviation-heading_median0.8429452625818135
deviation-heading_min0.35334297124392117
driven_any_max3.106204715673874
driven_any_mean1.9916046476558025
driven_any_median1.7330440991865288
driven_any_min1.3941256765762773
driven_lanedir_consec_max1.094806815977964
driven_lanedir_consec_mean0.5716952652305631
driven_lanedir_consec_min0.33805455021808206
driven_lanedir_max1.094806815977964
driven_lanedir_mean0.5716952652305631
driven_lanedir_median0.4269598473631031
driven_lanedir_min0.33805455021808206
get_duckie_state_max1.4641140931404678e-06
get_duckie_state_mean1.3856039795087115e-06
get_duckie_state_median1.3917211502317398e-06
get_duckie_state_min1.2948595244309e-06
get_robot_state_max0.003898919828786146
get_robot_state_mean0.0037475565480842945
get_robot_state_median0.003755669177524627
get_robot_state_min0.0035799680085017763
get_state_dump_max0.004991989007732212
get_state_dump_mean0.004773313107522525
get_state_dump_median0.004815612709711469
get_state_dump_min0.004470038002934949
get_ui_image_max0.03494102803487626
get_ui_image_mean0.03194517420819791
get_ui_image_median0.033276408013538566
get_ui_image_min0.026286852770838243
in-drivable-lane_max6.250000000000025
in-drivable-lane_mean5.137499999999996
in-drivable-lane_min4.14999999999999
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.106204715673874, "get_ui_image": 0.03172147614615304, "step_physics": 0.10518654187520345, "survival_time": 10.450000000000014, "driven_lanedir": 1.094806815977964, "get_state_dump": 0.004956151190258207, "get_robot_state": 0.003896604265485491, "sim_render-ego0": 0.004029973347981771, "get_duckie_state": 1.4475413731166294e-06, "in-drivable-lane": 6.250000000000025, "deviation-heading": 1.418304528247113, "agent_compute-ego0": 0.013249081657046365, "complete-iteration": 0.17801887761978877, "set_robot_commands": 0.002374985104515439, "deviation-center-line": 0.4812168239822914, "driven_lanedir_consec": 1.094806815977964, "sim_compute_sim_state": 0.010369633492969332, "sim_compute_performance-ego0": 0.002139795394170852}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.736543796672067, "get_ui_image": 0.03494102803487626, "step_physics": 0.1186071445071508, "survival_time": 6.249999999999986, "driven_lanedir": 0.455787522797674, "get_state_dump": 0.004675074229164729, "get_robot_state": 0.003614734089563763, "sim_render-ego0": 0.0038701541840084016, "get_duckie_state": 1.33590092734685e-06, "in-drivable-lane": 4.14999999999999, "deviation-heading": 1.2833491123172085, "agent_compute-ego0": 0.013317410908048116, "complete-iteration": 0.19298025729164245, "set_robot_commands": 0.002206849673437694, "deviation-center-line": 0.16255520934464338, "driven_lanedir_consec": 0.455787522797674, "sim_compute_sim_state": 0.009670567890954397, "sim_compute_performance-ego0": 0.0019881006271120103}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.7295444017009904, "get_ui_image": 0.03483133988092409, "step_physics": 0.1279853526377838, "survival_time": 7.399999999999982, "driven_lanedir": 0.39813217192853223, "get_state_dump": 0.004991989007732212, "get_robot_state": 0.003898919828786146, "sim_render-ego0": 0.004067672179049293, "get_duckie_state": 1.4641140931404678e-06, "in-drivable-lane": 5.799999999999981, "deviation-heading": 0.40254141284641853, "agent_compute-ego0": 0.013456210194018063, "complete-iteration": 0.2022147226653643, "set_robot_commands": 0.0024206878354885433, "deviation-center-line": 0.0874879252645561, "driven_lanedir_consec": 0.39813217192853223, "sim_compute_sim_state": 0.008358057713348594, "sim_compute_performance-ego0": 0.002109828411332713}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3941256765762773, "get_ui_image": 0.026286852770838243, "step_physics": 0.09435423283741393, "survival_time": 5.749999999999988, "driven_lanedir": 0.33805455021808206, "get_state_dump": 0.004470038002934949, "get_robot_state": 0.0035799680085017763, "sim_render-ego0": 0.0038308398476962382, "get_duckie_state": 1.2948595244309e-06, "in-drivable-lane": 4.349999999999987, "deviation-heading": 0.35334297124392117, "agent_compute-ego0": 0.013984776776412435, "complete-iteration": 0.1556832029901702, "set_robot_commands": 0.002103941193942366, "deviation-center-line": 0.08314255100045463, "driven_lanedir_consec": 0.33805455021808206, "sim_compute_sim_state": 0.005075824671778186, "sim_compute_performance-ego0": 0.0019129473587562295}}
set_robot_commands_max0.0024206878354885433
set_robot_commands_mean0.0022766159518460105
set_robot_commands_median0.002290917388976566
set_robot_commands_min0.002103941193942366
sim_compute_performance-ego0_max0.002139795394170852
sim_compute_performance-ego0_mean0.002037667947842951
sim_compute_performance-ego0_median0.0020489645192223616
sim_compute_performance-ego0_min0.0019129473587562295
sim_compute_sim_state_max0.010369633492969332
sim_compute_sim_state_mean0.008368520942262628
sim_compute_sim_state_median0.009014312802151496
sim_compute_sim_state_min0.005075824671778186
sim_render-ego0_max0.004067672179049293
sim_render-ego0_mean0.003949659889683927
sim_render-ego0_median0.003950063765995086
sim_render-ego0_min0.0038308398476962382
simulation-passed1
step_physics_max0.1279853526377838
step_physics_mean0.111533317964388
step_physics_median0.11189684319117713
step_physics_min0.09435423283741393
survival_time_max10.450000000000014
survival_time_mean7.462499999999992
survival_time_min5.749999999999988
No reset possible
5684211425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-040:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5671211092Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:23:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.2301113558772543
survival_time_median37.5749999999995
deviation-center-line_median1.859178955258347
in-drivable-lane_median6.049999999999924


other stats
agent_compute-ego0_max0.012764146782575696
agent_compute-ego0_mean0.012631879464332169
agent_compute-ego0_median0.012693941926570551
agent_compute-ego0_min0.01237548722161187
complete-iteration_max0.21098475481137904
complete-iteration_mean0.18381199721965413
complete-iteration_median0.1872860669974292
complete-iteration_min0.14969110007237907
deviation-center-line_max2.9855571452454868
deviation-center-line_mean1.7178691211962478
deviation-center-line_min0.16756142902280896
deviation-heading_max17.073277627492267
deviation-heading_mean9.132641147426362
deviation-heading_median9.268893215876188
deviation-heading_min0.9195005304608064
driven_any_max10.59870536942625
driven_any_mean6.095407198924209
driven_any_median6.151495461542775
driven_any_min1.4799325031850363
driven_lanedir_consec_max6.148523203034964
driven_lanedir_consec_mean3.3318204823428283
driven_lanedir_consec_min0.7185360145818402
driven_lanedir_max9.179619502885645
driven_lanedir_mean4.207478608551839
driven_lanedir_median3.465879458369935
driven_lanedir_min0.7185360145818402
get_duckie_state_max1.43090850804668e-06
get_duckie_state_mean1.3044576244300551e-06
get_duckie_state_median1.2835670033471672e-06
get_duckie_state_min1.219787982979206e-06
get_robot_state_max0.003797492615686269
get_robot_state_mean0.003648565996198437
get_robot_state_median0.0036357059535507778
get_robot_state_min0.0035253594620059236
get_state_dump_max0.004695241199147195
get_state_dump_mean0.004588006958325339
get_state_dump_median0.004590270815318466
get_state_dump_min0.0044762450035172275
get_ui_image_max0.03362927410040009
get_ui_image_mean0.029750441582943217
get_ui_image_median0.02995190581883513
get_ui_image_min0.02546868059370253
in-drivable-lane_max19.949999999999495
in-drivable-lane_mean9.31249999999984
in-drivable-lane_min5.2000000000000135
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.59870536942625, "get_ui_image": 0.027963979952936865, "step_physics": 0.10944474785651494, "survival_time": 59.99999999999873, "driven_lanedir": 9.179619502885645, "get_state_dump": 0.004695241199147195, "get_robot_state": 0.003797492615686269, "sim_render-ego0": 0.003984031629602081, "get_duckie_state": 1.43090850804668e-06, "in-drivable-lane": 5.3999999999997605, "deviation-heading": 14.079262650246458, "agent_compute-ego0": 0.012764146782575696, "complete-iteration": 0.17738299782726785, "set_robot_commands": 0.002261415310048938, "deviation-center-line": 2.9587146936810185, "driven_lanedir_consec": 6.148523203034964, "sim_compute_sim_state": 0.010309824836343452, "sim_compute_performance-ego0": 0.002078440266783093}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.7670308211821877, "get_ui_image": 0.03362927410040009, "step_physics": 0.12519651718353958, "survival_time": 17.750000000000117, "driven_lanedir": 1.5616049335461022, "get_state_dump": 0.00460293520702405, "get_robot_state": 0.0035404609830191965, "sim_render-ego0": 0.0037931384665242742, "get_duckie_state": 1.2912107317635183e-06, "in-drivable-lane": 6.700000000000087, "deviation-heading": 4.458523781505914, "agent_compute-ego0": 0.012654745176936804, "complete-iteration": 0.19718913616759057, "set_robot_commands": 0.0020648662963610015, "deviation-center-line": 0.7596432168356758, "driven_lanedir_consec": 1.5172116372035829, "sim_compute_sim_state": 0.009716165199708403, "sim_compute_performance-ego0": 0.0019090242600173096}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.535960101903363, "get_ui_image": 0.03193983168473339, "step_physics": 0.13723093141567405, "survival_time": 57.39999999999888, "driven_lanedir": 5.370153983193768, "get_state_dump": 0.0045776064236128814, "get_robot_state": 0.0037309509240823586, "sim_render-ego0": 0.003960634128646917, "get_duckie_state": 1.2759232749308162e-06, "in-drivable-lane": 19.949999999999495, "deviation-heading": 17.073277627492267, "agent_compute-ego0": 0.0127331386762043, "complete-iteration": 0.21098475481137904, "set_robot_commands": 0.002266707266798426, "deviation-center-line": 2.9855571452454868, "driven_lanedir_consec": 4.943011074550926, "sim_compute_sim_state": 0.012401851391771548, "sim_compute_performance-ego0": 0.0020614981755056622}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.4799325031850363, "get_ui_image": 0.02546868059370253, "step_physics": 0.0910006653178822, "survival_time": 9.850000000000003, "driven_lanedir": 0.7185360145818402, "get_state_dump": 0.0044762450035172275, "get_robot_state": 0.0035253594620059236, "sim_render-ego0": 0.003752158145711879, "get_duckie_state": 1.219787982979206e-06, "in-drivable-lane": 5.2000000000000135, "deviation-heading": 0.9195005304608064, "agent_compute-ego0": 0.01237548722161187, "complete-iteration": 0.14969110007237907, "set_robot_commands": 0.002105768280799943, "deviation-center-line": 0.16756142902280896, "driven_lanedir_consec": 0.7185360145818402, "sim_compute_sim_state": 0.005048308709655145, "sim_compute_performance-ego0": 0.0018601562037612453}}
set_robot_commands_max0.002266707266798426
set_robot_commands_mean0.0021746892885020773
set_robot_commands_median0.00218359179542444
set_robot_commands_min0.0020648662963610015
sim_compute_performance-ego0_max0.002078440266783093
sim_compute_performance-ego0_mean0.0019772797265168274
sim_compute_performance-ego0_median0.001985261217761486
sim_compute_performance-ego0_min0.0018601562037612453
sim_compute_sim_state_max0.012401851391771548
sim_compute_sim_state_mean0.009369037534369636
sim_compute_sim_state_median0.010012995018025928
sim_compute_sim_state_min0.005048308709655145
sim_render-ego0_max0.003984031629602081
sim_render-ego0_mean0.003872490592621288
sim_render-ego0_median0.003876886297585595
sim_render-ego0_min0.003752158145711879
simulation-passed1
step_physics_max0.13723093141567405
step_physics_mean0.11571821544340267
step_physics_median0.11732063252002724
step_physics_min0.0910006653178822
survival_time_max59.99999999999873
survival_time_mean36.24999999999943
survival_time_min9.850000000000003
No reset possible
5664211099Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:04:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6673319391891934
survival_time_median5.299999999999989
deviation-center-line_median0.1177648377554634
in-drivable-lane_median2.6999999999999904


other stats
agent_compute-ego0_max0.013701968980066984
agent_compute-ego0_mean0.012960431899751008
agent_compute-ego0_median0.01283102537804152
agent_compute-ego0_min0.012477707862854005
complete-iteration_max0.24997434860620743
complete-iteration_mean0.19510139906718965
complete-iteration_median0.19025777226241777
complete-iteration_min0.14991570313771566
deviation-center-line_max0.2637796641671393
deviation-center-line_mean0.13765229854232314
deviation-center-line_min0.05129985449122637
deviation-heading_max0.8720742701343996
deviation-heading_mean0.6083896508397842
deviation-heading_median0.6008401465164409
deviation-heading_min0.3598040401918552
driven_any_max1.7155729655655356
driven_any_mean1.2437745482133913
driven_any_median1.4797162565100852
driven_any_min0.30009271426785866
driven_lanedir_consec_max0.7512951150545382
driven_lanedir_consec_mean0.5584479750064535
driven_lanedir_consec_min0.14783290659288895
driven_lanedir_max0.7512951150545382
driven_lanedir_mean0.5584479750064535
driven_lanedir_median0.6673319391891934
driven_lanedir_min0.14783290659288895
get_duckie_state_max1.467547370392142e-06
get_duckie_state_mean1.291624198576427e-06
get_duckie_state_median1.2625982095529367e-06
get_duckie_state_min1.1737530048076924e-06
get_robot_state_max0.003799642173989306
get_robot_state_mean0.003653057130416108
get_robot_state_median0.003609060301437034
get_robot_state_min0.003594465744801057
get_state_dump_max0.004805099616930323
get_state_dump_mean0.00469013840078001
get_state_dump_median0.004701547875060691
get_state_dump_min0.004552358236068334
get_ui_image_max0.033152103424072266
get_ui_image_mean0.029857338110204447
get_ui_image_median0.03017884123245062
get_ui_image_min0.02591956655184428
in-drivable-lane_max3.699999999999987
in-drivable-lane_mean2.5249999999999924
in-drivable-lane_min1.0000000000000009
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.558321623080647, "get_ui_image": 0.027988841941764764, "step_physics": 0.12056732822108912, "survival_time": 5.4999999999999885, "driven_lanedir": 0.7512951150545382, "get_state_dump": 0.00472397417635531, "get_robot_state": 0.003611830977706222, "sim_render-ego0": 0.003675961279654288, "get_duckie_state": 1.2178678770323057e-06, "in-drivable-lane": 2.84999999999999, "deviation-heading": 0.8720742701343996, "agent_compute-ego0": 0.012619325706550668, "complete-iteration": 0.1853961450559599, "set_robot_commands": 0.0022083230920740076, "deviation-center-line": 0.2637796641671393, "driven_lanedir_consec": 0.7512951150545382, "sim_compute_sim_state": 0.007995375641831406, "sim_compute_performance-ego0": 0.0019212112770424232}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.30009271426785866, "get_ui_image": 0.033152103424072266, "step_physics": 0.180418149018899, "survival_time": 1.900000000000001, "driven_lanedir": 0.14783290659288895, "get_state_dump": 0.004552358236068334, "get_robot_state": 0.003594465744801057, "sim_render-ego0": 0.003668106519258939, "get_duckie_state": 1.1737530048076924e-06, "in-drivable-lane": 1.0000000000000009, "deviation-heading": 0.5660276848441617, "agent_compute-ego0": 0.013042725049532376, "complete-iteration": 0.24997434860620743, "set_robot_commands": 0.0020816754072140423, "deviation-center-line": 0.05129985449122637, "driven_lanedir_consec": 0.14783290659288895, "sim_compute_sim_state": 0.007579901279547276, "sim_compute_performance-ego0": 0.0018062897217579377}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4011108899395237, "get_ui_image": 0.032368840523136475, "step_physics": 0.12328205988245104, "survival_time": 5.09999999999999, "driven_lanedir": 0.6849102096941916, "get_state_dump": 0.004805099616930323, "get_robot_state": 0.003799642173989306, "sim_render-ego0": 0.004053393613944933, "get_duckie_state": 1.467547370392142e-06, "in-drivable-lane": 2.549999999999991, "deviation-heading": 0.6356526081887202, "agent_compute-ego0": 0.013701968980066984, "complete-iteration": 0.19511939946887563, "set_robot_commands": 0.002305637285547349, "deviation-center-line": 0.111098277293138, "driven_lanedir_consec": 0.6849102096941916, "sim_compute_sim_state": 0.00859623742335051, "sim_compute_performance-ego0": 0.0021121941723869844}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7155729655655356, "get_ui_image": 0.02591956655184428, "step_physics": 0.09028149048487344, "survival_time": 5.949999999999987, "driven_lanedir": 0.6497536686841954, "get_state_dump": 0.0046791215737660725, "get_robot_state": 0.0036062896251678462, "sim_render-ego0": 0.0038253764311472578, "get_duckie_state": 1.3073285420735675e-06, "in-drivable-lane": 3.699999999999987, "deviation-heading": 0.3598040401918552, "agent_compute-ego0": 0.012477707862854005, "complete-iteration": 0.14991570313771566, "set_robot_commands": 0.002212520440419515, "deviation-center-line": 0.1244313982177888, "driven_lanedir_consec": 0.6497536686841954, "sim_compute_sim_state": 0.004810516039530436, "sim_compute_performance-ego0": 0.0020130197207132976}}
set_robot_commands_max0.002305637285547349
set_robot_commands_mean0.002202039056313728
set_robot_commands_median0.002210421766246761
set_robot_commands_min0.0020816754072140423
sim_compute_performance-ego0_max0.0021121941723869844
sim_compute_performance-ego0_mean0.0019631787229751605
sim_compute_performance-ego0_median0.00196711549887786
sim_compute_performance-ego0_min0.0018062897217579377
sim_compute_sim_state_max0.00859623742335051
sim_compute_sim_state_mean0.0072455075960649075
sim_compute_sim_state_median0.007787638460689341
sim_compute_sim_state_min0.004810516039530436
sim_render-ego0_max0.004053393613944933
sim_render-ego0_mean0.0038057094610013543
sim_render-ego0_median0.0037506688554007728
sim_render-ego0_min0.003668106519258939
simulation-passed1
step_physics_max0.180418149018899
step_physics_mean0.12863725690182817
step_physics_median0.12192469405177007
step_physics_min0.09028149048487344
survival_time_max5.949999999999987
survival_time_mean4.612499999999992
survival_time_min1.900000000000001
No reset possible
5648511115Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:05:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5641411133Mo Kleit 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:02:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5639411427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-040:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5624011136Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:02:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5620511140Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 68, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 62, in compute_action
              ||     observation = self.preprocessor.preprocess(observation)
              ||   File "/workspace/wrappers.py", line 19, in preprocess
              ||     obs = cv2.cvtColor(obs, cv2.COLOR_BGR2RGB)
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-99ib2vsi/opencv/modules/imgproc/src/color.simd_helpers.hpp:92: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Invalid number of channels in input image:
              || >     'VScn::contains(scn)'
              || > where
              || >     'scn' is 120
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5611711142Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:06:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5610711284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:59
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5606711143Ayman Shams 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:02:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5602411151Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:54
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5598211151Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:02:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5597211283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:49
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5593911303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:51
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5592811282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:58
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5591011282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5588411287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:01
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5581911281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:01:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5577611281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5573711305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:14
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||