Duckietown Challenges Home Challenges Submissions

Evaluator 4888

ID4888
evaluatornogpu-prod-05
ownerI don't have one 😀
machinenogpu-prod_aa8204f8a7de
processnogpu-prod-05_aa8204f8a7de
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success23 53945
# timeout1 57543
# failed3 54629
# error
# aborted3 57357
# host-error38 53922
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5754310896Dishank Bansal 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutyesnogpu-prod-05----No reset possible
5752810933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-050:03:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5746310916Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:19:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.867337908750964
survival_time_median28.875000000000114
deviation-center-line_median0.999467046628405
in-drivable-lane_median7.749999999999947


other stats
agent_compute-ego0_max0.05219835076252175
agent_compute-ego0_mean0.02824762612799061
agent_compute-ego0_median0.024160918577638253
agent_compute-ego0_min0.012470316594164171
complete-iteration_max0.2274222777634071
complete-iteration_mean0.19888305343362667
complete-iteration_median0.19809530546614423
complete-iteration_min0.17191932503881102
deviation-center-line_max2.177682170925644
deviation-center-line_mean1.1073217128541006
deviation-center-line_min0.25267058723394764
deviation-heading_max6.574982177122018
deviation-heading_mean3.5645977743227863
deviation-heading_median3.4246686765575705
deviation-heading_min0.8340715670539861
driven_any_max6.691440767723821
driven_any_mean4.80817488989176
driven_any_median4.842301876256665
driven_any_min2.8566550393298877
driven_lanedir_consec_max5.903540691704079
driven_lanedir_consec_mean3.595314596705963
driven_lanedir_consec_min0.7430418776178467
driven_lanedir_max5.903540691704079
driven_lanedir_mean3.595314596705963
driven_lanedir_median3.867337908750964
driven_lanedir_min0.7430418776178467
get_duckie_state_max1.5457249220523088e-06
get_duckie_state_mean1.330577543665048e-06
get_duckie_state_median1.2897157926869291e-06
get_duckie_state_min1.197153667234025e-06
get_robot_state_max0.003727173006068395
get_robot_state_mean0.003654871516812895
get_robot_state_median0.003641324512944948
get_robot_state_min0.003609664035293291
get_state_dump_max0.004965100208474271
get_state_dump_mean0.0047757274939970625
get_state_dump_median0.004716089129748247
get_state_dump_min0.004705631508017486
get_ui_image_max0.03551828451257534
get_ui_image_mean0.03078106875456148
get_ui_image_median0.03013729316291823
get_ui_image_min0.02733140417983412
in-drivable-lane_max13.150000000000126
in-drivable-lane_mean7.649999999999977
in-drivable-lane_min1.9499999999998892
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.691440767723821, "get_ui_image": 0.027846174383228502, "step_physics": 0.10490667836240011, "survival_time": 36.60000000000006, "driven_lanedir": 5.837352029440995, "get_state_dump": 0.0047222198600821086, "get_robot_state": 0.003637488184326505, "sim_render-ego0": 0.0039365457480145674, "get_duckie_state": 1.2968279329848972e-06, "in-drivable-lane": 5.39999999999975, "deviation-heading": 5.214377040586471, "agent_compute-ego0": 0.012470316594164171, "complete-iteration": 0.17191932503881102, "set_robot_commands": 0.0024315487964416756, "deviation-center-line": 1.5140200200172755, "driven_lanedir_consec": 5.837352029440995, "sim_compute_sim_state": 0.009879380586527868, "sim_compute_performance-ego0": 0.002004466961057905}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.256255107706402, "get_ui_image": 0.03551828451257534, "step_physics": 0.1285916002339156, "survival_time": 37.74999999999999, "driven_lanedir": 5.903540691704079, "get_state_dump": 0.0047099583994143854, "get_robot_state": 0.003645160841563391, "sim_render-ego0": 0.003874073268244506, "get_duckie_state": 1.2826036523889613e-06, "in-drivable-lane": 1.9499999999998892, "deviation-heading": 6.574982177122018, "agent_compute-ego0": 0.035245054928714006, "complete-iteration": 0.2274222777634071, "set_robot_commands": 0.0022160101819921423, "deviation-center-line": 2.177682170925644, "driven_lanedir_consec": 5.903540691704079, "sim_compute_sim_state": 0.011499619673168848, "sim_compute_performance-ego0": 0.002035907967380746}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.428348644806928, "get_ui_image": 0.032428411942607954, "step_physics": 0.12448121916573004, "survival_time": 21.15000000000017, "driven_lanedir": 1.8973237880609344, "get_state_dump": 0.004705631508017486, "get_robot_state": 0.003609664035293291, "sim_render-ego0": 0.003992607008736089, "get_duckie_state": 1.197153667234025e-06, "in-drivable-lane": 10.100000000000144, "deviation-heading": 1.6349603125286705, "agent_compute-ego0": 0.0130767822265625, "complete-iteration": 0.1973000534300534, "set_robot_commands": 0.002202811668503959, "deviation-center-line": 0.4849140732395346, "driven_lanedir_consec": 1.8973237880609344, "sim_compute_sim_state": 0.010746848470759842, "sim_compute_performance-ego0": 0.0019721804924730984}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.8566550393298877, "get_ui_image": 0.02733140417983412, "step_physics": 0.09653518519588022, "survival_time": 17.85000000000012, "driven_lanedir": 0.7430418776178467, "get_state_dump": 0.004965100208474271, "get_robot_state": 0.003727173006068395, "sim_render-ego0": 0.004005513377695776, "get_duckie_state": 1.5457249220523088e-06, "in-drivable-lane": 13.150000000000126, "deviation-heading": 0.8340715670539861, "agent_compute-ego0": 0.05219835076252175, "complete-iteration": 0.1988905575022351, "set_robot_commands": 0.0023204874060007447, "deviation-center-line": 0.25267058723394764, "driven_lanedir_consec": 0.7430418776178467, "sim_compute_sim_state": 0.005732221310365134, "sim_compute_performance-ego0": 0.0019822939814136014}}
set_robot_commands_max0.0024315487964416756
set_robot_commands_mean0.0022927145132346305
set_robot_commands_median0.0022682487939964437
set_robot_commands_min0.002202811668503959
sim_compute_performance-ego0_max0.002035907967380746
sim_compute_performance-ego0_mean0.0019987123505813375
sim_compute_performance-ego0_median0.001993380471235753
sim_compute_performance-ego0_min0.0019721804924730984
sim_compute_sim_state_max0.011499619673168848
sim_compute_sim_state_mean0.009464517510205423
sim_compute_sim_state_median0.010313114528643856
sim_compute_sim_state_min0.005732221310365134
sim_render-ego0_max0.004005513377695776
sim_render-ego0_mean0.003952184850672735
sim_render-ego0_median0.0039645763783753285
sim_render-ego0_min0.003874073268244506
simulation-passed1
step_physics_max0.1285916002339156
step_physics_mean0.11362867073948148
step_physics_median0.11469394876406508
step_physics_min0.09653518519588022
survival_time_max37.74999999999999
survival_time_mean28.337500000000087
survival_time_min17.85000000000012
No reset possible
5743611010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-050:03:46
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5738810946Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:10:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4412446582958393
survival_time_median10.675000000000017
deviation-center-line_median0.24285333324582983
in-drivable-lane_median8.000000000000002


other stats
agent_compute-ego0_max0.012871271626079253
agent_compute-ego0_mean0.01259445454374247
agent_compute-ego0_median0.01261442717578676
agent_compute-ego0_min0.0122776921973171
complete-iteration_max0.20557018518447875
complete-iteration_mean0.17616621957923467
complete-iteration_median0.17271916171071905
complete-iteration_min0.1536563697110218
deviation-center-line_max0.386598464932263
deviation-center-line_mean0.23995933322115917
deviation-center-line_min0.08753220146071394
deviation-heading_max3.1359297518379883
deviation-heading_mean1.5154954326936587
deviation-heading_median1.1828617351232458
deviation-heading_min0.5603285086901558
driven_any_max4.184433547463574
driven_any_mean2.208574079544635
driven_any_median2.01990263530159
driven_any_min0.6100575001117864
driven_lanedir_consec_max0.6925116594982393
driven_lanedir_consec_mean0.4397840174769253
driven_lanedir_consec_min0.18413509381778329
driven_lanedir_max0.6925116594982393
driven_lanedir_mean0.4397840174769253
driven_lanedir_median0.4412446582958393
driven_lanedir_min0.18413509381778329
get_duckie_state_max2.162986331515842e-06
get_duckie_state_mean1.8995831715077192e-06
get_duckie_state_median1.860891719419793e-06
get_duckie_state_min1.713562915675448e-06
get_robot_state_max0.003854784700605604
get_robot_state_mean0.003696954258527612
get_robot_state_median0.003668085566911652
get_robot_state_min0.0035968611996815385
get_state_dump_max0.004784511195288764
get_state_dump_mean0.004538902047905814
get_state_dump_median0.004495673849119395
get_state_dump_min0.004379749298095703
get_ui_image_max0.033835726976394656
get_ui_image_mean0.029570625561330503
get_ui_image_median0.029295055411631105
get_ui_image_min0.02585666444566515
in-drivable-lane_max16.150000000000123
in-drivable-lane_mean8.675000000000031
in-drivable-lane_min2.5499999999999936
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.381546659231254, "get_ui_image": 0.026379755701884687, "step_physics": 0.08980824956932221, "survival_time": 12.40000000000004, "driven_lanedir": 0.5760757949809369, "get_state_dump": 0.004379749298095703, "get_robot_state": 0.0035968611996815385, "sim_render-ego0": 0.00390833831695189, "get_duckie_state": 1.8949010764738645e-06, "in-drivable-lane": 8.950000000000012, "deviation-heading": 1.5893703084818758, "agent_compute-ego0": 0.0122776921973171, "complete-iteration": 0.1536563697110218, "set_robot_commands": 0.0021755072965200647, "deviation-center-line": 0.3587070142522617, "driven_lanedir_consec": 0.5760757949809369, "sim_compute_sim_state": 0.00906901378708192, "sim_compute_performance-ego0": 0.0019762219195385055}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6100575001117864, "get_ui_image": 0.033835726976394656, "step_physics": 0.13327692151069642, "survival_time": 3.949999999999994, "driven_lanedir": 0.18413509381778329, "get_state_dump": 0.004452532529830933, "get_robot_state": 0.003649047017097473, "sim_render-ego0": 0.0038254469633102416, "get_duckie_state": 1.8268823623657224e-06, "in-drivable-lane": 2.5499999999999936, "deviation-heading": 0.7763531617646156, "agent_compute-ego0": 0.012517109513282776, "complete-iteration": 0.20557018518447875, "set_robot_commands": 0.0021215051412582396, "deviation-center-line": 0.08753220146071394, "driven_lanedir_consec": 0.18413509381778329, "sim_compute_sim_state": 0.009854790568351746, "sim_compute_performance-ego0": 0.0019499659538269043}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.184433547463574, "get_ui_image": 0.03221035512137752, "step_physics": 0.10775136891134544, "survival_time": 21.050000000000164, "driven_lanedir": 0.6925116594982393, "get_state_dump": 0.004538815168407856, "get_robot_state": 0.003687124116725831, "sim_render-ego0": 0.0040997617052629665, "get_duckie_state": 1.713562915675448e-06, "in-drivable-lane": 16.150000000000123, "deviation-heading": 3.1359297518379883, "agent_compute-ego0": 0.012871271626079253, "complete-iteration": 0.180818219320469, "set_robot_commands": 0.0022318628726977307, "deviation-center-line": 0.386598464932263, "driven_lanedir_consec": 0.6925116594982393, "sim_compute_sim_state": 0.011345419838530192, "sim_compute_performance-ego0": 0.0019968889335885433}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.658258611371925, "get_ui_image": 0.02585666444566515, "step_physics": 0.10323878659142388, "survival_time": 8.949999999999992, "driven_lanedir": 0.30641352161074176, "get_state_dump": 0.004784511195288764, "get_robot_state": 0.003854784700605604, "sim_render-ego0": 0.004121861192915174, "get_duckie_state": 2.162986331515842e-06, "in-drivable-lane": 7.049999999999991, "deviation-heading": 0.5603285086901558, "agent_compute-ego0": 0.012711744838290745, "complete-iteration": 0.1646201041009691, "set_robot_commands": 0.0023324754503038195, "deviation-center-line": 0.12699965223939802, "driven_lanedir_consec": 0.30641352161074176, "sim_compute_sim_state": 0.005524110794067383, "sim_compute_performance-ego0": 0.0020979338222079807}}
set_robot_commands_max0.0023324754503038195
set_robot_commands_mean0.0022153376901949636
set_robot_commands_median0.0022036850846088975
set_robot_commands_min0.0021215051412582396
sim_compute_performance-ego0_max0.0020979338222079807
sim_compute_performance-ego0_mean0.0020052526572904832
sim_compute_performance-ego0_median0.001986555426563524
sim_compute_performance-ego0_min0.0019499659538269043
sim_compute_sim_state_max0.011345419838530192
sim_compute_sim_state_mean0.00894833374700781
sim_compute_sim_state_median0.009461902177716834
sim_compute_sim_state_min0.005524110794067383
sim_render-ego0_max0.004121861192915174
sim_render-ego0_mean0.0039888520446100684
sim_render-ego0_median0.004004050011107428
sim_render-ego0_min0.0038254469633102416
simulation-passed1
step_physics_max0.13327692151069642
step_physics_mean0.108518831645697
step_physics_median0.10549507775138466
step_physics_min0.08980824956932221
survival_time_max21.050000000000164
survival_time_mean11.587500000000048
survival_time_min3.949999999999994
No reset possible
5736911426Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-testingLFP-simhost-erroryesnogpu-prod-050:03:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5735711012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-050:00:54
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5724510978Philippe Reddy 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:24:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.617251978226594
survival_time_median35.10000000000008
deviation-center-line_median1.8876731189062808
in-drivable-lane_median11.699999999999925


other stats
agent_compute-ego0_max0.04393496537449384
agent_compute-ego0_mean0.03644428131569861
agent_compute-ego0_median0.034523479628798634
agent_compute-ego0_min0.03279520063070332
complete-iteration_max0.23257929022167248
complete-iteration_mean0.1995473562360667
complete-iteration_median0.19312950962751096
complete-iteration_min0.17935111546757246
deviation-center-line_max3.218194136012909
deviation-center-line_mean1.7738257505182806
deviation-center-line_min0.10176262824765164
deviation-heading_max9.04686578393731
deviation-heading_mean4.570592852914481
deviation-heading_median4.313602159635396
deviation-heading_min0.6083013084498217
driven_any_max12.506589783206987
driven_any_mean7.155841011217437
driven_any_median7.134915952372982
driven_any_min1.8469423569167949
driven_lanedir_consec_max7.3300229152234815
driven_lanedir_consec_mean4.317384610060815
driven_lanedir_consec_min0.7050115685665883
driven_lanedir_max8.632565237314804
driven_lanedir_mean4.646544789639323
driven_lanedir_median4.6243011763379505
driven_lanedir_min0.7050115685665883
get_duckie_state_max1.8059065895811108e-06
get_duckie_state_mean1.665328478835354e-06
get_duckie_state_median1.663350195117977e-06
get_duckie_state_min1.5287069355243512e-06
get_robot_state_max0.003613133513857979
get_robot_state_mean0.003558621670046832
get_robot_state_median0.003565069144999628
get_robot_state_min0.003491214876330093
get_state_dump_max0.004610719947877787
get_state_dump_mean0.0045491559002961745
get_state_dump_median0.004582097088635213
get_state_dump_min0.004421709476036482
get_ui_image_max0.03506884527246124
get_ui_image_mean0.029483757519251422
get_ui_image_median0.02847395589695262
get_ui_image_min0.025918273010639228
in-drivable-lane_max16.699999999999633
in-drivable-lane_mean11.524999999999874
in-drivable-lane_min6.000000000000011
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.146380130956326, "get_ui_image": 0.026922387981295436, "step_physics": 0.09881113229018726, "survival_time": 39.89999999999987, "driven_lanedir": 6.15340638184437, "get_state_dump": 0.004421709476036482, "get_robot_state": 0.003491214876330093, "sim_render-ego0": 0.003692012256913549, "get_duckie_state": 1.637300054480943e-06, "in-drivable-lane": 9.349999999999667, "deviation-heading": 4.583507563187711, "agent_compute-ego0": 0.03400357434985336, "complete-iteration": 0.18434545901302105, "set_robot_commands": 0.002132872616095895, "deviation-center-line": 2.395368592656406, "driven_lanedir_consec": 6.15340638184437, "sim_compute_sim_state": 0.008932001152086318, "sim_compute_performance-ego0": 0.0018548828191840751}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.506589783206987, "get_ui_image": 0.03506884527246124, "step_physics": 0.1324647185605928, "survival_time": 59.99999999999873, "driven_lanedir": 8.632565237314804, "get_state_dump": 0.0045750772426964145, "get_robot_state": 0.003613133513857979, "sim_render-ego0": 0.003916269734340544, "get_duckie_state": 1.8059065895811108e-06, "in-drivable-lane": 16.699999999999633, "deviation-heading": 9.04686578393731, "agent_compute-ego0": 0.03504338490774391, "complete-iteration": 0.23257929022167248, "set_robot_commands": 0.0022292291989036645, "deviation-center-line": 3.218194136012909, "driven_lanedir_consec": 7.3300229152234815, "sim_compute_sim_state": 0.013588269088389376, "sim_compute_performance-ego0": 0.001990581928542214}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.123451773789637, "get_ui_image": 0.030025523812609804, "step_physics": 0.11095557063572488, "survival_time": 30.300000000000296, "driven_lanedir": 3.0951959708315315, "get_state_dump": 0.004610719947877787, "get_robot_state": 0.0035787779573946453, "sim_render-ego0": 0.0037937451037386495, "get_duckie_state": 1.5287069355243512e-06, "in-drivable-lane": 14.05000000000018, "deviation-heading": 4.043696756083081, "agent_compute-ego0": 0.03279520063070332, "complete-iteration": 0.20191356024200088, "set_robot_commands": 0.0021568578000516437, "deviation-center-line": 1.3799776451561552, "driven_lanedir_consec": 3.08109757460882, "sim_compute_sim_state": 0.01195987720269544, "sim_compute_performance-ego0": 0.001954978930302075}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8469423569167949, "get_ui_image": 0.025918273010639228, "step_physics": 0.08825855182878899, "survival_time": 9.850000000000003, "driven_lanedir": 0.7050115685665883, "get_state_dump": 0.004589116934574012, "get_robot_state": 0.0035513603326046105, "sim_render-ego0": 0.003820990071152196, "get_duckie_state": 1.689400335755011e-06, "in-drivable-lane": 6.000000000000011, "deviation-heading": 0.6083013084498217, "agent_compute-ego0": 0.04393496537449384, "complete-iteration": 0.17935111546757246, "set_robot_commands": 0.0022290848722361554, "deviation-center-line": 0.10176262824765164, "driven_lanedir_consec": 0.7050115685665883, "sim_compute_sim_state": 0.005052009014168171, "sim_compute_performance-ego0": 0.0019112536401459663}}
set_robot_commands_max0.0022292291989036645
set_robot_commands_mean0.0021870111218218395
set_robot_commands_median0.0021929713361438993
set_robot_commands_min0.002132872616095895
sim_compute_performance-ego0_max0.001990581928542214
sim_compute_performance-ego0_mean0.0019279243295435829
sim_compute_performance-ego0_median0.0019331162852240207
sim_compute_performance-ego0_min0.0018548828191840751
sim_compute_sim_state_max0.013588269088389376
sim_compute_sim_state_mean0.009883039114334826
sim_compute_sim_state_median0.01044593917739088
sim_compute_sim_state_min0.005052009014168171
sim_render-ego0_max0.003916269734340544
sim_render-ego0_mean0.003805754291536234
sim_render-ego0_median0.003807367587445423
sim_render-ego0_min0.003692012256913549
simulation-passed1
step_physics_max0.1324647185605928
step_physics_mean0.1076224933288235
step_physics_median0.10488335146295608
step_physics_min0.08825855182878899
survival_time_max59.99999999999873
survival_time_mean35.01249999999972
survival_time_min9.850000000000003
No reset possible
5712711015Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:32:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.322567958511052
survival_time_median59.99999999999873
deviation-center-line_median3.0961780691533165
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.03790706301807464
agent_compute-ego0_mean0.02527146302874482
agent_compute-ego0_median0.025244620661948797
agent_compute-ego0_min0.012689547773007051
complete-iteration_max0.2220472762705651
complete-iteration_mean0.19069670676192152
complete-iteration_median0.18932549155423484
complete-iteration_min0.16208856766865115
deviation-center-line_max3.682623172335518
deviation-center-line_mean2.7382966309913184
deviation-center-line_min1.078207213323122
deviation-heading_max11.630947626024136
deviation-heading_mean8.205394936614526
deviation-heading_median8.612018083679754
deviation-heading_min3.96659595307446
driven_any_max8.259648155454729
driven_any_mean6.677150028970629
driven_any_median7.46231679267069
driven_any_min3.524318375086404
driven_lanedir_consec_max8.132430414466537
driven_lanedir_consec_mean6.224654584914865
driven_lanedir_consec_min2.1210520081708193
driven_lanedir_max8.132430414466537
driven_lanedir_mean6.224654584914865
driven_lanedir_median7.322567958511052
driven_lanedir_min2.1210520081708193
get_duckie_state_max1.5522022231433117e-06
get_duckie_state_mean1.369517618934184e-06
get_duckie_state_median1.3298643105141283e-06
get_duckie_state_min1.266139631565167e-06
get_robot_state_max0.004043429022923198
get_robot_state_mean0.0038237325318397097
get_robot_state_median0.0037870561473172
get_robot_state_min0.00367738880980124
get_state_dump_max0.005016246505025821
get_state_dump_mean0.004813140844419933
get_state_dump_median0.004756116391210133
get_state_dump_min0.004724084090233643
get_ui_image_max0.03593687457070608
get_ui_image_mean0.031070469633132015
get_ui_image_median0.030646414979113627
get_ui_image_min0.02705217400359472
in-drivable-lane_max11.800000000000168
in-drivable-lane_mean2.950000000000042
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.259648155454729, "get_ui_image": 0.02838733531751799, "step_physics": 0.0948626602023567, "survival_time": 59.99999999999873, "driven_lanedir": 8.132430414466537, "get_state_dump": 0.004724084090233643, "get_robot_state": 0.00367738880980124, "sim_render-ego0": 0.003952643952699227, "get_duckie_state": 1.3201361790386267e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.699972227648395, "agent_compute-ego0": 0.012689547773007051, "complete-iteration": 0.16208856766865115, "set_robot_commands": 0.002226365198203666, "deviation-center-line": 2.7223536621402604, "driven_lanedir_consec": 8.132430414466537, "sim_compute_sim_state": 0.00948907532957968, "sim_compute_performance-ego0": 0.0019941923521043458}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.524318375086404, "get_ui_image": 0.03593687457070608, "step_physics": 0.1197872544271466, "survival_time": 30.5000000000003, "driven_lanedir": 2.1210520081708193, "get_state_dump": 0.0047857488235748345, "get_robot_state": 0.003791825861080189, "sim_render-ego0": 0.004017319109553011, "get_duckie_state": 1.3395924419896302e-06, "in-drivable-lane": 11.800000000000168, "deviation-heading": 3.96659595307446, "agent_compute-ego0": 0.037623128016919825, "complete-iteration": 0.2220472762705651, "set_robot_commands": 0.0023060574664226724, "deviation-center-line": 1.078207213323122, "driven_lanedir_consec": 2.1210520081708193, "sim_compute_sim_state": 0.011670012715990531, "sim_compute_performance-ego0": 0.002040269917239924}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.13873380488805, "get_ui_image": 0.03290549464070926, "step_physics": 0.1136734116385124, "survival_time": 59.99999999999873, "driven_lanedir": 6.963489517543526, "get_state_dump": 0.004726483958845432, "get_robot_state": 0.003782286433554212, "sim_render-ego0": 0.0040440472039850826, "get_duckie_state": 1.266139631565167e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.630947626024136, "agent_compute-ego0": 0.012866113306977766, "complete-iteration": 0.1896536711550672, "set_robot_commands": 0.002281829181261404, "deviation-center-line": 3.682623172335518, "driven_lanedir_consec": 6.963489517543526, "sim_compute_sim_state": 0.013194538572249464, "sim_compute_performance-ego0": 0.0020931981981644325}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.785899780453331, "get_ui_image": 0.02705217400359472, "step_physics": 0.09937991766409512, "survival_time": 59.99999999999873, "driven_lanedir": 7.681646399478578, "get_state_dump": 0.005016246505025821, "get_robot_state": 0.004043429022923198, "sim_render-ego0": 0.004168451874579716, "get_duckie_state": 1.5522022231433117e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.524063939711114, "agent_compute-ego0": 0.03790706301807464, "complete-iteration": 0.18899731195340247, "set_robot_commands": 0.0024188420456910907, "deviation-center-line": 3.4700024761663726, "driven_lanedir_consec": 7.681646399478578, "sim_compute_sim_state": 0.006701423166991273, "sim_compute_performance-ego0": 0.002212672110501178}}
set_robot_commands_max0.0024188420456910907
set_robot_commands_mean0.002308273472894708
set_robot_commands_median0.002293943323842038
set_robot_commands_min0.002226365198203666
sim_compute_performance-ego0_max0.002212672110501178
sim_compute_performance-ego0_mean0.0020850831445024696
sim_compute_performance-ego0_median0.0020667340577021783
sim_compute_performance-ego0_min0.0019941923521043458
sim_compute_sim_state_max0.013194538572249464
sim_compute_sim_state_mean0.010263762446202735
sim_compute_sim_state_median0.010579544022785103
sim_compute_sim_state_min0.006701423166991273
sim_render-ego0_max0.004168451874579716
sim_render-ego0_mean0.004045615535204259
sim_render-ego0_median0.004030683156769047
sim_render-ego0_min0.003952643952699227
simulation-passed1
step_physics_max0.1197872544271466
step_physics_mean0.1069258109830277
step_physics_median0.10652666465130375
step_physics_min0.0948626602023567
survival_time_max59.99999999999873
survival_time_mean52.62499999999912
survival_time_min30.5000000000003
No reset possible
5700411042Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:20:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9822393306359408
survival_time_median20.90000000000016
deviation-center-line_median0.33927183998865634
in-drivable-lane_median10.4250000000001


other stats
agent_compute-ego0_max0.013554780031565569
agent_compute-ego0_mean0.01306798344096615
agent_compute-ego0_median0.013000946394713823
agent_compute-ego0_min0.012715260942871384
complete-iteration_max0.2051411292332085
complete-iteration_mean0.17795754364411878
complete-iteration_median0.17633300995044413
complete-iteration_min0.1540230254423783
deviation-center-line_max0.8174781950897646
deviation-center-line_mean0.4218753561023099
deviation-center-line_min0.19147954934216233
deviation-heading_max5.065226464396504
deviation-heading_mean2.531637705893561
deviation-heading_median2.0424852161257747
deviation-heading_min0.9763539269261888
driven_any_max9.640126752704552
driven_any_mean4.2840864292888785
driven_any_median2.979535177529125
driven_any_min1.537148609392714
driven_lanedir_consec_max2.0299967283135953
driven_lanedir_consec_mean1.1711056348419944
driven_lanedir_consec_min0.6899471497825004
driven_lanedir_max2.146926809052315
driven_lanedir_mean1.395336902965985
driven_lanedir_median1.367289912901292
driven_lanedir_min0.699840977009041
get_duckie_state_max1.29174828827133e-06
get_duckie_state_mean1.2587506691438114e-06
get_duckie_state_median1.2630023081720698e-06
get_duckie_state_min1.217249771959776e-06
get_robot_state_max0.003697142622987246
get_robot_state_mean0.003648965855529363
get_robot_state_median0.003659149193187844
get_robot_state_min0.003580422412754521
get_state_dump_max0.004698790712839997
get_state_dump_mean0.004577469647515075
get_state_dump_median0.004573345744409912
get_state_dump_min0.004464396388400479
get_ui_image_max0.033972165363701394
get_ui_image_mean0.03001383481000412
get_ui_image_median0.030055770738498883
get_ui_image_min0.025971632399317303
in-drivable-lane_max47.09999999999868
in-drivable-lane_mean18.36249999999973
in-drivable-lane_min5.500000000000046
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.640126752704552, "get_ui_image": 0.02766352013485517, "step_physics": 0.0920782319512792, "survival_time": 59.99999999999873, "driven_lanedir": 2.0299967283135953, "get_state_dump": 0.004565462482461921, "get_robot_state": 0.0036564131362749872, "sim_render-ego0": 0.0039943348458168606, "get_duckie_state": 1.29174828827133e-06, "in-drivable-lane": 47.09999999999868, "deviation-heading": 2.10364193409864, "agent_compute-ego0": 0.013274366313670696, "complete-iteration": 0.15832090814544397, "set_robot_commands": 0.002209279658296126, "deviation-center-line": 0.42294147674737864, "driven_lanedir_consec": 2.0299967283135953, "sim_compute_sim_state": 0.008784211148429573, "sim_compute_performance-ego0": 0.0020138177149103247}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.0951053867344434, "get_ui_image": 0.033972165363701394, "step_physics": 0.13131560792266048, "survival_time": 21.000000000000163, "driven_lanedir": 2.146926809052315, "get_state_dump": 0.004464396388400479, "get_robot_state": 0.003580422412754521, "sim_render-ego0": 0.003842097280144408, "get_duckie_state": 1.2866674862678148e-06, "in-drivable-lane": 5.500000000000046, "deviation-heading": 5.065226464396504, "agent_compute-ego0": 0.012715260942871384, "complete-iteration": 0.2051411292332085, "set_robot_commands": 0.00219373521782157, "deviation-center-line": 0.8174781950897646, "driven_lanedir_consec": 1.2646376842628408, "sim_compute_sim_state": 0.01097717590966304, "sim_compute_performance-ego0": 0.0019987739463316855}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.8639649683238058, "get_ui_image": 0.03244802134214259, "step_physics": 0.12315869903107056, "survival_time": 20.80000000000016, "driven_lanedir": 0.7045830974889885, "get_state_dump": 0.004581229006357902, "get_robot_state": 0.0036618852501007007, "sim_render-ego0": 0.004014645834906782, "get_duckie_state": 1.217249771959776e-06, "in-drivable-lane": 15.000000000000174, "deviation-heading": 1.9813284981529096, "agent_compute-ego0": 0.013554780031565569, "complete-iteration": 0.19434511175544428, "set_robot_commands": 0.002210938959098834, "deviation-center-line": 0.25560220322993404, "driven_lanedir_consec": 0.6899471497825004, "sim_compute_sim_state": 0.008643566561545685, "sim_compute_performance-ego0": 0.0019884744136453533}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.537148609392714, "get_ui_image": 0.025971632399317303, "step_physics": 0.09350567918768676, "survival_time": 10.800000000000018, "driven_lanedir": 0.699840977009041, "get_state_dump": 0.004698790712839997, "get_robot_state": 0.003697142622987246, "sim_render-ego0": 0.003896076009020827, "get_duckie_state": 1.2393371300763248e-06, "in-drivable-lane": 5.850000000000028, "deviation-heading": 0.9763539269261888, "agent_compute-ego0": 0.012727526475756947, "complete-iteration": 0.1540230254423783, "set_robot_commands": 0.0022346511963875063, "deviation-center-line": 0.19147954934216233, "driven_lanedir_consec": 0.699840977009041, "sim_compute_sim_state": 0.005288641573646651, "sim_compute_performance-ego0": 0.0019216449579335577}}
set_robot_commands_max0.0022346511963875063
set_robot_commands_mean0.002212151257901009
set_robot_commands_median0.00221010930869748
set_robot_commands_min0.00219373521782157
sim_compute_performance-ego0_max0.0020138177149103247
sim_compute_performance-ego0_mean0.00198067775820523
sim_compute_performance-ego0_median0.001993624179988519
sim_compute_performance-ego0_min0.0019216449579335577
sim_compute_sim_state_max0.01097717590966304
sim_compute_sim_state_mean0.008423398798321238
sim_compute_sim_state_median0.008713888854987629
sim_compute_sim_state_min0.005288641573646651
sim_render-ego0_max0.004014645834906782
sim_render-ego0_mean0.003936788492472219
sim_render-ego0_median0.003945205427418844
sim_render-ego0_min0.003842097280144408
simulation-passed1
step_physics_max0.13131560792266048
step_physics_mean0.11001455452317424
step_physics_median0.10833218910937868
step_physics_min0.0920782319512792
survival_time_max59.99999999999873
survival_time_mean28.149999999999764
survival_time_min10.800000000000018
No reset possible
5698711313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-050:01:03
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5697211312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-050:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5695711312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-050:03:18
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5695011283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:14
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5693911283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5692711282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:09
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5687411067Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:08:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.33125336066698896
survival_time_median8.574999999999994
deviation-center-line_median0.13020002713835033
in-drivable-lane_median6.499999999999994


other stats
agent_compute-ego0_max0.013785411076373363
agent_compute-ego0_mean0.012903093547535051
agent_compute-ego0_median0.012696175246403136
agent_compute-ego0_min0.012434612620960584
complete-iteration_max0.21607649469950113
complete-iteration_mean0.17694737276438388
complete-iteration_median0.17316009908634294
complete-iteration_min0.1453927981853485
deviation-center-line_max0.3582480361712454
deviation-center-line_mean0.17821800375088356
deviation-center-line_min0.0942239245555882
deviation-heading_max1.8360971496363152
deviation-heading_mean0.9714685263236874
deviation-heading_median0.73896553523825
deviation-heading_min0.5718458851819346
driven_any_max3.076857727560073
driven_any_mean1.6441554910044405
driven_any_median1.439611654932459
driven_any_min0.6205409265927703
driven_lanedir_consec_max0.638406755711705
driven_lanedir_consec_mean0.3737138870438259
driven_lanedir_consec_min0.1939420711296207
driven_lanedir_max0.638406755711705
driven_lanedir_mean0.3737138870438259
driven_lanedir_median0.33125336066698896
driven_lanedir_min0.1939420711296207
get_duckie_state_max1.53679445565465e-06
get_duckie_state_mean1.4255848709338216e-06
get_duckie_state_median1.4480858138113312e-06
get_duckie_state_min1.269373400457974e-06
get_robot_state_max0.003915338631135872
get_robot_state_mean0.003679878698073262
get_robot_state_median0.0036425637351806383
get_robot_state_min0.0035190486907958982
get_state_dump_max0.005013184375073536
get_state_dump_mean0.004801337480307919
get_state_dump_median0.004753782358040007
get_state_dump_min0.004684600830078125
get_ui_image_max0.03471582768911339
get_ui_image_mean0.02963666031430068
get_ui_image_median0.02939765473269121
get_ui_image_min0.02503550410270691
in-drivable-lane_max12.000000000000052
in-drivable-lane_mean6.887500000000009
in-drivable-lane_min2.5499999999999927
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.076857727560073, "get_ui_image": 0.027791592569062204, "step_physics": 0.09570239457217128, "survival_time": 16.4500000000001, "driven_lanedir": 0.638406755711705, "get_state_dump": 0.004796380707711884, "get_robot_state": 0.003635910785559452, "sim_render-ego0": 0.0038190357612841058, "get_duckie_state": 1.440626202207623e-06, "in-drivable-lane": 12.000000000000052, "deviation-heading": 1.8360971496363152, "agent_compute-ego0": 0.012434612620960584, "complete-iteration": 0.16205417026172986, "set_robot_commands": 0.0021420442696773643, "deviation-center-line": 0.3582480361712454, "driven_lanedir_consec": 0.638406755711705, "sim_compute_sim_state": 0.009673798445499303, "sim_compute_performance-ego0": 0.0019704370787649444}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6205409265927703, "get_ui_image": 0.03471582768911339, "step_physics": 0.1399893013827772, "survival_time": 4.099999999999993, "driven_lanedir": 0.1939420711296207, "get_state_dump": 0.005013184375073536, "get_robot_state": 0.003915338631135872, "sim_render-ego0": 0.004134965230183429, "get_duckie_state": 1.53679445565465e-06, "in-drivable-lane": 2.5499999999999927, "deviation-heading": 0.8343713740745141, "agent_compute-ego0": 0.013785411076373363, "complete-iteration": 0.21607649469950113, "set_robot_commands": 0.0023011443126632505, "deviation-center-line": 0.0942239245555882, "driven_lanedir_consec": 0.1939420711296207, "sim_compute_sim_state": 0.009983384465596762, "sim_compute_performance-ego0": 0.002143316958324019}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.1062167831137593, "get_ui_image": 0.031003716896320213, "step_physics": 0.11597394449957486, "survival_time": 7.199999999999982, "driven_lanedir": 0.33091066285740367, "get_state_dump": 0.00471118400836813, "get_robot_state": 0.0036492166848018258, "sim_render-ego0": 0.003860572288776266, "get_duckie_state": 1.269373400457974e-06, "in-drivable-lane": 5.099999999999982, "deviation-heading": 0.6435596964019858, "agent_compute-ego0": 0.012798718748421504, "complete-iteration": 0.18426602791095603, "set_robot_commands": 0.0021700250691380992, "deviation-center-line": 0.12133515795264206, "driven_lanedir_consec": 0.33091066285740367, "sim_compute_sim_state": 0.008021316857173525, "sim_compute_performance-ego0": 0.0019917800508696456}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.773006526751158, "get_ui_image": 0.02503550410270691, "step_physics": 0.08650865077972412, "survival_time": 9.950000000000006, "driven_lanedir": 0.33159605847657425, "get_state_dump": 0.004684600830078125, "get_robot_state": 0.0035190486907958982, "sim_render-ego0": 0.003783861398696899, "get_duckie_state": 1.4555454254150392e-06, "in-drivable-lane": 7.900000000000006, "deviation-heading": 0.5718458851819346, "agent_compute-ego0": 0.012593631744384765, "complete-iteration": 0.1453927981853485, "set_robot_commands": 0.0021311962604522706, "deviation-center-line": 0.1390648963240586, "driven_lanedir_consec": 0.33159605847657425, "sim_compute_sim_state": 0.0051013314723968506, "sim_compute_performance-ego0": 0.0019422757625579832}}
set_robot_commands_max0.0023011443126632505
set_robot_commands_mean0.0021861024779827464
set_robot_commands_median0.002156034669407732
set_robot_commands_min0.0021311962604522706
sim_compute_performance-ego0_max0.002143316958324019
sim_compute_performance-ego0_mean0.002011952462629148
sim_compute_performance-ego0_median0.001981108564817295
sim_compute_performance-ego0_min0.0019422757625579832
sim_compute_sim_state_max0.009983384465596762
sim_compute_sim_state_mean0.00819495781016661
sim_compute_sim_state_median0.008847557651336414
sim_compute_sim_state_min0.0051013314723968506
sim_render-ego0_max0.004134965230183429
sim_render-ego0_mean0.003899608669735175
sim_render-ego0_median0.003839804025030186
sim_render-ego0_min0.003783861398696899
simulation-passed1
step_physics_max0.1399893013827772
step_physics_mean0.10954357280856188
step_physics_median0.10583816953587308
step_physics_min0.08650865077972412
survival_time_max16.4500000000001
survival_time_mean9.42500000000002
survival_time_min4.099999999999993
No reset possible
5683011284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:09
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5682111281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5679611425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-050:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5677411278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:16
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5674911285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:52
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5673411287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5669911427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-050:03:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5631411420Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFVI-sim-validationLFVIv-simsuccessyesnogpu-prod-050:35:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.684236380388404
survival_time_median33.64999999999935
deviation-center-line_median1.595695519866852
in-drivable-lane_median0.7499999999999973


other stats
agent_compute-ego0_max0.04840154874892462
agent_compute-ego0_mean0.04724864858851398
agent_compute-ego0_median0.04724864858851398
agent_compute-ego0_min0.04609574842810333
agent_compute-npc0_max0.04080857702536349
agent_compute-npc0_mean0.03847585563287699
agent_compute-npc0_median0.03847585563287699
agent_compute-npc0_min0.03614313424039049
agent_compute-npc1_max0.04344793839021884
agent_compute-npc1_mean0.03929625212897389
agent_compute-npc1_median0.03929625212897389
agent_compute-npc1_min0.035144565867728926
agent_compute-npc2_max0.042283130426589495
agent_compute-npc2_mean0.038920684374005296
agent_compute-npc2_median0.038920684374005296
agent_compute-npc2_min0.0355582383214211
complete-iteration_max1.2014614416628469
complete-iteration_mean1.1370155481042816
complete-iteration_median1.1370155481042816
complete-iteration_min1.0725696545457164
deviation-center-line_max2.8305007562607853
deviation-center-line_mean1.595695519866852
deviation-center-line_min0.3608902834729188
deviation-heading_max10.829028225443134
deviation-heading_mean6.436935393902713
deviation-heading_median6.436935393902713
deviation-heading_min2.044842562362293
driven_any_max14.590269734375006
driven_any_mean8.060581555671073
driven_any_median8.060581555671073
driven_any_min1.5308933769671378
driven_lanedir_consec_max14.2852209595819
driven_lanedir_consec_mean7.684236380388404
driven_lanedir_consec_min1.0832518011949093
driven_lanedir_max14.285221064869503
driven_lanedir_mean7.684288664877371
driven_lanedir_median7.684288664877371
driven_lanedir_min1.0833562648852373
get_duckie_state_max1.7613780741788902e-06
get_duckie_state_mean1.6281044828158254e-06
get_duckie_state_median1.6281044828158254e-06
get_duckie_state_min1.4948308914527607e-06
get_robot_state_max0.0142502711277818
get_robot_state_mean0.014113138704295012
get_robot_state_median0.014113138704295012
get_robot_state_min0.01397600628080822
get_state_dump_max0.009553223823528306
get_state_dump_mean0.009443641000621375
get_state_dump_median0.009443641000621375
get_state_dump_min0.009334058177714445
get_ui_image_max0.05165016085380916
get_ui_image_mean0.04974996152512634
get_ui_image_median0.04974996152512634
get_ui_image_min0.04784976219644352
in-drivable-lane_max1.499999999999995
in-drivable-lane_mean0.7499999999999973
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 14.590269734375006, "get_ui_image": 0.05165016085380916, "step_physics": 0.749967498247272, "survival_time": 59.99999999999873, "driven_lanedir": 14.285221064869503, "get_state_dump": 0.009553223823528306, "get_robot_state": 0.0142502711277818, "sim_render-ego0": 0.0039688518501936046, "sim_render-npc0": 0.0039094252749148455, "sim_render-npc1": 0.003919353096014653, "sim_render-npc2": 0.003964059458088616, "get_duckie_state": 1.4948308914527607e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.829028225443134, "agent_compute-ego0": 0.04609574842810333, "agent_compute-npc0": 0.04080857702536349, "agent_compute-npc1": 0.04344793839021884, "agent_compute-npc2": 0.042283130426589495, "complete-iteration": 1.0725696545457164, "set_robot_commands": 0.0023033023376845996, "deviation-center-line": 2.8305007562607853, "driven_lanedir_consec": 14.2852209595819, "sim_compute_sim_state": 0.041289117115919635, "sim_compute_performance-ego0": 0.0021412172087225487, "sim_compute_performance-npc0": 0.0019889797001059703, "sim_compute_performance-npc1": 0.001965733193835053, "sim_compute_performance-npc2": 0.002015965665806144}, "LFVI-norm-udem1-000-ego0": {"driven_any": 1.5308933769671378, "get_ui_image": 0.04784976219644352, "step_physics": 0.9009440529103182, "survival_time": 7.299999999999982, "driven_lanedir": 1.0833562648852373, "get_state_dump": 0.009334058177714445, "get_robot_state": 0.01397600628080822, "sim_render-ego0": 0.004072954865539966, "sim_render-npc0": 0.003984555095231452, "sim_render-npc1": 0.003963334219796317, "sim_render-npc2": 0.003945694488732993, "get_duckie_state": 1.7613780741788902e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 2.044842562362293, "agent_compute-ego0": 0.04840154874892462, "agent_compute-npc0": 0.03614313424039049, "agent_compute-npc1": 0.035144565867728926, "agent_compute-npc2": 0.0355582383214211, "complete-iteration": 1.2014614416628469, "set_robot_commands": 0.0022627658584490925, "deviation-center-line": 0.3608902834729188, "driven_lanedir_consec": 1.0832518011949093, "sim_compute_sim_state": 0.040972284719246584, "sim_compute_performance-ego0": 0.002160198834477639, "sim_compute_performance-npc0": 0.0019528784719454188, "sim_compute_performance-npc1": 0.0020049704986364663, "sim_compute_performance-npc2": 0.0019282451292284492}}
set_robot_commands_max0.0023033023376845996
set_robot_commands_mean0.002283034098066846
set_robot_commands_median0.002283034098066846
set_robot_commands_min0.0022627658584490925
sim_compute_performance-ego0_max0.002160198834477639
sim_compute_performance-ego0_mean0.0021507080216000935
sim_compute_performance-ego0_median0.0021507080216000935
sim_compute_performance-ego0_min0.0021412172087225487
sim_compute_performance-npc0_max0.0019889797001059703
sim_compute_performance-npc0_mean0.0019709290860256946
sim_compute_performance-npc0_median0.0019709290860256946
sim_compute_performance-npc0_min0.0019528784719454188
sim_compute_performance-npc1_max0.0020049704986364663
sim_compute_performance-npc1_mean0.0019853518462357596
sim_compute_performance-npc1_median0.0019853518462357596
sim_compute_performance-npc1_min0.001965733193835053
sim_compute_performance-npc2_max0.002015965665806144
sim_compute_performance-npc2_mean0.0019721053975172965
sim_compute_performance-npc2_median0.0019721053975172965
sim_compute_performance-npc2_min0.0019282451292284492
sim_compute_sim_state_max0.041289117115919635
sim_compute_sim_state_mean0.04113070091758311
sim_compute_sim_state_median0.04113070091758311
sim_compute_sim_state_min0.040972284719246584
sim_render-ego0_max0.004072954865539966
sim_render-ego0_mean0.004020903357866786
sim_render-ego0_median0.004020903357866786
sim_render-ego0_min0.0039688518501936046
sim_render-npc0_max0.003984555095231452
sim_render-npc0_mean0.003946990185073149
sim_render-npc0_median0.003946990185073149
sim_render-npc0_min0.0039094252749148455
sim_render-npc1_max0.003963334219796317
sim_render-npc1_mean0.003941343657905485
sim_render-npc1_median0.003941343657905485
sim_render-npc1_min0.003919353096014653
sim_render-npc2_max0.003964059458088616
sim_render-npc2_mean0.003954876973410805
sim_render-npc2_median0.003954876973410805
sim_render-npc2_min0.003945694488732993
simulation-passed1
step_physics_max0.9009440529103182
step_physics_mean0.8254557755787951
step_physics_median0.8254557755787951
step_physics_min0.749967498247272
survival_time_max59.99999999999873
survival_time_mean33.64999999999935
survival_time_min7.299999999999982
No reset possible
5624411430Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV-sim-validationLFVv-simhost-erroryesnogpu-prod-050:05:00
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5619511429Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-050:02:55
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5617211296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5614611299Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:55
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5608711301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:53
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5607911290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5603611310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:09
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5602211310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5596911308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:56
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5595111308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5592011305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5587311302Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5585511311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:46
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5584611307Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5583411309Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5580011303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:11
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5554911414Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFP-sim-testingLFP-simsuccessyesnogpu-prod-050:09:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1735445671412927
survival_time_median13.000000000000083
deviation-center-line_median0.7900786224903513
in-drivable-lane_median1.025000000000006


other stats
agent_compute-ego0_max0.044872420514653066
agent_compute-ego0_mean0.04111188475518394
agent_compute-ego0_median0.04050878975993831
agent_compute-ego0_min0.03855753898620606
complete-iteration_max0.26041371046663997
complete-iteration_mean0.24392145564911744
complete-iteration_median0.25281794462225704
complete-iteration_min0.2096362228853157
deviation-center-line_max1.58794067085882
deviation-center-line_mean0.8067710964679317
deviation-center-line_min0.05898647003220407
deviation-heading_max7.744772683207828
deviation-heading_mean3.6146239176691215
deviation-heading_median3.207502899473253
deviation-heading_min0.2987171885221512
driven_any_max5.859531796106464
driven_any_mean3.013508841708401
driven_any_median2.9248303345675164
driven_any_min0.34484290159210873
driven_lanedir_consec_max5.579076296675913
driven_lanedir_consec_mean2.567076886134911
driven_lanedir_consec_min0.3421421135811449
driven_lanedir_max5.579076296675913
driven_lanedir_mean2.567076886134911
driven_lanedir_median2.1735445671412927
driven_lanedir_min0.3421421135811449
get_duckie_state_max0.02315260887145996
get_duckie_state_mean0.016643947859881984
get_duckie_state_median0.019704893916561172
get_duckie_state_min0.004013394734945642
get_robot_state_max0.003462363146022408
get_robot_state_mean0.003403874470921765
get_robot_state_median0.003416814994160298
get_robot_state_min0.003319504749344056
get_state_dump_max0.007977185249328613
get_state_dump_mean0.007000731744436014
get_state_dump_median0.007490972491143935
get_state_dump_min0.005043796746127577
get_ui_image_max0.03493037195262795
get_ui_image_mean0.030249690352905048
get_ui_image_median0.030810184055145892
get_ui_image_min0.024448021348700465
in-drivable-lane_max3.0500000000000433
in-drivable-lane_mean1.275000000000014
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 0.34484290159210873, "get_ui_image": 0.029222850799560548, "step_physics": 0.1328132200241089, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3421421135811449, "get_state_dump": 0.007977185249328613, "get_robot_state": 0.0034064340591430666, "sim_render-ego0": 0.00363893985748291, "get_duckie_state": 0.02315260887145996, "in-drivable-lane": 0.0, "deviation-heading": 0.2987171885221512, "agent_compute-ego0": 0.03855753898620606, "complete-iteration": 0.24854521751403807, "set_robot_commands": 0.0022359371185302736, "deviation-center-line": 0.05898647003220407, "driven_lanedir_consec": 0.3421421135811449, "sim_compute_sim_state": 0.00553156852722168, "sim_compute_performance-ego0": 0.0019239282608032224}, "LFP-norm-zigzag-000-ego0": {"driven_any": 5.859531796106464, "get_ui_image": 0.03493037195262795, "step_physics": 0.1275286926718767, "survival_time": 25.00000000000022, "driven_lanedir": 5.579076296675913, "get_state_dump": 0.00745831325858415, "get_robot_state": 0.003462363146022408, "sim_render-ego0": 0.0036176359820032783, "get_duckie_state": 0.019859179765164495, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 5.0366702427940595, "agent_compute-ego0": 0.044872420514653066, "complete-iteration": 0.26041371046663997, "set_robot_commands": 0.0021141132194838837, "deviation-center-line": 1.2986201446255272, "driven_lanedir_consec": 5.579076296675913, "sim_compute_sim_state": 0.0146259600054956, "sim_compute_performance-ego0": 0.00185770855216447}, "LFP-norm-techtrack-000-ego0": {"driven_any": 5.101340158032568, "get_ui_image": 0.03239751731073123, "step_physics": 0.1336780468803875, "survival_time": 21.900000000000176, "driven_lanedir": 3.8930160169300976, "get_state_dump": 0.007523631723703719, "get_robot_state": 0.0034271959291775297, "sim_render-ego0": 0.0035703317994137287, "get_duckie_state": 0.019550608067957848, "in-drivable-lane": 3.0500000000000433, "deviation-heading": 7.744772683207828, "agent_compute-ego0": 0.04055738937881922, "complete-iteration": 0.257090671730476, "set_robot_commands": 0.0020758953615853345, "deviation-center-line": 1.58794067085882, "driven_lanedir_consec": 3.8930160169300976, "sim_compute_sim_state": 0.012374376653267202, "sim_compute_performance-ego0": 0.001848534733939551}, "LFP-norm-small_loop-000-ego0": {"driven_any": 0.7483205111024651, "get_ui_image": 0.024448021348700465, "step_physics": 0.11923337844480952, "survival_time": 4.099999999999993, "driven_lanedir": 0.45407311735248834, "get_state_dump": 0.005043796746127577, "get_robot_state": 0.003319504749344056, "sim_render-ego0": 0.003440483506903591, "get_duckie_state": 0.004013394734945642, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 1.3783355561524464, "agent_compute-ego0": 0.040460190141057395, "complete-iteration": 0.2096362228853157, "set_robot_commands": 0.0021331827324557015, "deviation-center-line": 0.28153710035517543, "driven_lanedir_consec": 0.45407311735248834, "sim_compute_sim_state": 0.00565523699105504, "sim_compute_performance-ego0": 0.001805371548756059}}
set_robot_commands_max0.0022359371185302736
set_robot_commands_mean0.0021397821080137982
set_robot_commands_median0.0021236479759697926
set_robot_commands_min0.0020758953615853345
sim_compute_performance-ego0_max0.0019239282608032224
sim_compute_performance-ego0_mean0.0018588857739158255
sim_compute_performance-ego0_median0.0018531216430520104
sim_compute_performance-ego0_min0.001805371548756059
sim_compute_sim_state_max0.0146259600054956
sim_compute_sim_state_mean0.00954678554425988
sim_compute_sim_state_median0.00901480682216112
sim_compute_sim_state_min0.00553156852722168
sim_render-ego0_max0.00363893985748291
sim_render-ego0_mean0.0035668477864508772
sim_render-ego0_median0.0035939838907085037
sim_render-ego0_min0.003440483506903591
simulation-passed1
step_physics_max0.1336780468803875
step_physics_mean0.12831333450529567
step_physics_median0.1301709563479928
step_physics_min0.11923337844480952
survival_time_max25.00000000000022
survival_time_mean13.362500000000097
survival_time_min2.4499999999999993
No reset possible
5553511289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:49
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5550211286Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:50
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5543311220Étienne Boucher 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:02:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5539811280Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5498011418Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV-sim-validationLFVv-simsuccessyesnogpu-prod-050:25:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7956884989076283
survival_time_median14.600000000000072
deviation-center-line_median0.7343040980147444
in-drivable-lane_median1.550000000000002


other stats
agent_compute-ego0_max0.048833545698995486
agent_compute-ego0_mean0.04561409724420714
agent_compute-ego0_median0.04542296018187878
agent_compute-ego0_min0.042776922914075505
agent_compute-npc0_max0.025743153015477065
agent_compute-npc0_mean0.022103170497294215
agent_compute-npc0_median0.021054118741708733
agent_compute-npc0_min0.02056129149028233
agent_compute-npc1_max0.03211266313280378
agent_compute-npc1_mean0.028871666515258937
agent_compute-npc1_median0.027867748910320293
agent_compute-npc1_min0.02663458750265274
agent_compute-npc2_max0.03114388499941145
agent_compute-npc2_mean0.027435641002172804
agent_compute-npc2_median0.02628812278482816
agent_compute-npc2_min0.024874915222278807
agent_compute-npc3_max0.04162149023182385
agent_compute-npc3_mean0.03564862840246888
agent_compute-npc3_median0.03564862840246888
agent_compute-npc3_min0.02967576657311391
complete-iteration_max1.1974161242837034
complete-iteration_mean0.8917717325231284
complete-iteration_median1.0110553919258765
complete-iteration_min0.3475600219570571
deviation-center-line_max1.1970998662303527
deviation-center-line_mean0.7864138565316539
deviation-center-line_min0.47994736386677417
deviation-heading_max6.161231033088842
deviation-heading_mean3.7182693698475817
deviation-heading_median3.2791056687362774
deviation-heading_min2.1536351088289276
driven_any_max4.783458036063022
driven_any_mean3.2152643928523372
driven_any_median3.3161296012613213
driven_any_min1.4453403328236851
driven_lanedir_consec_max3.6280508600691097
driven_lanedir_consec_mean2.641460206015879
driven_lanedir_consec_min1.3464129661791504
driven_lanedir_max3.6280508600691097
driven_lanedir_mean2.641460206015879
driven_lanedir_median2.7956884989076283
driven_lanedir_min1.3464129661791504
get_duckie_state_max1.5899586000653096e-06
get_duckie_state_mean1.3923665080433351e-06
get_duckie_state_median1.3768672943115235e-06
get_duckie_state_min1.2257728434849848e-06
get_robot_state_max0.01747248977516728
get_robot_state_mean0.013928139782531672
get_robot_state_median0.015708105717097874
get_robot_state_min0.006823857920763661
get_state_dump_max0.010957182393841186
get_state_dump_mean0.009328403196999967
get_state_dump_median0.010090211113197751
get_state_dump_min0.006176008167763182
get_ui_image_max0.05143228690330914
get_ui_image_mean0.04376957274668485
get_ui_image_median0.047075504281041694
get_ui_image_min0.029494995521346875
in-drivable-lane_max3.3000000000000185
in-drivable-lane_mean1.6000000000000056
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 1.4453403328236851, "get_ui_image": 0.04291425091879708, "step_physics": 0.6350633570126125, "survival_time": 6.949999999999983, "driven_lanedir": 1.3464129661791504, "get_state_dump": 0.009656190872192385, "get_robot_state": 0.014552581310272216, "sim_render-ego0": 0.003781371457236154, "sim_render-npc0": 0.003709815229688372, "sim_render-npc1": 0.0037482125418526785, "sim_render-npc2": 0.003817764350346157, "get_duckie_state": 1.3913427080426897e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.1536351088289276, "agent_compute-ego0": 0.04599709170205253, "agent_compute-npc0": 0.02056129149028233, "agent_compute-npc1": 0.03211266313280378, "agent_compute-npc2": 0.03114388499941145, "complete-iteration": 0.8894023827144077, "set_robot_commands": 0.002235339369092669, "deviation-center-line": 0.47994736386677417, "driven_lanedir_consec": 1.3464129661791504, "sim_compute_sim_state": 0.025492613656180246, "sim_compute_performance-ego0": 0.0020388109343392508, "sim_compute_performance-npc0": 0.0020473718643188475, "sim_compute_performance-npc1": 0.0019157682146344864, "sim_compute_performance-npc2": 0.0019249882016863144}, "LFV-norm-zigzag-000-ego0": {"driven_any": 4.783458036063022, "get_ui_image": 0.05123675764328631, "step_physics": 0.8146607056079708, "survival_time": 20.60000000000016, "driven_lanedir": 3.6280508600691097, "get_state_dump": 0.01052423135420312, "get_robot_state": 0.016863630123923536, "sim_render-ego0": 0.003650723011672641, "sim_render-npc0": 0.0035892266049512072, "sim_render-npc1": 0.003589931469563999, "sim_render-npc2": 0.0036366782523240657, "sim_render-npc3": 0.003653332915779465, "get_duckie_state": 1.3623918805803572e-06, "in-drivable-lane": 3.3000000000000185, "deviation-heading": 6.161231033088842, "agent_compute-ego0": 0.042776922914075505, "agent_compute-npc0": 0.02066593020071995, "agent_compute-npc1": 0.02663458750265274, "agent_compute-npc2": 0.024874915222278807, "agent_compute-npc3": 0.02967576657311391, "complete-iteration": 1.1327084011373452, "set_robot_commands": 0.002040118339852617, "deviation-center-line": 1.1970998662303527, "driven_lanedir_consec": 3.6280508600691097, "sim_compute_sim_state": 0.056617084484700715, "sim_compute_performance-ego0": 0.00202537217959942, "sim_compute_performance-npc0": 0.0018459913517026, "sim_compute_performance-npc1": 0.0018371860282473068, "sim_compute_performance-npc2": 0.0018517312934265876, "sim_compute_performance-npc3": 0.001852790033557513}, "LFV-norm-techtrack-000-ego0": {"driven_any": 3.60960504690231, "get_ui_image": 0.05143228690330914, "step_physics": 0.8589222543999223, "survival_time": 15.80000000000009, "driven_lanedir": 3.177375561499363, "get_state_dump": 0.010957182393841186, "get_robot_state": 0.01747248977516728, "sim_render-ego0": 0.003779600095297636, "sim_render-npc0": 0.0037880064185109425, "sim_render-npc1": 0.003735030111078208, "sim_render-npc2": 0.0036267489664938177, "sim_render-npc3": 0.003757879937108759, "get_duckie_state": 1.5899586000653096e-06, "in-drivable-lane": 1.2499999999999956, "deviation-heading": 3.1149546070138623, "agent_compute-ego0": 0.04484882866170504, "agent_compute-npc0": 0.021442307282697515, "agent_compute-npc1": 0.027867748910320293, "agent_compute-npc2": 0.02628812278482816, "agent_compute-npc3": 0.04162149023182385, "complete-iteration": 1.1974161242837034, "set_robot_commands": 0.0022047438456057, "deviation-center-line": 0.6193485361793041, "driven_lanedir_consec": 3.177375561499363, "sim_compute_sim_state": 0.05665427878828079, "sim_compute_performance-ego0": 0.0021254106274914667, "sim_compute_performance-npc0": 0.001999047276349474, "sim_compute_performance-npc1": 0.002028370505251719, "sim_compute_performance-npc2": 0.001893171376610404, "sim_compute_performance-npc3": 0.0019293275165257015}, "LFV-norm-small_loop-000-ego0": {"driven_any": 3.022654155620332, "get_ui_image": 0.029494995521346875, "step_physics": 0.205207370914048, "survival_time": 13.400000000000055, "driven_lanedir": 2.4140014363158935, "get_state_dump": 0.006176008167763182, "get_robot_state": 0.006823857920763661, "sim_render-ego0": 0.0035355826735939677, "sim_render-npc0": 0.0036179008980222792, "get_duckie_state": 1.2257728434849848e-06, "in-drivable-lane": 1.8500000000000083, "deviation-heading": 3.443256730458693, "agent_compute-ego0": 0.048833545698995486, "agent_compute-npc0": 0.025743153015477065, "complete-iteration": 0.3475600219570571, "set_robot_commands": 0.0023979121424451636, "deviation-center-line": 0.8492596598501848, "driven_lanedir_consec": 2.4140014363158935, "sim_compute_sim_state": 0.00968113441892716, "sim_compute_performance-ego0": 0.0018755981913286513, "sim_compute_performance-npc0": 0.0018915846445303425}}
set_robot_commands_max0.0023979121424451636
set_robot_commands_mean0.0022195284242490375
set_robot_commands_median0.0022200416073491847
set_robot_commands_min0.002040118339852617
sim_compute_performance-ego0_max0.0021254106274914667
sim_compute_performance-ego0_mean0.002016297983189697
sim_compute_performance-ego0_median0.002032091556969335
sim_compute_performance-ego0_min0.0018755981913286513
sim_compute_performance-npc0_max0.0020473718643188475
sim_compute_performance-npc0_mean0.001945998784225316
sim_compute_performance-npc0_median0.001945315960439908
sim_compute_performance-npc0_min0.0018459913517026
sim_compute_performance-npc1_max0.002028370505251719
sim_compute_performance-npc1_mean0.0019271082493778377
sim_compute_performance-npc1_median0.0019157682146344864
sim_compute_performance-npc1_min0.0018371860282473068
sim_compute_performance-npc2_max0.0019249882016863144
sim_compute_performance-npc2_mean0.0018899636239077687
sim_compute_performance-npc2_median0.001893171376610404
sim_compute_performance-npc2_min0.0018517312934265876
sim_compute_performance-npc3_max0.0019293275165257015
sim_compute_performance-npc3_mean0.0018910587750416072
sim_compute_performance-npc3_median0.0018910587750416072
sim_compute_performance-npc3_min0.001852790033557513
sim_compute_sim_state_max0.05665427878828079
sim_compute_sim_state_mean0.03711127783702223
sim_compute_sim_state_median0.04105484907044048
sim_compute_sim_state_min0.00968113441892716
sim_render-ego0_max0.003781371457236154
sim_render-ego0_mean0.0036868193094500993
sim_render-ego0_median0.0037151615534851386
sim_render-ego0_min0.0035355826735939677
sim_render-npc0_max0.0037880064185109425
sim_render-npc0_mean0.003676237287793201
sim_render-npc0_median0.0036638580638553254
sim_render-npc0_min0.0035892266049512072
sim_render-npc1_max0.0037482125418526785
sim_render-npc1_mean0.003691058040831629
sim_render-npc1_median0.003735030111078208
sim_render-npc1_min0.003589931469563999
sim_render-npc2_max0.003817764350346157
sim_render-npc2_mean0.00369373052305468
sim_render-npc2_median0.0036366782523240657
sim_render-npc2_min0.0036267489664938177
sim_render-npc3_max0.003757879937108759
sim_render-npc3_mean0.003705606426444112
sim_render-npc3_median0.003705606426444112
sim_render-npc3_min0.003653332915779465
simulation-passed1
step_physics_max0.8589222543999223
step_physics_mean0.6284634219836384
step_physics_median0.7248620313102916
step_physics_min0.205207370914048
survival_time_max20.60000000000016
survival_time_mean14.187500000000073
survival_time_min6.949999999999983
No reset possible
5493011316Liam Paull 🇨🇦template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:03:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.014794842056606129
agent_compute-ego0_mean0.011985792616861885
agent_compute-ego0_median0.01170154534144073
agent_compute-ego0_min0.009745237727959951
complete-iteration_max0.2144880994506504
complete-iteration_mean0.17915703054265328
complete-iteration_median0.1808309318647103
complete-iteration_min0.14047815899054208
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.519918441772461e-06
get_duckie_state_mean1.3592494937000614e-06
get_duckie_state_median1.3711856627897307e-06
get_duckie_state_min1.1747082074483235e-06
get_robot_state_max0.00429528692494268
get_robot_state_mean0.003818204203863279
get_robot_state_median0.003811441812501846
get_robot_state_min0.0033546462655067444
get_state_dump_max0.010440810866977858
get_state_dump_mean0.00606015621980239
get_state_dump_median0.004790122373194634
get_state_dump_min0.004219569265842438
get_ui_image_max0.03891999306886093
get_ui_image_mean0.03028219301917152
get_ui_image_median0.02894044620326803
get_ui_image_min0.024327886601289112
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.0269071301327476, "step_physics": 0.09877267970314509, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004462291922750352, "get_robot_state": 0.003603278836117515, "sim_render-ego0": 0.0036937405791463737, "get_duckie_state": 1.361098470567148e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.011069068425818337, "complete-iteration": 0.16210471829281578, "set_robot_commands": 0.0021235686314256884, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.009465283985379377, "sim_compute_performance-ego0": 0.0019236667246758184}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03891999306886093, "step_physics": 0.1259147136107735, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.010440810866977858, "get_robot_state": 0.00429528692494268, "sim_render-ego0": 0.004026923490607221, "get_duckie_state": 1.3812728550123132e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.014794842056606129, "complete-iteration": 0.2144880994506504, "set_robot_commands": 0.003538282021232273, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.010599387728649635, "sim_compute_performance-ego0": 0.001872749432273533}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.030973762273788452, "step_physics": 0.1304912467797597, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.005117952823638916, "get_robot_state": 0.004019604788886176, "sim_render-ego0": 0.0040272606743706595, "get_duckie_state": 1.519918441772461e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.012334022257063124, "complete-iteration": 0.19955714543660483, "set_robot_commands": 0.0022251506646474204, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.008177806933720907, "sim_compute_performance-ego0": 0.002098735835817125}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.024327886601289112, "step_physics": 0.08708281815052032, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.004219569265842438, "get_robot_state": 0.0033546462655067444, "sim_render-ego0": 0.0034613236784935, "get_duckie_state": 1.1747082074483235e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.009745237727959951, "complete-iteration": 0.14047815899054208, "set_robot_commands": 0.001929750045140584, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.004505316416422526, "sim_compute_performance-ego0": 0.00177745521068573}}
set_robot_commands_max0.003538282021232273
set_robot_commands_mean0.0024541878406114915
set_robot_commands_median0.0021743596480365544
set_robot_commands_min0.001929750045140584
sim_compute_performance-ego0_max0.002098735835817125
sim_compute_performance-ego0_mean0.0019181518008630515
sim_compute_performance-ego0_median0.0018982080784746755
sim_compute_performance-ego0_min0.00177745521068573
sim_compute_sim_state_max0.010599387728649635
sim_compute_sim_state_mean0.00818694876604311
sim_compute_sim_state_median0.008821545459550141
sim_compute_sim_state_min0.004505316416422526
sim_render-ego0_max0.0040272606743706595
sim_render-ego0_mean0.0038023121056544383
sim_render-ego0_median0.003860332034876797
sim_render-ego0_min0.0034613236784935
simulation-passed1
step_physics_max0.1304912467797597
step_physics_mean0.11056536456104966
step_physics_median0.11234369665695929
step_physics_min0.08708281815052032
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
5490011332Olga (Ge Ya) Xu 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:02:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5488911450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-050:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5486511350Martin Cote 🇨🇦template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:03:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.012697598602198348
agent_compute-ego0_mean0.011964107759555226
agent_compute-ego0_median0.011922091029692388
agent_compute-ego0_min0.011314650376637776
complete-iteration_max0.20530467188876608
complete-iteration_mean0.1843339113955639
complete-iteration_median0.1882124934895632
complete-iteration_min0.1556059867143631
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.5629662407769097e-06
get_duckie_state_mean1.4948059347932188e-06
get_duckie_state_median1.480455377565089e-06
get_duckie_state_min1.4553467432657878e-06
get_robot_state_max0.003800322737874864
get_robot_state_mean0.003664156759397769
get_robot_state_median0.003668717626068327
get_robot_state_min0.003518869047579558
get_state_dump_max0.005970567087583904
get_state_dump_mean0.005000397801606078
get_state_dump_median0.004782725953393512
get_state_dump_min0.004465572212053382
get_ui_image_max0.03569509412931359
get_ui_image_mean0.03059061573991343
get_ui_image_median0.03033627819076034
get_ui_image_min0.025994812448819477
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.028758832170993467, "step_physics": 0.10708321348021302, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.005970567087583904, "get_robot_state": 0.003800322737874864, "sim_render-ego0": 0.003762128986889803, "get_duckie_state": 1.4863436735129055e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.012697598602198348, "complete-iteration": 0.17627218252495874, "set_robot_commands": 0.0021274240711067296, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.009509681146356124, "sim_compute_performance-ego0": 0.0024678842930854123}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03569509412931359, "step_physics": 0.13341839676317965, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.004465572212053382, "get_robot_state": 0.003518869047579558, "sim_render-ego0": 0.0036217622134996495, "get_duckie_state": 1.4745670816172725e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.011518408422884732, "complete-iteration": 0.20530467188876608, "set_robot_commands": 0.00203655077063519, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.008992718613666037, "sim_compute_performance-ego0": 0.0019470453262329104}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.03191372421052721, "step_physics": 0.1306442121664683, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004975514279471504, "get_robot_state": 0.0037389761871761745, "sim_render-ego0": 0.0039800504843393964, "get_duckie_state": 1.5629662407769097e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.01232577363650004, "complete-iteration": 0.2001528044541677, "set_robot_commands": 0.0022852950625949437, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.008060816261503432, "sim_compute_performance-ego0": 0.0021251142024993896}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.025994812448819477, "step_physics": 0.0974525089065234, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.004589937627315521, "get_robot_state": 0.0035984590649604797, "sim_render-ego0": 0.003584687908490499, "get_duckie_state": 1.4553467432657878e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.011314650376637776, "complete-iteration": 0.1556059867143631, "set_robot_commands": 0.002128832042217254, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.004992686212062836, "sim_compute_performance-ego0": 0.001858559747536977}}
set_robot_commands_max0.0022852950625949437
set_robot_commands_mean0.00214452548663853
set_robot_commands_median0.002128128056661992
set_robot_commands_min0.00203655077063519
sim_compute_performance-ego0_max0.0024678842930854123
sim_compute_performance-ego0_mean0.0020996508923386724
sim_compute_performance-ego0_median0.00203607976436615
sim_compute_performance-ego0_min0.001858559747536977
sim_compute_sim_state_max0.009509681146356124
sim_compute_sim_state_mean0.007888975558397108
sim_compute_sim_state_median0.008526767437584733
sim_compute_sim_state_min0.004992686212062836
sim_render-ego0_max0.0039800504843393964
sim_render-ego0_mean0.003737157398304837
sim_render-ego0_median0.0036919456001947262
sim_render-ego0_min0.003584687908490499
simulation-passed1
step_physics_max0.13341839676317965
step_physics_mean0.11714958282909609
step_physics_median0.11886371282334066
step_physics_min0.0974525089065234
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
5485711424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5485311439Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:46
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5476311369Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:15:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7283443557928948
survival_time_median16.100000000000094
deviation-center-line_median0.2926502684915605
in-drivable-lane_median5.9250000000000345


other stats
agent_compute-ego0_max0.0131616814495766
agent_compute-ego0_mean0.012519564067363868
agent_compute-ego0_median0.01269695654175601
agent_compute-ego0_min0.01152266173636685
complete-iteration_max0.22132363063948496
complete-iteration_mean0.19115710138019823
complete-iteration_median0.192650787637298
complete-iteration_min0.15800319960671202
deviation-center-line_max2.716128300209175
deviation-center-line_mean0.8688455318489362
deviation-center-line_min0.17395329020344838
deviation-heading_max9.364393447947428
deviation-heading_mean3.504017732088851
deviation-heading_median1.914172614911495
deviation-heading_min0.8233322505849855
driven_any_max11.576374858943296
driven_any_mean4.515754937092375
driven_any_median2.588805478404965
driven_any_min1.3090339326162734
driven_lanedir_consec_max11.35777612844458
driven_lanedir_consec_mean3.3740122827919317
driven_lanedir_consec_min0.6815842911373583
driven_lanedir_max11.35777612844458
driven_lanedir_mean3.4121350959938015
driven_lanedir_median0.7953900128501512
driven_lanedir_min0.6999842298303249
get_duckie_state_max1.345595268354024e-06
get_duckie_state_mean1.3134957272321602e-06
get_duckie_state_median1.3063480979071695e-06
get_duckie_state_min1.2956914447602771e-06
get_robot_state_max0.003739902557427349
get_robot_state_mean0.00367204779983548
get_robot_state_median0.003717492210732825
get_robot_state_min0.003513304220448922
get_state_dump_max0.004778983329963005
get_state_dump_mean0.004699964534445634
get_state_dump_median0.0046811478381365325
get_state_dump_min0.004658579131546465
get_ui_image_max0.036265925282523745
get_ui_image_mean0.030318305473519137
get_ui_image_median0.029257378261813308
get_ui_image_min0.0264925400879262
in-drivable-lane_max14.500000000000128
in-drivable-lane_mean6.587500000000049
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.576374858943296, "get_ui_image": 0.0264925400879262, "step_physics": 0.0953303334317934, "survival_time": 59.99999999999873, "driven_lanedir": 11.35777612844458, "get_state_dump": 0.004658579131546465, "get_robot_state": 0.003513304220448922, "sim_render-ego0": 0.0036006736120117594, "get_duckie_state": 1.3026667077972133e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.364393447947428, "agent_compute-ego0": 0.01152266173636685, "complete-iteration": 0.15800319960671202, "set_robot_commands": 0.0020787874725240155, "deviation-center-line": 2.716128300209175, "driven_lanedir_consec": 11.35777612844458, "sim_compute_sim_state": 0.0088249983934439, "sim_compute_performance-ego0": 0.0018999520983922296}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3090339326162734, "get_ui_image": 0.036265925282523745, "step_physics": 0.14548244362785703, "survival_time": 8.349999999999984, "driven_lanedir": 0.7567044817554647, "get_state_dump": 0.004678452298754738, "get_robot_state": 0.0037076842217218303, "sim_render-ego0": 0.00388259972844805, "get_duckie_state": 1.2956914447602771e-06, "in-drivable-lane": 3.499999999999993, "deviation-heading": 1.4828199817293957, "agent_compute-ego0": 0.012587467829386393, "complete-iteration": 0.22132363063948496, "set_robot_commands": 0.002342248246783302, "deviation-center-line": 0.2060270850431949, "driven_lanedir_consec": 0.7567044817554647, "sim_compute_sim_state": 0.010252616235188076, "sim_compute_performance-ego0": 0.0020390933468228296}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.1150610770084435, "get_ui_image": 0.031724348611254706, "step_physics": 0.14619538537972335, "survival_time": 14.000000000000064, "driven_lanedir": 0.8340755439448376, "get_state_dump": 0.004778983329963005, "get_robot_state": 0.003739902557427349, "sim_render-ego0": 0.003840313263210962, "get_duckie_state": 1.3100294880171264e-06, "in-drivable-lane": 8.350000000000076, "deviation-heading": 2.3455252480935944, "agent_compute-ego0": 0.01280644525412563, "complete-iteration": 0.2157889931227389, "set_robot_commands": 0.002188008026720366, "deviation-center-line": 0.3792734519399262, "driven_lanedir_consec": 0.6815842911373583, "sim_compute_sim_state": 0.008410767728323615, "sim_compute_performance-ego0": 0.00201734614117714}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.0625498798014874, "get_ui_image": 0.02679040791237191, "step_physics": 0.10722907471330198, "survival_time": 18.200000000000124, "driven_lanedir": 0.6999842298303249, "get_state_dump": 0.004683843377518327, "get_robot_state": 0.0037273001997438194, "sim_render-ego0": 0.0038484494980067425, "get_duckie_state": 1.345595268354024e-06, "in-drivable-lane": 14.500000000000128, "deviation-heading": 0.8233322505849855, "agent_compute-ego0": 0.0131616814495766, "complete-iteration": 0.16951258215185713, "set_robot_commands": 0.0023189721042162752, "deviation-center-line": 0.17395329020344838, "driven_lanedir_consec": 0.6999842298303249, "sim_compute_sim_state": 0.005644152915641053, "sim_compute_performance-ego0": 0.0020244533068513215}}
set_robot_commands_max0.002342248246783302
set_robot_commands_mean0.00223200396256099
set_robot_commands_median0.0022534900654683204
set_robot_commands_min0.0020787874725240155
sim_compute_performance-ego0_max0.0020390933468228296
sim_compute_performance-ego0_mean0.00199521122331088
sim_compute_performance-ego0_median0.002020899724014231
sim_compute_performance-ego0_min0.0018999520983922296
sim_compute_sim_state_max0.010252616235188076
sim_compute_sim_state_mean0.008283133818149161
sim_compute_sim_state_median0.008617883060883756
sim_compute_sim_state_min0.005644152915641053
sim_render-ego0_max0.00388259972844805
sim_render-ego0_mean0.0037930090254193784
sim_render-ego0_median0.003844381380608852
sim_render-ego0_min0.0036006736120117594
simulation-passed1
step_physics_max0.14619538537972335
step_physics_mean0.12355930928816894
step_physics_median0.1263557591705795
step_physics_min0.0953303334317934
survival_time_max59.99999999999873
survival_time_mean25.13749999999973
survival_time_min8.349999999999984
No reset possible
5470311383Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:09:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7323271476107855
survival_time_median13.475000000000064
deviation-center-line_median0.18599262385776355
in-drivable-lane_median6.200000000000058


other stats
agent_compute-ego0_max0.012980799205967637
agent_compute-ego0_mean0.012703764019315757
agent_compute-ego0_median0.01271013688956592
agent_compute-ego0_min0.012413983092163548
complete-iteration_max0.22571867746664276
complete-iteration_mean0.19769860957353877
complete-iteration_median0.19591645257972215
complete-iteration_min0.17324285566806794
deviation-center-line_max1.0033144276239525
deviation-center-line_mean0.3786233431995541
deviation-center-line_min0.13919369745873633
deviation-heading_max3.57686897084054
deviation-heading_mean1.4924248189815714
deviation-heading_median0.9521493556550796
deviation-heading_min0.48853159377558575
driven_any_max5.7833140890238734
driven_any_mean3.1875686018975804
driven_any_median2.8204305470707607
driven_any_min1.3260992244249263
driven_lanedir_consec_max4.049390434628596
driven_lanedir_consec_mean1.5460858118203689
driven_lanedir_consec_min0.6702985174313079
driven_lanedir_max4.049390434628596
driven_lanedir_mean1.5460858118203689
driven_lanedir_median0.7323271476107855
driven_lanedir_min0.6702985174313079
get_duckie_state_max1.649387547227203e-06
get_duckie_state_mean1.4599350270595889e-06
get_duckie_state_median1.4079166642317535e-06
get_duckie_state_min1.3745192325476443e-06
get_robot_state_max0.004118958457571561
get_robot_state_mean0.003790543402467025
get_robot_state_median0.003715864768687715
get_robot_state_min0.0036114856149211073
get_state_dump_max0.005256936198375264
get_state_dump_mean0.004861687518320544
get_state_dump_median0.004763516637873142
get_state_dump_min0.004662780599160628
get_ui_image_max0.0353034607907559
get_ui_image_mean0.03064121810969854
get_ui_image_median0.03058644299757641
get_ui_image_min0.02608852565288544
in-drivable-lane_max17.200000000000152
in-drivable-lane_mean8.125000000000064
in-drivable-lane_min2.8999999999999897
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.7833140890238734, "get_ui_image": 0.026966231790455902, "step_physics": 0.11538645534804372, "survival_time": 26.35000000000024, "driven_lanedir": 4.049390434628596, "get_state_dump": 0.004662780599160628, "get_robot_state": 0.0036114856149211073, "sim_render-ego0": 0.003717569239211805, "get_duckie_state": 1.3745192325476443e-06, "in-drivable-lane": 9.050000000000129, "deviation-heading": 3.57686897084054, "agent_compute-ego0": 0.012413983092163548, "complete-iteration": 0.18138954720713876, "set_robot_commands": 0.0022055267384558015, "deviation-center-line": 1.0033144276239525, "driven_lanedir_consec": 4.049390434628596, "sim_compute_sim_state": 0.010358676314353945, "sim_compute_performance-ego0": 0.0019744210170977044}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3260992244249263, "get_ui_image": 0.0353034607907559, "step_physics": 0.15069943962367713, "survival_time": 6.999999999999983, "driven_lanedir": 0.7588109447252747, "get_state_dump": 0.004719024008892952, "get_robot_state": 0.0036722041190938746, "sim_render-ego0": 0.0038634733105382176, "get_duckie_state": 1.4389660341519837e-06, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 1.3932936423990552, "agent_compute-ego0": 0.01283823513815589, "complete-iteration": 0.22571867746664276, "set_robot_commands": 0.002321873996274691, "deviation-center-line": 0.2265925779714117, "driven_lanedir_consec": 0.7588109447252747, "sim_compute_sim_state": 0.01015028716824579, "sim_compute_performance-ego0": 0.002056453244905945}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.3559826924436067, "get_ui_image": 0.03420665420469691, "step_physics": 0.13607715974088574, "survival_time": 6.0499999999999865, "driven_lanedir": 0.6702985174313079, "get_state_dump": 0.005256936198375264, "get_robot_state": 0.004118958457571561, "sim_render-ego0": 0.004166354898546562, "get_duckie_state": 1.649387547227203e-06, "in-drivable-lane": 3.349999999999988, "deviation-heading": 0.5110050689111044, "agent_compute-ego0": 0.012980799205967637, "complete-iteration": 0.2104433579523055, "set_robot_commands": 0.0024436438669923877, "deviation-center-line": 0.13919369745873633, "driven_lanedir_consec": 0.6702985174313079, "sim_compute_sim_state": 0.008852575646072138, "sim_compute_performance-ego0": 0.002233047954371718}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.284878401697915, "get_ui_image": 0.02608852565288544, "step_physics": 0.11171724379062652, "survival_time": 19.95000000000015, "driven_lanedir": 0.7058433504962964, "get_state_dump": 0.004808009266853332, "get_robot_state": 0.0037595254182815553, "sim_render-ego0": 0.003860347867012024, "get_duckie_state": 1.3768672943115235e-06, "in-drivable-lane": 17.200000000000152, "deviation-heading": 0.48853159377558575, "agent_compute-ego0": 0.012582038640975951, "complete-iteration": 0.17324285566806794, "set_robot_commands": 0.0022276711463928224, "deviation-center-line": 0.14539266974411538, "driven_lanedir_consec": 0.7058433504962964, "sim_compute_sim_state": 0.006063281893730164, "sim_compute_performance-ego0": 0.002034212350845337}}
set_robot_commands_max0.0024436438669923877
set_robot_commands_mean0.0022996789370289257
set_robot_commands_median0.0022747725713337568
set_robot_commands_min0.0022055267384558015
sim_compute_performance-ego0_max0.002233047954371718
sim_compute_performance-ego0_mean0.002074533641805176
sim_compute_performance-ego0_median0.002045332797875641
sim_compute_performance-ego0_min0.0019744210170977044
sim_compute_sim_state_max0.010358676314353945
sim_compute_sim_state_mean0.008856205255600508
sim_compute_sim_state_median0.009501431407158964
sim_compute_sim_state_min0.006063281893730164
sim_render-ego0_max0.004166354898546562
sim_render-ego0_mean0.003901936328827152
sim_render-ego0_median0.0038619105887751208
sim_render-ego0_min0.003717569239211805
simulation-passed1
step_physics_max0.15069943962367713
step_physics_mean0.12847007462580828
step_physics_median0.12573180754446472
step_physics_min0.11171724379062652
survival_time_max26.35000000000024
survival_time_mean14.837500000000093
survival_time_min6.0499999999999865
No reset possible
5465411404Marton Moro 🇭🇺template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:04:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.011984606583913168
agent_compute-ego0_mean0.01118338445225094
agent_compute-ego0_median0.01095733348327347
agent_compute-ego0_min0.01083426425854365
complete-iteration_max0.20102247984512991
complete-iteration_mean0.17649779828455642
complete-iteration_median0.17303539564212164
complete-iteration_min0.15889792200885242
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.4199486261681665e-06
get_duckie_state_mean1.3565233548263563e-06
get_duckie_state_median1.3486630674721538e-06
get_duckie_state_min1.3088186581929524e-06
get_robot_state_max0.003795320789019266
get_robot_state_mean0.003693341346621506
get_robot_state_median0.003704619940352325
get_robot_state_min0.003568804716762108
get_state_dump_max0.005096733570098877
get_state_dump_mean0.004836070259098671
get_state_dump_median0.004791681105912822
get_state_dump_min0.0046641852544701615
get_ui_image_max0.034368356932764466
get_ui_image_mean0.029382899834350773
get_ui_image_median0.028165846235222287
get_ui_image_min0.02683154993419406
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.02683154993419406, "step_physics": 0.09528503689584852, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.00474527968636042, "get_robot_state": 0.003568804716762108, "sim_render-ego0": 0.003861551043353503, "get_duckie_state": 1.4199486261681665e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.010916000680078437, "complete-iteration": 0.15889792200885242, "set_robot_commands": 0.0021956585630585877, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.009344007395490817, "sim_compute_performance-ego0": 0.002051635633541059}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.034368356932764466, "step_physics": 0.13025076233822366, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.0046641852544701615, "get_robot_state": 0.0036191162855728817, "sim_render-ego0": 0.003811685935310696, "get_duckie_state": 1.316485197647758e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.010998666286468506, "complete-iteration": 0.20102247984512991, "set_robot_commands": 0.002248383086660634, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.008960226307744566, "sim_compute_performance-ego0": 0.0020031773525735607}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.029496722751193576, "step_physics": 0.11938748757044476, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004838082525465224, "get_robot_state": 0.003790123595131768, "sim_render-ego0": 0.003899872303009033, "get_duckie_state": 1.3808409372965495e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.011984606583913168, "complete-iteration": 0.18519203861554465, "set_robot_commands": 0.0021893978118896484, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.007437696059544881, "sim_compute_performance-ego0": 0.0020723409122890895}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.026834969719250996, "step_physics": 0.10085032880306244, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.005096733570098877, "get_robot_state": 0.003795320789019266, "sim_render-ego0": 0.003868351380030314, "get_duckie_state": 1.3088186581929524e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.01083426425854365, "complete-iteration": 0.16087875266869864, "set_robot_commands": 0.0022994577884674072, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.005089799563090007, "sim_compute_performance-ego0": 0.002110655109087626}}
set_robot_commands_max0.0022994577884674072
set_robot_commands_mean0.0022332243125190695
set_robot_commands_median0.002222020824859611
set_robot_commands_min0.0021893978118896484
sim_compute_performance-ego0_max0.002110655109087626
sim_compute_performance-ego0_mean0.0020594522518728336
sim_compute_performance-ego0_median0.002061988272915074
sim_compute_performance-ego0_min0.0020031773525735607
sim_compute_sim_state_max0.009344007395490817
sim_compute_sim_state_mean0.007707932331467567
sim_compute_sim_state_median0.008198961183644724
sim_compute_sim_state_min0.005089799563090007
sim_render-ego0_max0.003899872303009033
sim_render-ego0_mean0.0038603651654258862
sim_render-ego0_median0.003864951211691909
sim_render-ego0_min0.003811685935310696
simulation-passed1
step_physics_max0.13025076233822366
step_physics_mean0.11144340390189485
step_physics_median0.1101189081867536
step_physics_min0.09528503689584852
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
5462911435Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:00:49
The container "solut [...]
The container "solution-ego0" exited with code 127.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5449911482Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:36:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.118755046076464
survival_time_median59.99999999999873
deviation-center-line_median4.239339866955369
in-drivable-lane_median17.449999999999555


other stats
agent_compute-ego0_max0.012491598812169971
agent_compute-ego0_mean0.012160224184009256
agent_compute-ego0_median0.012197918042255182
agent_compute-ego0_min0.011753461839356688
complete-iteration_max0.22106356882830644
complete-iteration_mean0.20219081292839275
complete-iteration_median0.20169873102618496
complete-iteration_min0.18430222083289455
deviation-center-line_max4.291853510181824
deviation-center-line_mean4.086794531760715
deviation-center-line_min3.5766448829502986
deviation-heading_max18.91142385326124
deviation-heading_mean14.915174478405488
deviation-heading_median15.982059343290649
deviation-heading_min8.785155373779421
driven_any_max7.921019422730379
driven_any_mean7.919219215031775
driven_any_median7.920762530354851
driven_any_min7.914332376687018
driven_lanedir_consec_max5.597822266418271
driven_lanedir_consec_mean5.111393230757194
driven_lanedir_consec_min4.610240564457578
driven_lanedir_max5.597822266418271
driven_lanedir_mean5.111393230757194
driven_lanedir_median5.118755046076464
driven_lanedir_min4.610240564457578
get_duckie_state_max1.5637161928251522e-06
get_duckie_state_mean1.409071668994913e-06
get_duckie_state_median1.4052005929811908e-06
get_duckie_state_min1.2621692971921186e-06
get_robot_state_max0.003885296361829518
get_robot_state_mean0.003763750729016916
get_robot_state_median0.0037696838974456406
get_robot_state_min0.003630338759346866
get_state_dump_max0.005427466542595729
get_state_dump_mean0.004979635654738503
get_state_dump_median0.004889102402972143
get_state_dump_min0.004712871270413998
get_ui_image_max0.035584070005583626
get_ui_image_mean0.031336257797196745
get_ui_image_median0.03176370389654079
get_ui_image_min0.02623355339012178
in-drivable-lane_max21.64999999999949
in-drivable-lane_mean17.12499999999957
in-drivable-lane_min11.949999999999685
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.921019422730379, "get_ui_image": 0.02963406438136677, "step_physics": 0.11915874759124578, "survival_time": 59.99999999999873, "driven_lanedir": 4.873706573038142, "get_state_dump": 0.004712871270413998, "get_robot_state": 0.003831490588922683, "sim_render-ego0": 0.003852234196404831, "get_duckie_state": 1.455723097878233e-06, "in-drivable-lane": 21.249999999999456, "deviation-heading": 8.785155373779421, "agent_compute-ego0": 0.011753461839356688, "complete-iteration": 0.1869923923533723, "set_robot_commands": 0.0022480003442692815, "deviation-center-line": 3.5766448829502986, "driven_lanedir_consec": 4.873706573038142, "sim_compute_sim_state": 0.00963967467823394, "sim_compute_performance-ego0": 0.00206524426494411}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.920932123739414, "get_ui_image": 0.035584070005583626, "step_physics": 0.144680323350638, "survival_time": 59.99999999999873, "driven_lanedir": 5.597822266418271, "get_state_dump": 0.004771063865769614, "get_robot_state": 0.003630338759346866, "sim_render-ego0": 0.003704586791356934, "get_duckie_state": 1.3546780880841483e-06, "in-drivable-lane": 11.949999999999685, "deviation-heading": 18.91142385326124, "agent_compute-ego0": 0.012109929576305228, "complete-iteration": 0.22106356882830644, "set_robot_commands": 0.0021508669078995246, "deviation-center-line": 4.2902602647195, "driven_lanedir_consec": 5.597822266418271, "sim_compute_sim_state": 0.012384928037085996, "sim_compute_performance-ego0": 0.001954727029919525}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.914332376687018, "get_ui_image": 0.03389334341171481, "step_physics": 0.13913190434318498, "survival_time": 59.99999999999873, "driven_lanedir": 5.363803519114785, "get_state_dump": 0.005007140940174671, "get_robot_state": 0.003885296361829518, "sim_render-ego0": 0.003976842148119365, "get_duckie_state": 1.5637161928251522e-06, "in-drivable-lane": 13.649999999999654, "deviation-heading": 18.40197113965874, "agent_compute-ego0": 0.012491598812169971, "complete-iteration": 0.2164050696989976, "set_robot_commands": 0.002266257529850308, "deviation-center-line": 4.291853510181824, "driven_lanedir_consec": 5.363803519114785, "sim_compute_sim_state": 0.013503543542485553, "sim_compute_performance-ego0": 0.0021384864127407663}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920592936970287, "get_ui_image": 0.02623355339012178, "step_physics": 0.12251536157307875, "survival_time": 59.99999999999873, "driven_lanedir": 4.610240564457578, "get_state_dump": 0.005427466542595729, "get_robot_state": 0.003707877205968598, "sim_render-ego0": 0.00374708604455292, "get_duckie_state": 1.2621692971921186e-06, "in-drivable-lane": 21.64999999999949, "deviation-heading": 13.562147546922551, "agent_compute-ego0": 0.012285906508205135, "complete-iteration": 0.18430222083289455, "set_robot_commands": 0.002155569967481119, "deviation-center-line": 4.1884194691912375, "driven_lanedir_consec": 4.610240564457578, "sim_compute_sim_state": 0.006262421707229551, "sim_compute_performance-ego0": 0.001873490415346017}}
set_robot_commands_max0.002266257529850308
set_robot_commands_mean0.0022051736873750583
set_robot_commands_median0.0022017851558752003
set_robot_commands_min0.0021508669078995246
sim_compute_performance-ego0_max0.0021384864127407663
sim_compute_performance-ego0_mean0.0020079870307376044
sim_compute_performance-ego0_median0.0020099856474318175
sim_compute_performance-ego0_min0.001873490415346017
sim_compute_sim_state_max0.013503543542485553
sim_compute_sim_state_mean0.01044764199125876
sim_compute_sim_state_median0.011012301357659968
sim_compute_sim_state_min0.006262421707229551
sim_render-ego0_max0.003976842148119365
sim_render-ego0_mean0.003820187295108512
sim_render-ego0_median0.003799660120478875
sim_render-ego0_min0.003704586791356934
simulation-passed1
step_physics_max0.144680323350638
step_physics_mean0.13137158421453687
step_physics_median0.13082363295813187
step_physics_min0.11915874759124578
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5446611524Jean-Sébastien Grondin 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:13:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7492323866785631
survival_time_median18.60000000000013
deviation-center-line_median0.2300188603602864
in-drivable-lane_median10.074999999999942


other stats
agent_compute-ego0_max0.012832503350789117
agent_compute-ego0_mean0.01230226121016057
agent_compute-ego0_median0.012151530481721096
agent_compute-ego0_min0.012073480526410977
complete-iteration_max0.28161871433258057
complete-iteration_mean0.2336102815396082
complete-iteration_median0.23664982847705623
complete-iteration_min0.17952275487173974
deviation-center-line_max2.2027643448698178
deviation-center-line_mean0.6712488504897206
deviation-center-line_min0.022193336368492057
deviation-heading_max8.92025947508403
deviation-heading_mean3.1197160493681033
deviation-heading_median1.5054591655113656
deviation-heading_min0.5476863913656523
driven_any_max10.092448417556142
driven_any_mean5.040712093371855
driven_any_median4.907951910567576
driven_any_min0.2544961347961279
driven_lanedir_consec_max7.255981943965089
driven_lanedir_consec_mean2.2011896633896835
driven_lanedir_consec_min0.05031193623651875
driven_lanedir_max7.255981943965089
driven_lanedir_mean2.2011896633896835
driven_lanedir_median0.7492323866785631
driven_lanedir_min0.05031193623651875
get_duckie_state_max1.379170600643552e-06
get_duckie_state_mean1.3432838496488862e-06
get_duckie_state_median1.3681533965956255e-06
get_duckie_state_min1.2576580047607425e-06
get_robot_state_max0.003908293999281506
get_robot_state_mean0.0036590627042414506
get_robot_state_median0.003654433750181259
get_robot_state_min0.0034190893173217775
get_state_dump_max0.004858539888522769
get_state_dump_mean0.004728090972184023
get_state_dump_median0.00472960429908955
get_state_dump_min0.004594615402034225
get_ui_image_max0.03407770099255863
get_ui_image_mean0.03040424292955189
get_ui_image_median0.030782028717842386
get_ui_image_min0.025975213289964164
in-drivable-lane_max19.050000000000153
in-drivable-lane_mean10.11250000000001
in-drivable-lane_min1.250000000000001
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.382998521636259, "get_ui_image": 0.02817647990196284, "step_physics": 0.1430418116454703, "survival_time": 20.300000000000153, "driven_lanedir": 0.14758378586712562, "get_state_dump": 0.004594615402034225, "get_robot_state": 0.003572654958439108, "sim_render-ego0": 0.003626644757807401, "get_duckie_state": 1.3707603810753224e-06, "in-drivable-lane": 19.050000000000153, "deviation-heading": 0.8755285826672731, "agent_compute-ego0": 0.012073480526410977, "complete-iteration": 0.2061121703951599, "set_robot_commands": 0.002159017309802756, "deviation-center-line": 0.09205322305303656, "driven_lanedir_consec": 0.14758378586712562, "sim_compute_sim_state": 0.006906401613127687, "sim_compute_performance-ego0": 0.00187789485847042}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2544961347961279, "get_ui_image": 0.03338757753372192, "step_physics": 0.21127589344978331, "survival_time": 1.950000000000001, "driven_lanedir": 0.05031193623651875, "get_state_dump": 0.004822969436645508, "get_robot_state": 0.0034190893173217775, "sim_render-ego0": 0.004643255472183227, "get_duckie_state": 1.2576580047607425e-06, "in-drivable-lane": 1.250000000000001, "deviation-heading": 0.5476863913656523, "agent_compute-ego0": 0.012077486515045166, "complete-iteration": 0.28161871433258057, "set_robot_commands": 0.0020823419094085694, "deviation-center-line": 0.022193336368492057, "driven_lanedir_consec": 0.05031193623651875, "sim_compute_sim_state": 0.007961082458496093, "sim_compute_performance-ego0": 0.0018676698207855224}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.092448417556142, "get_ui_image": 0.03407770099255863, "step_physics": 0.18938358614108705, "survival_time": 37.200000000000024, "driven_lanedir": 7.255981943965089, "get_state_dump": 0.004858539888522769, "get_robot_state": 0.003908293999281506, "sim_render-ego0": 0.00393734650323855, "get_duckie_state": 1.365546412115929e-06, "in-drivable-lane": 8.899999999999768, "deviation-heading": 8.92025947508403, "agent_compute-ego0": 0.012832503350789117, "complete-iteration": 0.2671874865589526, "set_robot_commands": 0.0023277081099132564, "deviation-center-line": 2.2027643448698178, "driven_lanedir_consec": 7.255981943965089, "sim_compute_sim_state": 0.013629632348182217, "sim_compute_performance-ego0": 0.002139318389380538}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.432905299498891, "get_ui_image": 0.025975213289964164, "step_physics": 0.1184167918202448, "survival_time": 16.900000000000105, "driven_lanedir": 1.3508809874900003, "get_state_dump": 0.004636239161533592, "get_robot_state": 0.0037362125419234103, "sim_render-ego0": 0.003791557300758925, "get_duckie_state": 1.379170600643552e-06, "in-drivable-lane": 11.250000000000115, "deviation-heading": 2.135389748355458, "agent_compute-ego0": 0.012225574448397026, "complete-iteration": 0.17952275487173974, "set_robot_commands": 0.0022408434775023334, "deviation-center-line": 0.3679844976675362, "driven_lanedir_consec": 1.3508809874900003, "sim_compute_sim_state": 0.006408903099442653, "sim_compute_performance-ego0": 0.002004413126492571}}
set_robot_commands_max0.0023277081099132564
set_robot_commands_mean0.002202477701656729
set_robot_commands_median0.0021999303936525447
set_robot_commands_min0.0020823419094085694
sim_compute_performance-ego0_max0.002139318389380538
sim_compute_performance-ego0_mean0.001972324048782263
sim_compute_performance-ego0_median0.0019411539924814951
sim_compute_performance-ego0_min0.0018676698207855224
sim_compute_sim_state_max0.013629632348182217
sim_compute_sim_state_mean0.008726504879812162
sim_compute_sim_state_median0.00743374203581189
sim_compute_sim_state_min0.006408903099442653
sim_render-ego0_max0.004643255472183227
sim_render-ego0_mean0.003999701008497026
sim_render-ego0_median0.0038644519019987375
sim_render-ego0_min0.003626644757807401
simulation-passed1
step_physics_max0.21127589344978331
step_physics_mean0.16552952076414637
step_physics_median0.1662126988932787
step_physics_min0.1184167918202448
survival_time_max37.200000000000024
survival_time_mean19.08750000000007
survival_time_min1.950000000000001
No reset possible
5436311561Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:35:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.972304687839711
survival_time_median59.99999999999873
deviation-center-line_median2.629051112298106
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012651937986591475
agent_compute-ego0_mean0.012291118614282536
agent_compute-ego0_median0.012371177975085256
agent_compute-ego0_min0.011770180520368158
complete-iteration_max0.20436184451939363
complete-iteration_mean0.18191452601073088
complete-iteration_median0.18056820195283024
complete-iteration_min0.1621598556178694
deviation-center-line_max4.2111375695605675
deviation-center-line_mean2.951639690023109
deviation-center-line_min2.3373189659356544
deviation-heading_max7.278905077689474
deviation-heading_mean5.583918785662409
deviation-heading_median5.94671093338398
deviation-heading_min3.1633481981922
driven_any_max4.002342600917214
driven_any_mean4.001498269461621
driven_any_median4.002335324097265
driven_any_min3.9989798287347376
driven_lanedir_consec_max3.991010945056227
driven_lanedir_consec_mean3.971328366520443
driven_lanedir_consec_min3.949693145346125
driven_lanedir_max3.991010945056227
driven_lanedir_mean3.971328366520443
driven_lanedir_median3.972304687839711
driven_lanedir_min3.949693145346125
get_duckie_state_max1.4430180278844778e-06
get_duckie_state_mean1.3709564590136474e-06
get_duckie_state_median1.3929918147840668e-06
get_duckie_state_min1.2548241786019788e-06
get_robot_state_max0.003969666364290236
get_robot_state_mean0.003842482955926264
get_robot_state_median0.0038702289428837982
get_robot_state_min0.003659807573647225
get_state_dump_max0.004957038695171017
get_state_dump_mean0.004830970107069817
get_state_dump_median0.004891969976973077
get_state_dump_min0.0045829017791621
get_ui_image_max0.03766391021226665
get_ui_image_mean0.03146049531671427
get_ui_image_median0.03037675840471507
get_ui_image_min0.027424554245160285
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.002342600917214, "get_ui_image": 0.029629286878015675, "step_physics": 0.1206843438096884, "survival_time": 59.99999999999873, "driven_lanedir": 3.991010945056227, "get_state_dump": 0.004843645548443314, "get_robot_state": 0.0038726724851736913, "sim_render-ego0": 0.003952316201596732, "get_duckie_state": 1.417409371178315e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.1633481981922, "agent_compute-ego0": 0.01242121550363863, "complete-iteration": 0.19101746552790533, "set_robot_commands": 0.002328627909549964, "deviation-center-line": 4.2111375695605675, "driven_lanedir_consec": 3.991010945056227, "sim_compute_sim_state": 0.011060387566127348, "sim_compute_performance-ego0": 0.0021345857577359647}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.002334682666548, "get_ui_image": 0.03766391021226665, "step_physics": 0.12426216437556564, "survival_time": 59.99999999999873, "driven_lanedir": 3.9647606925776446, "get_state_dump": 0.00494029440550284, "get_robot_state": 0.003969666364290236, "sim_render-ego0": 0.004066544905193243, "get_duckie_state": 1.3685742583898185e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.802691551406189, "agent_compute-ego0": 0.012651937986591475, "complete-iteration": 0.20436184451939363, "set_robot_commands": 0.002383759774137397, "deviation-center-line": 2.640603872798909, "driven_lanedir_consec": 3.9647606925776446, "sim_compute_sim_state": 0.012158637439877069, "sim_compute_performance-ego0": 0.002174166616651041}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.9989798287347376, "get_ui_image": 0.031124229931414473, "step_physics": 0.09973641180376724, "survival_time": 59.99999999999873, "driven_lanedir": 3.949693145346125, "get_state_dump": 0.0045829017791621, "get_robot_state": 0.003659807573647225, "sim_render-ego0": 0.0037806502587590784, "get_duckie_state": 1.2548241786019788e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.278905077689474, "agent_compute-ego0": 0.011770180520368158, "complete-iteration": 0.17011893837775516, "set_robot_commands": 0.0021834564050171, "deviation-center-line": 2.6174983517973027, "driven_lanedir_consec": 3.949693145346125, "sim_compute_sim_state": 0.0111826361466407, "sim_compute_performance-ego0": 0.0020146403681924204}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.002335965527982, "get_ui_image": 0.027424554245160285, "step_physics": 0.09868731109625492, "survival_time": 59.99999999999873, "driven_lanedir": 3.9798486831017774, "get_state_dump": 0.004957038695171017, "get_robot_state": 0.003867785400593906, "sim_render-ego0": 0.003966886931712384, "get_duckie_state": 1.4430180278844778e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.090730315361771, "agent_compute-ego0": 0.012321140446531882, "complete-iteration": 0.1621598556178694, "set_robot_commands": 0.0023034547985245246, "deviation-center-line": 2.3373189659356544, "driven_lanedir_consec": 3.9798486831017774, "sim_compute_sim_state": 0.0064728472453172165, "sim_compute_performance-ego0": 0.0020707773229263903}}
set_robot_commands_max0.002383759774137397
set_robot_commands_mean0.0022998247218072466
set_robot_commands_median0.0023160413540372444
set_robot_commands_min0.0021834564050171
sim_compute_performance-ego0_max0.002174166616651041
sim_compute_performance-ego0_mean0.002098542516376454
sim_compute_performance-ego0_median0.0021026815403311777
sim_compute_performance-ego0_min0.0020146403681924204
sim_compute_sim_state_max0.012158637439877069
sim_compute_sim_state_mean0.010218627099490582
sim_compute_sim_state_median0.011121511856384023
sim_compute_sim_state_min0.0064728472453172165
sim_render-ego0_max0.004066544905193243
sim_render-ego0_mean0.00394159957431536
sim_render-ego0_median0.0039596015666545584
sim_render-ego0_min0.0037806502587590784
simulation-passed1
step_physics_max0.12426216437556564
step_physics_mean0.11084255777131906
step_physics_median0.11021037780672782
step_physics_min0.09868731109625492
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5427211607Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:22:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.022413416407229
survival_time_median32.07500000000015
deviation-center-line_median1.439017283148046
in-drivable-lane_median6.97499999999993


other stats
agent_compute-ego0_max0.012872817520669684
agent_compute-ego0_mean0.012327077522157556
agent_compute-ego0_median0.0122607390743549
agent_compute-ego0_min0.011914014419250742
complete-iteration_max0.21695422268275055
complete-iteration_mean0.19637499931966768
complete-iteration_median0.1988352562666029
complete-iteration_min0.17087526206271436
deviation-center-line_max3.793111811386335
deviation-center-line_mean1.804958707218343
deviation-center-line_min0.5486884511909452
deviation-heading_max11.99134991548244
deviation-heading_mean6.308071525840447
deviation-heading_median5.5865913290443885
deviation-heading_min2.067753529790571
driven_any_max11.595677275272427
driven_any_mean7.191547511879526
driven_any_median6.27504274770193
driven_any_min4.6204272768418155
driven_lanedir_consec_max10.98114378145332
driven_lanedir_consec_mean5.688995483631837
driven_lanedir_consec_min1.730011320259571
driven_lanedir_max10.98114378145332
driven_lanedir_mean5.688995483631837
driven_lanedir_median5.022413416407229
driven_lanedir_min1.730011320259571
get_duckie_state_max1.3540785603618796e-06
get_duckie_state_mean1.334222687210086e-06
get_duckie_state_median1.3392786734660152e-06
get_duckie_state_min1.3042548415464327e-06
get_robot_state_max0.003875167860576581
get_robot_state_mean0.0037992845581054447
get_robot_state_median0.003793764477104453
get_robot_state_min0.0037344414176362934
get_state_dump_max0.004840922096501226
get_state_dump_mean0.004819374850751808
get_state_dump_median0.0048314714526356455
get_state_dump_min0.0047736344012347135
get_ui_image_max0.03534112825538173
get_ui_image_mean0.031037008380082023
get_ui_image_median0.031110887100103304
get_ui_image_min0.02658513106473975
in-drivable-lane_max19.250000000000274
in-drivable-lane_mean8.81250000000003
in-drivable-lane_min2.0499999999999927
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.577008312924825, "get_ui_image": 0.02893865173277648, "step_physics": 0.11718775882669118, "survival_time": 36.75000000000005, "driven_lanedir": 6.177414893310685, "get_state_dump": 0.004840922096501226, "get_robot_state": 0.0038108851598656697, "sim_render-ego0": 0.003842352848985921, "get_duckie_state": 1.3469353966090991e-06, "in-drivable-lane": 8.399999999999782, "deviation-heading": 6.0920072373751974, "agent_compute-ego0": 0.012125361548817676, "complete-iteration": 0.18491272142399912, "set_robot_commands": 0.002243101920770562, "deviation-center-line": 1.462330926336175, "driven_lanedir_consec": 6.177414893310685, "sim_compute_sim_state": 0.009798137390095257, "sim_compute_performance-ego0": 0.0020375588665837827}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.9730771824790345, "get_ui_image": 0.03534112825538173, "step_physics": 0.14151186879837152, "survival_time": 26.35000000000024, "driven_lanedir": 3.8674119395037727, "get_state_dump": 0.0047736344012347135, "get_robot_state": 0.0037344414176362934, "sim_render-ego0": 0.0039052344632871223, "get_duckie_state": 1.3316219503229314e-06, "in-drivable-lane": 5.550000000000079, "deviation-heading": 5.081175420713579, "agent_compute-ego0": 0.012396116599892124, "complete-iteration": 0.21695422268275055, "set_robot_commands": 0.0022704443245223074, "deviation-center-line": 1.4157036399599168, "driven_lanedir_consec": 3.8674119395037727, "sim_compute_sim_state": 0.010886460542678831, "sim_compute_performance-ego0": 0.0020458413795991378}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.6204272768418155, "get_ui_image": 0.03328312246743013, "step_physics": 0.13873716043427126, "survival_time": 27.400000000000254, "driven_lanedir": 1.730011320259571, "get_state_dump": 0.004832659914193909, "get_robot_state": 0.003875167860576581, "sim_render-ego0": 0.004042311878586511, "get_duckie_state": 1.3540785603618796e-06, "in-drivable-lane": 19.250000000000274, "deviation-heading": 2.067753529790571, "agent_compute-ego0": 0.012872817520669684, "complete-iteration": 0.21275779110920667, "set_robot_commands": 0.002324457377032504, "deviation-center-line": 0.5486884511909452, "driven_lanedir_consec": 1.730011320259571, "sim_compute_sim_state": 0.01058433181818283, "sim_compute_performance-ego0": 0.0021147597682932037}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.595677275272427, "get_ui_image": 0.02658513106473975, "step_physics": 0.10922467321480044, "survival_time": 59.99999999999873, "driven_lanedir": 10.98114378145332, "get_state_dump": 0.004830282991077382, "get_robot_state": 0.0037766437943432354, "sim_render-ego0": 0.0038103406177174537, "get_duckie_state": 1.3042548415464327e-06, "in-drivable-lane": 2.0499999999999927, "deviation-heading": 11.99134991548244, "agent_compute-ego0": 0.011914014419250742, "complete-iteration": 0.17087526206271436, "set_robot_commands": 0.002277316499212997, "deviation-center-line": 3.793111811386335, "driven_lanedir_consec": 10.98114378145332, "sim_compute_sim_state": 0.006353928187209105, "sim_compute_performance-ego0": 0.0020140628830578604}}
set_robot_commands_max0.002324457377032504
set_robot_commands_mean0.0022788300303845923
set_robot_commands_median0.002273880411867652
set_robot_commands_min0.002243101920770562
sim_compute_performance-ego0_max0.0021147597682932037
sim_compute_performance-ego0_mean0.002053055724383496
sim_compute_performance-ego0_median0.00204170012309146
sim_compute_performance-ego0_min0.0020140628830578604
sim_compute_sim_state_max0.010886460542678831
sim_compute_sim_state_mean0.009405714484541503
sim_compute_sim_state_median0.01019123460413904
sim_compute_sim_state_min0.006353928187209105
sim_render-ego0_max0.004042311878586511
sim_render-ego0_mean0.003900059952144252
sim_render-ego0_median0.003873793656136522
sim_render-ego0_min0.0038103406177174537
simulation-passed1
step_physics_max0.14151186879837152
step_physics_mean0.12666536531853362
step_physics_median0.12796245963048122
step_physics_min0.10922467321480044
survival_time_max59.99999999999873
survival_time_mean37.624999999999815
survival_time_min26.35000000000024
No reset possible
5421811633Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:14:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9411606329190768
survival_time_median21.100000000000165
deviation-center-line_median0.27191924475728985
in-drivable-lane_median15.82500000000013


other stats
agent_compute-ego0_max0.013392649081923206
agent_compute-ego0_mean0.012786665059485986
agent_compute-ego0_median0.012781577074813711
agent_compute-ego0_min0.012190857006393316
complete-iteration_max0.22258197684441844
complete-iteration_mean0.19583333727140284
complete-iteration_median0.19632505441546516
complete-iteration_min0.1681012634102625
deviation-center-line_max0.4208039689714152
deviation-center-line_mean0.2671458557904196
deviation-center-line_min0.1039409646756836
deviation-heading_max3.101829968584494
deviation-heading_mean1.634185102335462
deviation-heading_median1.3987430580932896
deviation-heading_min0.637424324570775
driven_any_max7.7997187778591
driven_any_mean4.554957711381011
driven_any_median4.575890801982413
driven_any_min1.2683304637001178
driven_lanedir_consec_max1.5934558489270714
driven_lanedir_consec_mean1.0336006721492672
driven_lanedir_consec_min0.6586255738318432
driven_lanedir_max1.5934558489270714
driven_lanedir_mean1.0336006721492672
driven_lanedir_median0.9411606329190768
driven_lanedir_min0.6586255738318432
get_duckie_state_max1.3458394558630255e-06
get_duckie_state_mean1.312252873937365e-06
get_duckie_state_median1.327403218133847e-06
get_duckie_state_min1.2483656036187402e-06
get_robot_state_max0.003888159473047397
get_robot_state_mean0.00378667793157746
get_robot_state_median0.003810599640361103
get_robot_state_min0.0036373529725402367
get_state_dump_max0.00493504023700027
get_state_dump_mean0.004781908826455829
get_state_dump_median0.00481253191992378
get_state_dump_min0.004567531228975485
get_ui_image_max0.03882822682780604
get_ui_image_mean0.03207306894808455
get_ui_image_median0.03143848723499415
get_ui_image_min0.026587074494543877
in-drivable-lane_max31.64999999999995
in-drivable-lane_mean16.62500000000005
in-drivable-lane_min3.1999999999999886
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.7997187778591, "get_ui_image": 0.03015279833560633, "step_physics": 0.12285172955216332, "survival_time": 37.40000000000001, "driven_lanedir": 1.1735918960617857, "get_state_dump": 0.004785530080145923, "get_robot_state": 0.003888159473047397, "sim_render-ego0": 0.003989209161103966, "get_duckie_state": 1.3458394558630255e-06, "in-drivable-lane": 31.64999999999995, "deviation-heading": 1.9700910970733352, "agent_compute-ego0": 0.01297145182682134, "complete-iteration": 0.19461731726082368, "set_robot_commands": 0.0023765226550032203, "deviation-center-line": 0.38878604287160173, "driven_lanedir_consec": 1.1735918960617857, "sim_compute_sim_state": 0.011390709272214026, "sim_compute_performance-ego0": 0.0021218744234663143}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2683304637001178, "get_ui_image": 0.03882822682780604, "step_physics": 0.14377225214435208, "survival_time": 6.149999999999986, "driven_lanedir": 0.6586255738318432, "get_state_dump": 0.004839533759701637, "get_robot_state": 0.003862038735420473, "sim_render-ego0": 0.003871352441849247, "get_duckie_state": 1.3093794545819683e-06, "in-drivable-lane": 3.1999999999999886, "deviation-heading": 0.8273950191132441, "agent_compute-ego0": 0.012591702322806082, "complete-iteration": 0.22258197684441844, "set_robot_commands": 0.002292060082958591, "deviation-center-line": 0.1039409646756836, "driven_lanedir_consec": 0.6586255738318432, "sim_compute_sim_state": 0.010370752503795008, "sim_compute_performance-ego0": 0.0020642203669394214}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.6827874227415687, "get_ui_image": 0.03272417613438198, "step_physics": 0.12413176024182244, "survival_time": 16.050000000000093, "driven_lanedir": 1.5934558489270714, "get_state_dump": 0.00493504023700027, "get_robot_state": 0.0037591605453017336, "sim_render-ego0": 0.0038668309679682953, "get_duckie_state": 1.2483656036187402e-06, "in-drivable-lane": 8.450000000000024, "deviation-heading": 3.101829968584494, "agent_compute-ego0": 0.013392649081923206, "complete-iteration": 0.19803279157010664, "set_robot_commands": 0.0022698907378297414, "deviation-center-line": 0.4208039689714152, "driven_lanedir_consec": 1.5934558489270714, "sim_compute_sim_state": 0.01085550814681912, "sim_compute_performance-ego0": 0.002012688180674678}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.468994181223258, "get_ui_image": 0.026587074494543877, "step_physics": 0.10686841811842591, "survival_time": 26.150000000000237, "driven_lanedir": 0.7087293697763684, "get_state_dump": 0.004567531228975485, "get_robot_state": 0.0036373529725402367, "sim_render-ego0": 0.003778800254559699, "get_duckie_state": 1.3454269816857257e-06, "in-drivable-lane": 23.200000000000237, "deviation-heading": 0.637424324570775, "agent_compute-ego0": 0.012190857006393316, "complete-iteration": 0.1681012634102625, "set_robot_commands": 0.002188020080100489, "deviation-center-line": 0.155052446642978, "driven_lanedir_consec": 0.7087293697763684, "sim_compute_sim_state": 0.006247258823336536, "sim_compute_performance-ego0": 0.0019509373730375568}}
set_robot_commands_max0.0023765226550032203
set_robot_commands_mean0.0022816233889730105
set_robot_commands_median0.002280975410394166
set_robot_commands_min0.002188020080100489
sim_compute_performance-ego0_max0.0021218744234663143
sim_compute_performance-ego0_mean0.002037430086029493
sim_compute_performance-ego0_median0.0020384542738070494
sim_compute_performance-ego0_min0.0019509373730375568
sim_compute_sim_state_max0.011390709272214026
sim_compute_sim_state_mean0.009716057186541172
sim_compute_sim_state_median0.010613130325307064
sim_compute_sim_state_min0.006247258823336536
sim_render-ego0_max0.003989209161103966
sim_render-ego0_mean0.0038765482063703015
sim_render-ego0_median0.003869091704908771
sim_render-ego0_min0.003778800254559699
simulation-passed1
step_physics_max0.14377225214435208
step_physics_mean0.12440604001419094
step_physics_median0.12349174489699288
step_physics_min0.10686841811842591
survival_time_max37.40000000000001
survival_time_mean21.43750000000008
survival_time_min6.149999999999986
No reset possible
5415611650Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:26:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.4588689695708705
survival_time_median43.349999999999675
deviation-center-line_median1.5834250597969597
in-drivable-lane_median26.89999999999988


other stats
agent_compute-ego0_max0.012674878102652037
agent_compute-ego0_mean0.012523279662595033
agent_compute-ego0_median0.012621270916952651
agent_compute-ego0_min0.012175698713822798
complete-iteration_max0.22128882304481837
complete-iteration_mean0.1984760378537841
complete-iteration_median0.19685180764312285
complete-iteration_min0.17891171308407225
deviation-center-line_max1.8296449142539608
deviation-center-line_mean1.2804291946778965
deviation-center-line_min0.12522174486370632
deviation-heading_max7.188118674474241
deviation-heading_mean5.038828953421045
deviation-heading_median6.1025314150571415
deviation-heading_min0.7621343090956534
driven_any_max11.315370024646503
driven_any_mean8.510969018602916
driven_any_median8.723107192716709
driven_any_min5.2822916643317415
driven_lanedir_consec_max6.157532244843333
driven_lanedir_consec_mean3.9384548539158537
driven_lanedir_consec_min0.6785492316783388
driven_lanedir_max6.157532244843333
driven_lanedir_mean3.9384548539158537
driven_lanedir_median4.4588689695708705
driven_lanedir_min0.6785492316783388
get_duckie_state_max1.3886327328889266e-06
get_duckie_state_mean1.3475832055958296e-06
get_duckie_state_median1.3454457623411928e-06
get_duckie_state_min1.3108085648120066e-06
get_robot_state_max0.0038902199113523806
get_robot_state_mean0.003840035241916024
get_robot_state_median0.0038405639328229248
get_robot_state_min0.003788793190665867
get_state_dump_max0.004839528421437519
get_state_dump_mean0.0047842740925409695
get_state_dump_median0.004779448874114918
get_state_dump_min0.004738670200496525
get_ui_image_max0.036653908439304515
get_ui_image_mean0.03157114106478947
get_ui_image_median0.03065300626806815
get_ui_image_min0.02832464328371706
in-drivable-lane_max32.39999999999904
in-drivable-lane_mean24.549999999999628
in-drivable-lane_min11.999999999999712
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.971824183478296, "get_ui_image": 0.028666208936022473, "step_physics": 0.11921140837979008, "survival_time": 38.44999999999995, "driven_lanedir": 6.157532244843333, "get_state_dump": 0.004738670200496525, "get_robot_state": 0.0038902199113523806, "sim_render-ego0": 0.003845091609211711, "get_duckie_state": 1.3280224490475345e-06, "in-drivable-lane": 11.999999999999712, "deviation-heading": 5.718645999084838, "agent_compute-ego0": 0.012175698713822798, "complete-iteration": 0.1864959930444693, "set_robot_commands": 0.002339990727313153, "deviation-center-line": 1.6460860511716295, "driven_lanedir_consec": 6.157532244843333, "sim_compute_sim_state": 0.009435848756269976, "sim_compute_performance-ego0": 0.0021055475457922206}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.315370024646503, "get_ui_image": 0.036653908439304515, "step_physics": 0.1425152061296546, "survival_time": 57.44999999999887, "driven_lanedir": 4.914164933776802, "get_state_dump": 0.004752453099126401, "get_robot_state": 0.003788793190665867, "sim_render-ego0": 0.00391322488370149, "get_duckie_state": 1.3886327328889266e-06, "in-drivable-lane": 32.39999999999904, "deviation-heading": 7.188118674474241, "agent_compute-ego0": 0.012671853355739428, "complete-iteration": 0.22128882304481837, "set_robot_commands": 0.002300567004991614, "deviation-center-line": 1.8296449142539608, "driven_lanedir_consec": 4.914164933776802, "sim_compute_sim_state": 0.012488601104072903, "sim_compute_performance-ego0": 0.002110089633775794}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.474390201955122, "get_ui_image": 0.03263980360011383, "step_physics": 0.13117831957759818, "survival_time": 48.24999999999939, "driven_lanedir": 4.00357300536494, "get_state_dump": 0.004839528421437519, "get_robot_state": 0.0038347681116613543, "sim_render-ego0": 0.0038875948568308574, "get_duckie_state": 1.3108085648120066e-06, "in-drivable-lane": 28.49999999999948, "deviation-heading": 6.4864168310294446, "agent_compute-ego0": 0.012674878102652037, "complete-iteration": 0.20720762224177644, "set_robot_commands": 0.0023292695513423187, "deviation-center-line": 1.5207640684222894, "driven_lanedir_consec": 4.00357300536494, "sim_compute_sim_state": 0.013602785442186438, "sim_compute_performance-ego0": 0.0021298338907846013}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.2822916643317415, "get_ui_image": 0.02832464328371706, "step_physics": 0.1144062445585448, "survival_time": 28.50000000000027, "driven_lanedir": 0.6785492316783388, "get_state_dump": 0.004806444649103435, "get_robot_state": 0.0038463597539844943, "sim_render-ego0": 0.003999505068082525, "get_duckie_state": 1.362869075634851e-06, "in-drivable-lane": 25.30000000000027, "deviation-heading": 0.7621343090956534, "agent_compute-ego0": 0.012570688478165877, "complete-iteration": 0.17891171308407225, "set_robot_commands": 0.0024164883768913415, "deviation-center-line": 0.12522174486370632, "driven_lanedir_consec": 0.6785492316783388, "sim_compute_sim_state": 0.006329194468082355, "sim_compute_performance-ego0": 0.002126011038411102}}
set_robot_commands_max0.0024164883768913415
set_robot_commands_mean0.002346578915134607
set_robot_commands_median0.002334630139327736
set_robot_commands_min0.002300567004991614
sim_compute_performance-ego0_max0.0021298338907846013
sim_compute_performance-ego0_mean0.00211787052719093
sim_compute_performance-ego0_median0.002118050336093448
sim_compute_performance-ego0_min0.0021055475457922206
sim_compute_sim_state_max0.013602785442186438
sim_compute_sim_state_mean0.010464107442652918
sim_compute_sim_state_median0.01096222493017144
sim_compute_sim_state_min0.006329194468082355
sim_render-ego0_max0.003999505068082525
sim_render-ego0_mean0.003911354104456646
sim_render-ego0_median0.003900409870266174
sim_render-ego0_min0.003845091609211711
simulation-passed1
step_physics_max0.1425152061296546
step_physics_mean0.1268277946613969
step_physics_median0.12519486397869412
step_physics_min0.1144062445585448
survival_time_max57.44999999999887
survival_time_mean43.162499999999625
survival_time_min28.50000000000027
No reset possible
5405211682Bhavya Patwa 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:34:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.273291225856315
survival_time_median59.99999999999873
deviation-center-line_median2.7564100840121197
in-drivable-lane_median2.07500000000001


other stats
agent_compute-ego0_max0.013106609959090182
agent_compute-ego0_mean0.012804012237822076
agent_compute-ego0_median0.01280597479671779
agent_compute-ego0_min0.012497489398762546
complete-iteration_max0.2206257697843096
complete-iteration_mean0.20371725825354176
complete-iteration_median0.20915471197480773
complete-iteration_min0.17593383928024203
deviation-center-line_max3.2217712363547024
deviation-center-line_mean2.6212817485608504
deviation-center-line_min1.7505355898644603
deviation-heading_max17.67640549082442
deviation-heading_mean13.856564832613037
deviation-heading_median14.7150256434599
deviation-heading_min8.319802552707923
driven_any_max10.137402783491698
driven_any_mean9.266358664705272
driven_any_median9.98086987662694
driven_any_min6.966292122075513
driven_lanedir_consec_max9.67259600167273
driven_lanedir_consec_mean7.06002237518492
driven_lanedir_consec_min4.0209110473543195
driven_lanedir_max9.67259600167273
driven_lanedir_mean8.261326114440555
driven_lanedir_median9.18498381484736
driven_lanedir_min5.0027408263947715
get_duckie_state_max2.3990745449145567e-06
get_duckie_state_mean2.232794290721917e-06
get_duckie_state_median2.211530499504874e-06
get_duckie_state_min2.109041618963364e-06
get_robot_state_max0.0039089418867049265
get_robot_state_mean0.0037629174442057912
get_robot_state_median0.0037206881628625912
get_robot_state_min0.003701351564393056
get_state_dump_max0.005172575046180388
get_state_dump_mean0.004829144358790604
get_state_dump_median0.0047650607201975646
get_state_dump_min0.004613880948586897
get_ui_image_max0.03470855569164521
get_ui_image_mean0.030720005018774615
get_ui_image_median0.03077220736345979
get_ui_image_min0.02662704965653368
in-drivable-lane_max11.549999999999343
in-drivable-lane_mean3.924999999999841
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.112612069543424, "get_ui_image": 0.029547491041845723, "step_physics": 0.12937709195329983, "survival_time": 59.99999999999873, "driven_lanedir": 9.547807611450928, "get_state_dump": 0.004802684799816884, "get_robot_state": 0.0039089418867049265, "sim_render-ego0": 0.00395809561882686, "get_duckie_state": 2.3990745449145567e-06, "in-drivable-lane": 1.3500000000000192, "deviation-heading": 14.180400091988098, "agent_compute-ego0": 0.012992562302741085, "complete-iteration": 0.19903309895136673, "set_robot_commands": 0.0024137498933409374, "deviation-center-line": 2.5444758211571674, "driven_lanedir_consec": 9.547807611450928, "sim_compute_sim_state": 0.0097753388200771, "sim_compute_performance-ego0": 0.0021656939230989556}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.137402783491698, "get_ui_image": 0.03470855569164521, "step_physics": 0.1424081081355442, "survival_time": 59.99999999999873, "driven_lanedir": 9.67259600167273, "get_state_dump": 0.005172575046180388, "get_robot_state": 0.003707295154949509, "sim_render-ego0": 0.003864627396633583, "get_duckie_state": 2.109041618963364e-06, "in-drivable-lane": 0.0, "deviation-heading": 15.2496511949317, "agent_compute-ego0": 0.013106609959090182, "complete-iteration": 0.2206257697843096, "set_robot_commands": 0.002307292722246232, "deviation-center-line": 2.968344346867072, "driven_lanedir_consec": 9.67259600167273, "sim_compute_sim_state": 0.013216566384384575, "sim_compute_performance-ego0": 0.0020507070841539114}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.966292122075513, "get_ui_image": 0.031996923685073855, "step_physics": 0.14447833841497248, "survival_time": 43.94999999999964, "driven_lanedir": 5.0027408263947715, "get_state_dump": 0.004613880948586897, "get_robot_state": 0.0037340811707756738, "sim_render-ego0": 0.00384429855780168, "get_duckie_state": 2.167712558399547e-06, "in-drivable-lane": 11.549999999999343, "deviation-heading": 8.319802552707923, "agent_compute-ego0": 0.012619387290694496, "complete-iteration": 0.2192763249982487, "set_robot_commands": 0.0022797608917409723, "deviation-center-line": 1.7505355898644603, "driven_lanedir_consec": 4.998774840261701, "sim_compute_sim_state": 0.013574284586039456, "sim_compute_performance-ego0": 0.002047545259649103}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.849127683710456, "get_ui_image": 0.02662704965653368, "step_physics": 0.11422530935765504, "survival_time": 59.99999999999873, "driven_lanedir": 8.822160018243794, "get_state_dump": 0.004727436640578246, "get_robot_state": 0.003701351564393056, "sim_render-ego0": 0.003769065418608679, "get_duckie_state": 2.255348440610201e-06, "in-drivable-lane": 2.8000000000000007, "deviation-heading": 17.67640549082442, "agent_compute-ego0": 0.012497489398762546, "complete-iteration": 0.17593383928024203, "set_robot_commands": 0.0022752828939471216, "deviation-center-line": 3.2217712363547024, "driven_lanedir_consec": 4.0209110473543195, "sim_compute_sim_state": 0.006049965144593352, "sim_compute_performance-ego0": 0.0019765327018464634}}
set_robot_commands_max0.0024137498933409374
set_robot_commands_mean0.0023190216003188156
set_robot_commands_median0.002293526806993602
set_robot_commands_min0.0022752828939471216
sim_compute_performance-ego0_max0.0021656939230989556
sim_compute_performance-ego0_mean0.0020601197421871087
sim_compute_performance-ego0_median0.002049126171901507
sim_compute_performance-ego0_min0.0019765327018464634
sim_compute_sim_state_max0.013574284586039456
sim_compute_sim_state_mean0.010654038733773625
sim_compute_sim_state_median0.011495952602230838
sim_compute_sim_state_min0.006049965144593352
sim_render-ego0_max0.00395809561882686
sim_render-ego0_mean0.003859021747967701
sim_render-ego0_median0.003854462977217632
sim_render-ego0_min0.003769065418608679
simulation-passed1
step_physics_max0.14447833841497248
step_physics_mean0.1326222119653679
step_physics_median0.135892600044422
step_physics_min0.11422530935765504
survival_time_max59.99999999999873
survival_time_mean55.98749999999895
survival_time_min43.94999999999964
No reset possible
5404911705brian wongbaseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5397611731Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:24:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.959500031093986
survival_time_median39.474999999999575
deviation-center-line_median1.2855910031735545
in-drivable-lane_median19.94999999999959


other stats
agent_compute-ego0_max0.013052778226973438
agent_compute-ego0_mean0.012415218299938292
agent_compute-ego0_median0.012365811670920542
agent_compute-ego0_min0.01187647163093864
complete-iteration_max0.2300221853963598
complete-iteration_mean0.20462260221476591
complete-iteration_median0.2056346123569275
complete-iteration_min0.1771989987488488
deviation-center-line_max2.1613880395990472
deviation-center-line_mean1.2886103836782703
deviation-center-line_min0.4218714887669255
deviation-heading_max10.434138993679731
deviation-heading_mean5.984467030667154
deviation-heading_median5.781612095357342
deviation-heading_min1.9405049382741988
driven_any_max13.17439129702074
driven_any_mean7.965385293602357
driven_any_median7.14251124647881
driven_any_min4.402127384431073
driven_lanedir_consec_max6.200725341845583
driven_lanedir_consec_mean3.408573700564621
driven_lanedir_consec_min1.5145693982249282
driven_lanedir_max7.994032374750411
driven_lanedir_mean3.858079029731987
driven_lanedir_median2.961857172976305
driven_lanedir_min1.5145693982249282
get_duckie_state_max1.4493705628813551e-06
get_duckie_state_mean1.338144036640301e-06
get_duckie_state_median1.3186582306536334e-06
get_duckie_state_min1.2658891223725818e-06
get_robot_state_max0.003982772588186764
get_robot_state_mean0.003885365483679768
get_robot_state_median0.003938417805207251
get_robot_state_min0.003681853736117805
get_state_dump_max0.004989331912738708
get_state_dump_mean0.0048456304691725655
get_state_dump_median0.004932185369708211
get_state_dump_min0.004528819224535129
get_ui_image_max0.036694085959232216
get_ui_image_mean0.03277830733743511
get_ui_image_median0.03290651201955516
get_ui_image_min0.02860611935139789
in-drivable-lane_max42.499999999999
in-drivable-lane_mean21.74999999999956
in-drivable-lane_min4.600000000000065
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 13.17439129702074, "get_ui_image": 0.030390507573390586, "step_physics": 0.11919038539921412, "survival_time": 59.99999999999873, "driven_lanedir": 7.994032374750411, "get_state_dump": 0.004938728704142829, "get_robot_state": 0.003910528630837116, "sim_render-ego0": 0.004009766542941307, "get_duckie_state": 1.4493705628813551e-06, "in-drivable-lane": 25.849999999998985, "deviation-heading": 10.434138993679731, "agent_compute-ego0": 0.01211342486017054, "complete-iteration": 0.18916790272969192, "set_robot_commands": 0.0023564954879976728, "deviation-center-line": 2.1613880395990472, "driven_lanedir_consec": 6.200725341845583, "sim_compute_sim_state": 0.010028279294181526, "sim_compute_performance-ego0": 0.0021362084333942295}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.629218673584049, "get_ui_image": 0.036694085959232216, "step_physics": 0.14637443358763988, "survival_time": 23.050000000000193, "driven_lanedir": 3.7380873889692943, "get_state_dump": 0.004528819224535129, "get_robot_state": 0.003681853736117805, "sim_render-ego0": 0.003718011306993889, "get_duckie_state": 1.2658891223725818e-06, "in-drivable-lane": 4.600000000000065, "deviation-heading": 5.798335189934956, "agent_compute-ego0": 0.01187647163093864, "complete-iteration": 0.2221013219841631, "set_robot_commands": 0.002218073064630682, "deviation-center-line": 1.5015203275657212, "driven_lanedir_consec": 3.7377136028363216, "sim_compute_sim_state": 0.010877978234064011, "sim_compute_performance-ego0": 0.002047968633247144}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.65580381937357, "get_ui_image": 0.035422516465719735, "step_physics": 0.15178967267940682, "survival_time": 55.89999999999896, "driven_lanedir": 2.185626956983316, "get_state_dump": 0.004989331912738708, "get_robot_state": 0.0039663069795773855, "sim_render-ego0": 0.004062695626811964, "get_duckie_state": 1.3393200967224504e-06, "in-drivable-lane": 42.499999999999, "deviation-heading": 5.764889000779728, "agent_compute-ego0": 0.013052778226973438, "complete-iteration": 0.2300221853963598, "set_robot_commands": 0.0023399136554353253, "deviation-center-line": 1.069661678781388, "driven_lanedir_consec": 2.18128645935165, "sim_compute_sim_state": 0.012081050787577149, "sim_compute_performance-ego0": 0.0022203159502726566}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.402127384431073, "get_ui_image": 0.02860611935139789, "step_physics": 0.11170569313414276, "survival_time": 21.900000000000176, "driven_lanedir": 1.5145693982249282, "get_state_dump": 0.004925642035273593, "get_robot_state": 0.003982772588186764, "sim_render-ego0": 0.004053260307920278, "get_duckie_state": 1.2979963645848164e-06, "in-drivable-lane": 14.050000000000196, "deviation-heading": 1.9405049382741988, "agent_compute-ego0": 0.012618198481670544, "complete-iteration": 0.1771989987488488, "set_robot_commands": 0.002393584588122531, "deviation-center-line": 0.4218714887669255, "driven_lanedir_consec": 1.5145693982249282, "sim_compute_sim_state": 0.006703173109502076, "sim_compute_performance-ego0": 0.002120653969280269}}
set_robot_commands_max0.002393584588122531
set_robot_commands_mean0.0023270166990465527
set_robot_commands_median0.0023482045717164992
set_robot_commands_min0.002218073064630682
sim_compute_performance-ego0_max0.0022203159502726566
sim_compute_performance-ego0_mean0.0021312867465485747
sim_compute_performance-ego0_median0.002128431201337249
sim_compute_performance-ego0_min0.002047968633247144
sim_compute_sim_state_max0.012081050787577149
sim_compute_sim_state_mean0.009922620356331189
sim_compute_sim_state_median0.010453128764122768
sim_compute_sim_state_min0.006703173109502076
sim_render-ego0_max0.004062695626811964
sim_render-ego0_mean0.003960933446166859
sim_render-ego0_median0.004031513425430793
sim_render-ego0_min0.003718011306993889
simulation-passed1
step_physics_max0.15178967267940682
step_physics_mean0.1322650462001009
step_physics_median0.132782409493427
step_physics_min0.11170569313414276
survival_time_max59.99999999999873
survival_time_mean40.212499999999515
survival_time_min21.900000000000176
No reset possible
5394511708Mo Kleit 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:21:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.0881557239926596
survival_time_median31.024999999999597
deviation-center-line_median1.0588113673973412
in-drivable-lane_median12.524999999999904


other stats
agent_compute-ego0_max0.01365096345910885
agent_compute-ego0_mean0.013259622527074404
agent_compute-ego0_median0.013233795761808862
agent_compute-ego0_min0.012919935125571031
complete-iteration_max0.3293627062622382
complete-iteration_mean0.2613774552451541
complete-iteration_median0.24804072702914737
complete-iteration_min0.22006566066008348
deviation-center-line_max2.816749256851416
deviation-center-line_mean1.273019151510199
deviation-center-line_min0.15770461439469743
deviation-heading_max14.079333221314402
deviation-heading_mean6.675263946017764
deviation-heading_median5.762453705415103
deviation-heading_min1.096815151926448
driven_any_max15.840790408904311
driven_any_mean8.190278217255266
driven_any_median7.954358635914049
driven_any_min1.0116051882886523
driven_lanedir_consec_max9.487729377311204
driven_lanedir_consec_mean3.5955894161861712
driven_lanedir_consec_min0.7183168394481616
driven_lanedir_max9.487729377311204
driven_lanedir_mean4.065935220563219
driven_lanedir_median3.028847332746754
driven_lanedir_min0.7183168394481616
get_duckie_state_max1.7100367052801724e-06
get_duckie_state_mean1.585356856847961e-06
get_duckie_state_median1.6038783532574209e-06
get_duckie_state_min1.4236340155968298e-06
get_robot_state_max0.004204196882952611
get_robot_state_mean0.004018301607111912
get_robot_state_median0.003993048642829787
get_robot_state_min0.003882912259835463
get_state_dump_max0.0052218566387157725
get_state_dump_mean0.004970910320683728
get_state_dump_median0.004945705287586035
get_state_dump_min0.0047703740688470695
get_ui_image_max0.04087787258381746
get_ui_image_mean0.03383857270289307
get_ui_image_median0.03304593524491313
get_ui_image_min0.028384547737928537
in-drivable-lane_max30.04999999999949
in-drivable-lane_mean14.17499999999982
in-drivable-lane_min1.5999999999999943
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 15.840790408904311, "get_ui_image": 0.03066052068381583, "step_physics": 0.1618111786695444, "survival_time": 59.99999999999873, "driven_lanedir": 9.487729377311204, "get_state_dump": 0.004824366200277946, "get_robot_state": 0.003905507348955521, "sim_render-ego0": 0.003996206262923597, "get_duckie_state": 1.5996477189012411e-06, "in-drivable-lane": 20.149999999999796, "deviation-heading": 14.079333221314402, "agent_compute-ego0": 0.01316163065431517, "complete-iteration": 0.23312700757575372, "set_robot_commands": 0.002413719321766265, "deviation-center-line": 2.816749256851416, "driven_lanedir_consec": 9.487729377311204, "sim_compute_sim_state": 0.010055204315249072, "sim_compute_performance-ego0": 0.002205276965697938}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.0116051882886523, "get_ui_image": 0.04087787258381746, "step_physics": 0.24604674261443468, "survival_time": 4.849999999999991, "driven_lanedir": 0.7183168394481616, "get_state_dump": 0.005067044374894122, "get_robot_state": 0.004080589936704052, "sim_render-ego0": 0.004143432695038465, "get_duckie_state": 1.6081089876136002e-06, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 1.096815151926448, "agent_compute-ego0": 0.013305960869302556, "complete-iteration": 0.3293627062622382, "set_robot_commands": 0.002499064620660276, "deviation-center-line": 0.15770461439469743, "driven_lanedir_consec": 0.7183168394481616, "sim_compute_sim_state": 0.010995422090802872, "sim_compute_performance-ego0": 0.002249486592351174}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.3922390128966566, "get_ui_image": 0.03543134980601043, "step_physics": 0.1861669664899704, "survival_time": 10.100000000000009, "driven_lanedir": 1.0028406783980468, "get_state_dump": 0.0052218566387157725, "get_robot_state": 0.004204196882952611, "sim_render-ego0": 0.004145180650532539, "get_duckie_state": 1.7100367052801724e-06, "in-drivable-lane": 4.900000000000008, "deviation-heading": 2.432907219364061, "agent_compute-ego0": 0.01365096345910885, "complete-iteration": 0.26295444648254096, "set_robot_commands": 0.002471766448373278, "deviation-center-line": 0.2838258068492398, "driven_lanedir_consec": 0.9162563058580796, "sim_compute_sim_state": 0.009332679175390986, "sim_compute_performance-ego0": 0.0022268107371964476}, "LF-norm-small_loop-000-ego0": {"driven_any": 13.51647825893144, "get_ui_image": 0.028384547737928537, "step_physics": 0.15502410576893733, "survival_time": 51.949999999999186, "driven_lanedir": 5.054853987095461, "get_state_dump": 0.0047703740688470695, "get_robot_state": 0.003882912259835463, "sim_render-ego0": 0.003928941946763259, "get_duckie_state": 1.4236340155968298e-06, "in-drivable-lane": 30.04999999999949, "deviation-heading": 9.092000191466145, "agent_compute-ego0": 0.012919935125571031, "complete-iteration": 0.22006566066008348, "set_robot_commands": 0.002402436503997216, "deviation-center-line": 1.8337969279454425, "driven_lanedir_consec": 3.2600551421272392, "sim_compute_sim_state": 0.00652811756500831, "sim_compute_performance-ego0": 0.002132463913697463}}
set_robot_commands_max0.002499064620660276
set_robot_commands_mean0.0024467467236992586
set_robot_commands_median0.0024427428850697713
set_robot_commands_min0.002402436503997216
sim_compute_performance-ego0_max0.002249486592351174
sim_compute_performance-ego0_mean0.002203509552235755
sim_compute_performance-ego0_median0.0022160438514471923
sim_compute_performance-ego0_min0.002132463913697463
sim_compute_sim_state_max0.010995422090802872
sim_compute_sim_state_mean0.00922785578661281
sim_compute_sim_state_median0.009693941745320027
sim_compute_sim_state_min0.00652811756500831
sim_render-ego0_max0.004145180650532539
sim_render-ego0_mean0.004053440388814465
sim_render-ego0_median0.004069819478981031
sim_render-ego0_min0.003928941946763259
simulation-passed1
step_physics_max0.24604674261443468
step_physics_mean0.1872622483857217
step_physics_median0.17398907257975738
step_physics_min0.15502410576893733
survival_time_max59.99999999999873
survival_time_mean31.724999999999483
survival_time_min4.849999999999991
No reset possible
5392211709Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:03:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible