Duckietown Challenges Home Challenges Submissions

Evaluator 4884

ID4884
evaluatornogpu-prod-04
ownerI don't have one 😀
machinenogpu-prod_544653df24e5
processnogpu-prod-04_544653df24e5
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success19 53953
# timeout1 57559
# failed2 54869
# error
# aborted2 57251
# host-error32 53919
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5755910895Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simtimeoutyesnogpu-prod-04----No reset possible
5750410907Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:18:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.46401597870149824
survival_time_median26.324999999999996
deviation-center-line_median0.31222190103202596
in-drivable-lane_median21.149999999999956


other stats
agent_compute-ego0_max0.013216530690427686
agent_compute-ego0_mean0.013013740483986394
agent_compute-ego0_median0.013006577439027906
agent_compute-ego0_min0.01282527636746208
complete-iteration_max0.2663536189032383
complete-iteration_mean0.2156589279019726
complete-iteration_median0.21297188551287344
complete-iteration_min0.17033832167890528
deviation-center-line_max0.8100744117097856
deviation-center-line_mean0.3831657066891606
deviation-center-line_min0.09814461298280504
deviation-heading_max5.490278862493698
deviation-heading_mean2.293261487112065
deviation-heading_median1.49698608782353
deviation-heading_min0.6887949103075026
driven_any_max8.956131438107757
driven_any_mean4.17482739666687
driven_any_median3.734624335313724
driven_any_min0.2739294779322746
driven_lanedir_consec_max1.3739312146658191
driven_lanedir_consec_mean0.6064173608052668
driven_lanedir_consec_min0.1237062711522512
driven_lanedir_max1.3739312146658191
driven_lanedir_mean0.674863356364966
driven_lanedir_median0.6009079698208968
driven_lanedir_min0.1237062711522512
get_duckie_state_max1.434419975906122e-06
get_duckie_state_mean1.3055336852283363e-06
get_duckie_state_median1.2668251266354238e-06
get_duckie_state_min1.2540645117363775e-06
get_robot_state_max0.004032525859895299
get_robot_state_mean0.003809664945263996
get_robot_state_median0.003770425541489823
get_robot_state_min0.0036652828381810378
get_state_dump_max0.0050670592511286505
get_state_dump_mean0.004854764861465723
get_state_dump_median0.0048147971688033715
get_state_dump_min0.004722405857127496
get_ui_image_max0.03782664361547251
get_ui_image_mean0.03156644765859705
get_ui_image_median0.030544682882172942
get_ui_image_min0.027349781254569792
in-drivable-lane_max52.499999999998735
in-drivable-lane_mean24.04999999999966
in-drivable-lane_min1.3999999999999966
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.783350706026735, "get_ui_image": 0.02818767688764992, "step_physics": 0.10462601606596247, "survival_time": 13.80000000000006, "driven_lanedir": 0.12725461736252974, "get_state_dump": 0.004722405857127496, "get_robot_state": 0.0036652828381810378, "sim_render-ego0": 0.003953391464178313, "get_duckie_state": 1.2540645117363775e-06, "in-drivable-lane": 12.40000000000006, "deviation-heading": 0.6887949103075026, "agent_compute-ego0": 0.01295323922746018, "complete-iteration": 0.17033832167890528, "set_robot_commands": 0.002215103982588014, "deviation-center-line": 0.1549119946135065, "driven_lanedir_consec": 0.12725461736252974, "sim_compute_sim_state": 0.007991172776755873, "sim_compute_performance-ego0": 0.0019413865430260393}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2739294779322746, "get_ui_image": 0.03782664361547251, "step_physics": 0.1872721851849165, "survival_time": 2.9999999999999973, "driven_lanedir": 0.1237062711522512, "get_state_dump": 0.0050670592511286505, "get_robot_state": 0.004032525859895299, "sim_render-ego0": 0.004285988260488041, "get_duckie_state": 1.434419975906122e-06, "in-drivable-lane": 1.3999999999999966, "deviation-heading": 1.1274540250869305, "agent_compute-ego0": 0.013216530690427686, "complete-iteration": 0.2663536189032383, "set_robot_commands": 0.002416567724259173, "deviation-center-line": 0.09814461298280504, "driven_lanedir_consec": 0.1237062711522512, "sim_compute_sim_state": 0.009951063844024156, "sim_compute_performance-ego0": 0.002194209176985944}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.956131438107757, "get_ui_image": 0.03290168887669597, "step_physics": 0.16723189584222264, "survival_time": 59.99999999999873, "driven_lanedir": 1.3739312146658191, "get_state_dump": 0.004733060817734387, "get_robot_state": 0.0037428336179226663, "sim_render-ego0": 0.003997351307356785, "get_duckie_state": 1.2615737470361612e-06, "in-drivable-lane": 52.499999999998735, "deviation-heading": 1.8665181505601296, "agent_compute-ego0": 0.013059915650595636, "complete-iteration": 0.2419551594072734, "set_robot_commands": 0.0022550326005108252, "deviation-center-line": 0.46953180745054546, "driven_lanedir_consec": 1.3739312146658191, "sim_compute_sim_state": 0.0118970970230039, "sim_compute_performance-ego0": 0.002049983093680986}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.685897964600713, "get_ui_image": 0.027349781254569792, "step_physics": 0.12105137737980232, "survival_time": 38.84999999999993, "driven_lanedir": 1.0745613222792638, "get_state_dump": 0.004896533519872357, "get_robot_state": 0.0037980174650569807, "sim_render-ego0": 0.003952273366383844, "get_duckie_state": 1.2720765062346863e-06, "in-drivable-lane": 29.899999999999853, "deviation-heading": 5.490278862493698, "agent_compute-ego0": 0.01282527636746208, "complete-iteration": 0.18398861161847344, "set_robot_commands": 0.0022826482826762457, "deviation-center-line": 0.8100744117097856, "driven_lanedir_consec": 0.8007773400404667, "sim_compute_sim_state": 0.005717044624387452, "sim_compute_performance-ego0": 0.0020281824170776995}}
set_robot_commands_max0.002416567724259173
set_robot_commands_mean0.0022923381475085645
set_robot_commands_median0.002268840441593535
set_robot_commands_min0.002215103982588014
sim_compute_performance-ego0_max0.002194209176985944
sim_compute_performance-ego0_mean0.0020534403076926675
sim_compute_performance-ego0_median0.002039082755379342
sim_compute_performance-ego0_min0.0019413865430260393
sim_compute_sim_state_max0.0118970970230039
sim_compute_sim_state_mean0.008889094567042845
sim_compute_sim_state_median0.008971118310390016
sim_compute_sim_state_min0.005717044624387452
sim_render-ego0_max0.004285988260488041
sim_render-ego0_mean0.004047251099601745
sim_render-ego0_median0.003975371385767548
sim_render-ego0_min0.003952273366383844
simulation-passed1
step_physics_max0.1872721851849165
step_physics_mean0.14504536861822598
step_physics_median0.14414163661101248
step_physics_min0.10462601606596247
survival_time_max59.99999999999873
survival_time_mean28.91249999999968
survival_time_min2.9999999999999973
No reset possible
5749811010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-040:01:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5728110974Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:46:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013738318545732969
agent_compute-ego0_mean0.012648918199896516
agent_compute-ego0_median0.012805781098428514
agent_compute-ego0_min0.011245792056996062
complete-iteration_max0.3379433520330577
complete-iteration_mean0.28681215591772113
complete-iteration_median0.28535875779802256
complete-iteration_min0.2385877560417817
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.5097196453516929e-06
get_duckie_state_mean1.437112155504568e-06
get_duckie_state_median1.4598919489699338e-06
get_duckie_state_min1.3189450787267122e-06
get_robot_state_max0.003932549296370355
get_robot_state_mean0.003736379690511737
get_robot_state_median0.0037395861821805905
get_robot_state_min0.003533797101315412
get_state_dump_max0.004914933894694993
get_state_dump_mean0.0047388783998036765
get_state_dump_median0.004747045625754936
get_state_dump_min0.004546488453009841
get_ui_image_max0.034472530628620435
get_ui_image_mean0.029866828062849973
get_ui_image_median0.02945756564827188
get_ui_image_min0.026079650326235704
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.026079650326235704, "step_physics": 0.18971239438561177, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004546488453009841, "get_robot_state": 0.003533797101315412, "sim_render-ego0": 0.0037561217315191034, "get_duckie_state": 1.3189450787267122e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.011245792056996062, "complete-iteration": 0.25080975922418575, "set_robot_commands": 0.002125792261166537, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007825121494455203, "sim_compute_performance-ego0": 0.001898928744707576}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.034472530628620435, "step_physics": 0.2616130604930563, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004643445606533435, "get_robot_state": 0.003681694041878655, "sim_render-ego0": 0.003958818815232912, "get_duckie_state": 1.5097196453516929e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013738318545732969, "complete-iteration": 0.3379433520330577, "set_robot_commands": 0.0022726813323491815, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.0114103068320777, "sim_compute_performance-ego0": 0.0020553144586771157}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.032682909556570695, "step_physics": 0.2481532863137327, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004850645644976436, "get_robot_state": 0.003932549296370355, "sim_render-ego0": 0.004033161936751214, "get_duckie_state": 1.4757732864621278e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012650044931162409, "complete-iteration": 0.3199077563718594, "set_robot_commands": 0.0022927241758144866, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009075598752468848, "sim_compute_performance-ego0": 0.00214027127655817}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02623222173997306, "step_physics": 0.17612362999800937, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004914933894694993, "get_robot_state": 0.003797478322482526, "sim_render-ego0": 0.0040137495823843496, "get_duckie_state": 1.4440106114777398e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.012961517265694625, "complete-iteration": 0.2385877560417817, "set_robot_commands": 0.0022556265625330333, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0061288251170111534, "sim_compute_performance-ego0": 0.002070298302084282}}
set_robot_commands_max0.0022927241758144866
set_robot_commands_mean0.0022367060829658093
set_robot_commands_median0.002264153947441107
set_robot_commands_min0.002125792261166537
sim_compute_performance-ego0_max0.00214027127655817
sim_compute_performance-ego0_mean0.0020412031955067862
sim_compute_performance-ego0_median0.0020628063803806987
sim_compute_performance-ego0_min0.001898928744707576
sim_compute_sim_state_max0.0114103068320777
sim_compute_sim_state_mean0.008609963049003227
sim_compute_sim_state_median0.008450360123462026
sim_compute_sim_state_min0.0061288251170111534
sim_render-ego0_max0.004033161936751214
sim_render-ego0_mean0.003940463016471895
sim_render-ego0_median0.003986284198808631
sim_render-ego0_min0.0037561217315191034
simulation-passed1
step_physics_max0.2616130604930563
step_physics_mean0.21890059279760257
step_physics_median0.21893284034967225
step_physics_min0.17612362999800937
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5725111012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-040:02:25
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5715411006Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:26:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.857763077199723
survival_time_median55.52499999999898
deviation-center-line_median0.5355572710055535
in-drivable-lane_median20.124999999999595


other stats
agent_compute-ego0_max0.013978863415652758
agent_compute-ego0_mean0.012937438696915576
agent_compute-ego0_median0.012641907433089766
agent_compute-ego0_min0.012487076505830016
complete-iteration_max0.23275496386274508
complete-iteration_mean0.1844086353110908
complete-iteration_median0.17395365938427315
complete-iteration_min0.15697225861307187
deviation-center-line_max3.5353161315669768
deviation-center-line_mean1.1880693961423403
deviation-center-line_min0.14584691099127772
deviation-heading_max11.616875491001563
deviation-heading_mean4.370463238458996
deviation-heading_median2.0570656654478334
deviation-heading_min1.750846131938751
driven_any_max8.591727955437616
driven_any_mean5.672397153697949
driven_any_median6.910221988997872
driven_any_min0.2774166813584346
driven_lanedir_consec_max7.517339287583782
driven_lanedir_consec_mean2.8321619605884827
driven_lanedir_consec_min0.09578240037070174
driven_lanedir_max7.517339287583782
driven_lanedir_mean2.8321619605884827
driven_lanedir_median1.857763077199723
driven_lanedir_min0.09578240037070174
get_duckie_state_max1.6689300537109375e-06
get_duckie_state_mean1.4297568876986265e-06
get_duckie_state_median1.3627969751172942e-06
get_duckie_state_min1.32450354684898e-06
get_robot_state_max0.003815707395221389
get_robot_state_mean0.003722364940676863
get_robot_state_median0.003731508834673702
get_robot_state_min0.00361073469813866
get_state_dump_max0.0048049163445101324
get_state_dump_mean0.004709137485212075
get_state_dump_median0.00469488012110823
get_state_dump_min0.004641873354121708
get_ui_image_max0.03556556943096692
get_ui_image_mean0.030694515652165175
get_ui_image_median0.030373038150904252
get_ui_image_min0.02646641687588529
in-drivable-lane_max47.09999999999868
in-drivable-lane_mean21.83749999999947
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.591727955437616, "get_ui_image": 0.02830399740347755, "step_physics": 0.0923990452914909, "survival_time": 59.99999999999873, "driven_lanedir": 1.9940691687777663, "get_state_dump": 0.004641873354121708, "get_robot_state": 0.0036985044376141424, "sim_render-ego0": 0.003952094259905279, "get_duckie_state": 1.3419730180903934e-06, "in-drivable-lane": 47.09999999999868, "deviation-heading": 1.750846131938751, "agent_compute-ego0": 0.012699059503064564, "complete-iteration": 0.15903407231060096, "set_robot_commands": 0.002204254009046722, "deviation-center-line": 0.4897529899953101, "driven_lanedir_consec": 1.9940691687777663, "sim_compute_sim_state": 0.009047116367743474, "sim_compute_performance-ego0": 0.002005307303181695}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2774166813584346, "get_ui_image": 0.03556556943096692, "step_physics": 0.15847318383711803, "survival_time": 3.899999999999994, "driven_lanedir": 0.09578240037070174, "get_state_dump": 0.004672814019118683, "get_robot_state": 0.00361073469813866, "sim_render-ego0": 0.0038752767104136793, "get_duckie_state": 1.6689300537109375e-06, "in-drivable-lane": 1.649999999999994, "deviation-heading": 1.8660882364073728, "agent_compute-ego0": 0.012487076505830016, "complete-iteration": 0.23275496386274508, "set_robot_commands": 0.0021799033201193507, "deviation-center-line": 0.14584691099127772, "driven_lanedir_consec": 0.09578240037070174, "sim_compute_sim_state": 0.009865845306010186, "sim_compute_performance-ego0": 0.0019395502307746984}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.118453480034493, "get_ui_image": 0.03244207889833096, "step_physics": 0.11370376831398084, "survival_time": 51.04999999999924, "driven_lanedir": 1.7214569856216793, "get_state_dump": 0.0048049163445101324, "get_robot_state": 0.003815707395221389, "sim_render-ego0": 0.004107829642622438, "get_duckie_state": 1.383620932144195e-06, "in-drivable-lane": 38.5999999999992, "deviation-heading": 2.248043094488294, "agent_compute-ego0": 0.013978863415652758, "complete-iteration": 0.18887324645794537, "set_robot_commands": 0.0023246910240785484, "deviation-center-line": 0.5813615520157969, "driven_lanedir_consec": 1.7214569856216793, "sim_compute_sim_state": 0.011495161196490324, "sim_compute_performance-ego0": 0.0021067283858058504}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.70199049796125, "get_ui_image": 0.02646641687588529, "step_physics": 0.09469509601195984, "survival_time": 59.99999999999873, "driven_lanedir": 7.517339287583782, "get_state_dump": 0.004716946223097777, "get_robot_state": 0.00376451323173326, "sim_render-ego0": 0.003945407422754191, "get_duckie_state": 1.32450354684898e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.616875491001563, "agent_compute-ego0": 0.012584755363114966, "complete-iteration": 0.15697225861307187, "set_robot_commands": 0.002261822467838894, "deviation-center-line": 3.5353161315669768, "driven_lanedir_consec": 7.517339287583782, "sim_compute_sim_state": 0.00641789702352735, "sim_compute_performance-ego0": 0.002033760902982866}}
set_robot_commands_max0.0023246910240785484
set_robot_commands_mean0.0022426677052708784
set_robot_commands_median0.0022330382384428077
set_robot_commands_min0.0021799033201193507
sim_compute_performance-ego0_max0.0021067283858058504
sim_compute_performance-ego0_mean0.0020213367056862775
sim_compute_performance-ego0_median0.0020195341030822805
sim_compute_performance-ego0_min0.0019395502307746984
sim_compute_sim_state_max0.011495161196490324
sim_compute_sim_state_mean0.009206504973442834
sim_compute_sim_state_median0.00945648083687683
sim_compute_sim_state_min0.00641789702352735
sim_render-ego0_max0.004107829642622438
sim_render-ego0_mean0.0039701520089238974
sim_render-ego0_median0.003948750841329735
sim_render-ego0_min0.0038752767104136793
simulation-passed1
step_physics_max0.15847318383711803
step_physics_mean0.1148177733636374
step_physics_median0.10419943216297034
step_physics_min0.0923990452914909
survival_time_max59.99999999999873
survival_time_mean43.73749999999917
survival_time_min3.899999999999994
No reset possible
5713911313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-040:02:27
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5697511050Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:29:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.6079141677766486
survival_time_median48.599999999999376
deviation-center-line_median1.0480568495468807
in-drivable-lane_median11.424999999999429


other stats
agent_compute-ego0_max0.04124734597870066
agent_compute-ego0_mean0.0355133575183948
agent_compute-ego0_median0.037244073616000906
agent_compute-ego0_min0.026317936862876753
complete-iteration_max0.22749870246296425
complete-iteration_mean0.20127972964389831
complete-iteration_median0.19413994516736527
complete-iteration_min0.18934032577789855
deviation-center-line_max2.535731363362248
deviation-center-line_mean1.282647255899307
deviation-center-line_min0.4987439611412188
deviation-heading_max16.081712740785804
deviation-heading_mean8.03209475822269
deviation-heading_median6.360320259031398
deviation-heading_min3.32602577404216
driven_any_max7.403107793373319
driven_any_mean5.972180197975024
driven_any_median5.996920828118591
driven_any_min4.491771342289592
driven_lanedir_consec_max4.7319311428630835
driven_lanedir_consec_mean3.4272235129297877
driven_lanedir_consec_min1.761134573302771
driven_lanedir_max6.354678878432403
driven_lanedir_mean3.945947477358138
driven_lanedir_median3.811803181670759
driven_lanedir_min1.8055046676586284
get_duckie_state_max1.4186004714902294e-06
get_duckie_state_mean1.329720099905194e-06
get_duckie_state_median1.3404764231161871e-06
get_duckie_state_min1.2193270818981713e-06
get_robot_state_max0.003697277982925933
get_robot_state_mean0.0035828234033938467
get_robot_state_median0.003590449028729931
get_robot_state_min0.003453117573189592
get_state_dump_max0.004743833079116757
get_state_dump_mean0.0046739477616816434
get_state_dump_median0.0046918947518779725
get_state_dump_min0.004568168463853873
get_ui_image_max0.035793537104953636
get_ui_image_mean0.03053775201932104
get_ui_image_median0.029757293214018828
get_ui_image_min0.02684288454429288
in-drivable-lane_max32.79999999999937
in-drivable-lane_mean15.012499999999497
in-drivable-lane_min4.39999999999975
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.962223138971315, "get_ui_image": 0.0284288138276917, "step_physics": 0.09814626456312991, "survival_time": 47.34999999999945, "driven_lanedir": 3.9517822515407257, "get_state_dump": 0.004743833079116757, "get_robot_state": 0.003616418013592813, "sim_render-ego0": 0.003878524786309351, "get_duckie_state": 1.3133141561902526e-06, "in-drivable-lane": 16.89999999999915, "deviation-heading": 3.32602577404216, "agent_compute-ego0": 0.04124734597870066, "complete-iteration": 0.1951818659838745, "set_robot_commands": 0.002223579189445399, "deviation-center-line": 0.7918652320371933, "driven_lanedir_consec": 3.9517822515407257, "sim_compute_sim_state": 0.010812353735734642, "sim_compute_performance-ego0": 0.0019992964680184797}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.403107793373319, "get_ui_image": 0.035793537104953636, "step_physics": 0.12961833185200689, "survival_time": 59.99999999999873, "driven_lanedir": 6.354678878432403, "get_state_dump": 0.004568168463853873, "get_robot_state": 0.0035644800438670494, "sim_render-ego0": 0.003792297234642416, "get_duckie_state": 1.4186004714902294e-06, "in-drivable-lane": 4.39999999999975, "deviation-heading": 16.081712740785804, "agent_compute-ego0": 0.034852616892170646, "complete-iteration": 0.22749870246296425, "set_robot_commands": 0.0021776430414280823, "deviation-center-line": 2.535731363362248, "driven_lanedir_consec": 4.7319311428630835, "sim_compute_sim_state": 0.011114216366973548, "sim_compute_performance-ego0": 0.001932608694160709}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.0316185172658665, "get_ui_image": 0.031085772600345955, "step_physics": 0.10625158856531422, "survival_time": 49.849999999999305, "driven_lanedir": 1.8055046676586284, "get_state_dump": 0.004697453521774384, "get_robot_state": 0.003453117573189592, "sim_render-ego0": 0.003786187850401731, "get_duckie_state": 1.2193270818981713e-06, "in-drivable-lane": 32.79999999999937, "deviation-heading": 5.564762170682116, "agent_compute-ego0": 0.026317936862876753, "complete-iteration": 0.18934032577789855, "set_robot_commands": 0.002020082158411672, "deviation-center-line": 0.4987439611412188, "driven_lanedir_consec": 1.761134573302771, "sim_compute_sim_state": 0.00975126087785006, "sim_compute_performance-ego0": 0.001898695806224265}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.491771342289592, "get_ui_image": 0.02684288454429288, "step_physics": 0.10363834053667034, "survival_time": 38.249999999999964, "driven_lanedir": 3.6718241118007926, "get_state_dump": 0.004686335981981561, "get_robot_state": 0.003697277982925933, "sim_render-ego0": 0.0039032445563971217, "get_duckie_state": 1.3676386900421223e-06, "in-drivable-lane": 5.94999999999971, "deviation-heading": 7.155878347380679, "agent_compute-ego0": 0.03963553033983116, "complete-iteration": 0.19309802435085605, "set_robot_commands": 0.002215383880754675, "deviation-center-line": 1.304248467056568, "driven_lanedir_consec": 3.264046084012571, "sim_compute_sim_state": 0.0064424718328929135, "sim_compute_performance-ego0": 0.0019499380968258213}}
set_robot_commands_max0.002223579189445399
set_robot_commands_mean0.002159172067509957
set_robot_commands_median0.0021965134610913784
set_robot_commands_min0.002020082158411672
sim_compute_performance-ego0_max0.0019992964680184797
sim_compute_performance-ego0_mean0.0019451347663073189
sim_compute_performance-ego0_median0.0019412733954932652
sim_compute_performance-ego0_min0.001898695806224265
sim_compute_sim_state_max0.011114216366973548
sim_compute_sim_state_mean0.00953007570336279
sim_compute_sim_state_median0.010281807306792352
sim_compute_sim_state_min0.0064424718328929135
sim_render-ego0_max0.0039032445563971217
sim_render-ego0_mean0.003840063606937655
sim_render-ego0_median0.003835411010475883
sim_render-ego0_min0.003786187850401731
simulation-passed1
step_physics_max0.12961833185200689
step_physics_mean0.10941363137928034
step_physics_median0.10494496455099228
step_physics_min0.09814626456312991
survival_time_max59.99999999999873
survival_time_mean48.862499999999365
survival_time_min38.249999999999964
No reset possible
5695811312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-040:01:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5694311278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:56
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5693411278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:01:20
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5691111281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:15
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5689811284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:10
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5688911284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:01:46
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5686511286Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:03:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5686011286Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5684711425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-040:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5683111427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-040:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5680911287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5678411285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:02
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5674011289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:16
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5671911283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:01:29
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5669211290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:33
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5667611296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5581311422Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFVI_multi-sim-validationLFVIv-simsuccessyesnogpu-prod-041:20:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.982100312006373
survival_time_median59.99999999999873
deviation-center-line_median4.416433388905102
in-drivable-lane_median0.07499999999999973


other stats
agent_compute-ego0_max0.040627359252091155
agent_compute-ego0_mean0.0405213539050481
agent_compute-ego0_median0.0405213539050481
agent_compute-ego0_min0.04041534855800505
agent_compute-ego1_max0.04034977888286759
agent_compute-ego1_mean0.040028717396757584
agent_compute-ego1_median0.040028717396757584
agent_compute-ego1_min0.03970765591064758
agent_compute-ego2_max0.04027102491837755
agent_compute-ego2_mean0.03975178409277847
agent_compute-ego2_median0.03975178409277847
agent_compute-ego2_min0.03923254326717939
agent_compute-ego3_max0.04101410257528466
agent_compute-ego3_mean0.04000050658290333
agent_compute-ego3_median0.04000050658290333
agent_compute-ego3_min0.038986910590522
complete-iteration_max1.0863832905330228
complete-iteration_mean1.0555721019130266
complete-iteration_median1.0555721019130266
complete-iteration_min1.0247609132930302
deviation-center-line_max6.993703781443878
deviation-center-line_mean4.549008093224059
deviation-center-line_min2.7547936419560757
deviation-heading_max42.18086494270505
deviation-heading_mean23.382515698011055
deviation-heading_median20.824989043063063
deviation-heading_min10.227436318070511
driven_any_max14.590298622055846
driven_any_mean7.967358633328365
driven_any_median8.415174702140996
driven_any_min0.4793285042172145
driven_lanedir_consec_max14.286955591091672
driven_lanedir_consec_mean7.642102407896726
driven_lanedir_consec_min0.4628754568232531
driven_lanedir_max14.286955591091672
driven_lanedir_mean7.708069044375746
driven_lanedir_median7.982127316139571
driven_lanedir_min0.4628754568232531
get_duckie_state_max1.240332458140352e-06
get_duckie_state_mean1.2356673152520198e-06
get_duckie_state_median1.2356673152520198e-06
get_duckie_state_min1.2310021723636878e-06
get_robot_state_max0.013831173549782326
get_robot_state_mean0.013682959677277754
get_robot_state_median0.013682959677277754
get_robot_state_min0.013534745804773185
get_state_dump_max0.00904176078370767
get_state_dump_mean0.009028148194534591
get_state_dump_median0.009028148194534591
get_state_dump_min0.009014535605361518
get_ui_image_max0.04833416101041185
get_ui_image_mean0.04715031261348804
get_ui_image_median0.04715031261348804
get_ui_image_min0.045966464216564216
in-drivable-lane_max0.8999999999999968
in-drivable-lane_mean0.2687499999999944
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 14.590274250259988, "get_ui_image": 0.04833416101041185, "step_physics": 0.8012010201526423, "survival_time": 59.99999999999873, "driven_lanedir": 14.285870115338705, "get_state_dump": 0.009014535605361518, "get_robot_state": 0.013831173549782326, "sim_render-ego0": 0.003765170719105437, "sim_render-ego1": 0.003726561798044883, "sim_render-ego2": 0.0036411487887443657, "sim_render-ego3": 0.0036476823709886536, "get_duckie_state": 1.240332458140352e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.65141140471916, "agent_compute-ego0": 0.04041534855800505, "agent_compute-ego1": 0.03970765591064758, "agent_compute-ego2": 0.03923254326717939, "agent_compute-ego3": 0.038986910590522, "complete-iteration": 1.0863832905330228, "set_robot_commands": 0.0023630735379869395, "deviation-center-line": 2.869488261734872, "driven_lanedir_consec": 14.285870115338705, "sim_compute_sim_state": 0.0242200501256938, "sim_compute_performance-ego0": 0.001971058206296186, "sim_compute_performance-ego1": 0.0018927068337115716, "sim_compute_performance-ego2": 0.0018687043757760256, "sim_compute_performance-ego3": 0.0018376190398356796}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 2.2400890986044524, "get_ui_image": 0.04833416101041185, "step_physics": 0.8012010201526423, "survival_time": 59.99999999999873, "driven_lanedir": 1.900791696912732, "get_state_dump": 0.009014535605361518, "get_robot_state": 0.013831173549782326, "sim_render-ego0": 0.003765170719105437, "sim_render-ego1": 0.003726561798044883, "sim_render-ego2": 0.0036411487887443657, "sim_render-ego3": 0.0036476823709886536, "get_duckie_state": 1.240332458140352e-06, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 38.71500900662983, "agent_compute-ego0": 0.04041534855800505, "agent_compute-ego1": 0.03970765591064758, "agent_compute-ego2": 0.03923254326717939, "agent_compute-ego3": 0.038986910590522, "complete-iteration": 1.0863832905330228, "set_robot_commands": 0.0023630735379869395, "deviation-center-line": 6.000862773390881, "driven_lanedir_consec": 1.900791696912732, "sim_compute_sim_state": 0.0242200501256938, "sim_compute_performance-ego0": 0.001971058206296186, "sim_compute_performance-ego1": 0.0018927068337115716, "sim_compute_performance-ego2": 0.0018687043757760256, "sim_compute_performance-ego3": 0.0018376190398356796}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 14.59026030567754, "get_ui_image": 0.04833416101041185, "step_physics": 0.8012010201526423, "survival_time": 59.99999999999873, "driven_lanedir": 14.286955591091672, "get_state_dump": 0.009014535605361518, "get_robot_state": 0.013831173549782326, "sim_render-ego0": 0.003765170719105437, "sim_render-ego1": 0.003726561798044883, "sim_render-ego2": 0.0036411487887443657, "sim_render-ego3": 0.0036476823709886536, "get_duckie_state": 1.240332458140352e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.77473756366386, "agent_compute-ego0": 0.04041534855800505, "agent_compute-ego1": 0.03970765591064758, "agent_compute-ego2": 0.03923254326717939, "agent_compute-ego3": 0.038986910590522, "complete-iteration": 1.0863832905330228, "set_robot_commands": 0.0023630735379869395, "deviation-center-line": 2.7783831944119246, "driven_lanedir_consec": 14.286955591091672, "sim_compute_sim_state": 0.0242200501256938, "sim_compute_performance-ego0": 0.001971058206296186, "sim_compute_performance-ego1": 0.0018927068337115716, "sim_compute_performance-ego2": 0.0018687043757760256, "sim_compute_performance-ego3": 0.0018376190398356796}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 0.9929039380973048, "get_ui_image": 0.04833416101041185, "step_physics": 0.8012010201526423, "survival_time": 59.99999999999873, "driven_lanedir": 0.8491677542940025, "get_state_dump": 0.009014535605361518, "get_robot_state": 0.013831173549782326, "sim_render-ego0": 0.003765170719105437, "sim_render-ego1": 0.003726561798044883, "sim_render-ego2": 0.0036411487887443657, "sim_render-ego3": 0.0036476823709886536, "get_duckie_state": 1.240332458140352e-06, "in-drivable-lane": 0.14999999999999947, "deviation-heading": 42.18086494270505, "agent_compute-ego0": 0.04041534855800505, "agent_compute-ego1": 0.03970765591064758, "agent_compute-ego2": 0.03923254326717939, "agent_compute-ego3": 0.038986910590522, "complete-iteration": 1.0863832905330228, "set_robot_commands": 0.0023630735379869395, "deviation-center-line": 6.993703781443878, "driven_lanedir_consec": 0.6900128436534608, "sim_compute_sim_state": 0.0242200501256938, "sim_compute_performance-ego0": 0.001971058206296186, "sim_compute_performance-ego1": 0.0018927068337115716, "sim_compute_performance-ego2": 0.0018687043757760256, "sim_compute_performance-ego3": 0.0018376190398356796}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 14.590298622055846, "get_ui_image": 0.045966464216564216, "step_physics": 0.7400444663633018, "survival_time": 59.99999999999873, "driven_lanedir": 14.197477618061928, "get_state_dump": 0.00904176078370767, "get_robot_state": 0.013534745804773185, "sim_render-ego0": 0.003730573820928848, "sim_render-ego1": 0.0037336448745664014, "sim_render-ego2": 0.003631875874299392, "sim_render-ego3": 0.003642914197923341, "get_duckie_state": 1.2310021723636878e-06, "in-drivable-lane": 0.3499999999999801, "deviation-heading": 10.227436318070511, "agent_compute-ego0": 0.040627359252091155, "agent_compute-ego1": 0.04034977888286759, "agent_compute-ego2": 0.04027102491837755, "agent_compute-ego3": 0.04101410257528466, "complete-iteration": 1.0247609132930302, "set_robot_commands": 0.0022827665772068807, "deviation-center-line": 2.7547936419560757, "driven_lanedir_consec": 14.197453553420626, "sim_compute_sim_state": 0.022601126433411407, "sim_compute_performance-ego0": 0.001980852227127622, "sim_compute_performance-ego1": 0.0018457060154034237, "sim_compute_performance-ego2": 0.0018712981952219384, "sim_compute_performance-ego3": 0.0018575755285283708}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 14.590285873013205, "get_ui_image": 0.045966464216564216, "step_physics": 0.7400444663633018, "survival_time": 59.99999999999873, "driven_lanedir": 14.06346293536641, "get_state_dump": 0.00904176078370767, "get_robot_state": 0.013534745804773185, "sim_render-ego0": 0.003730573820928848, "sim_render-ego1": 0.0037336448745664014, "sim_render-ego2": 0.003631875874299392, "sim_render-ego3": 0.003642914197923341, "get_duckie_state": 1.2310021723636878e-06, "in-drivable-lane": 0.7499999999999787, "deviation-heading": 10.772165851951048, "agent_compute-ego0": 0.040627359252091155, "agent_compute-ego1": 0.04034977888286759, "agent_compute-ego2": 0.04027102491837755, "agent_compute-ego3": 0.04101410257528466, "complete-iteration": 1.0247609132930302, "set_robot_commands": 0.0022827665772068807, "deviation-center-line": 3.004721468129042, "driven_lanedir_consec": 14.063408927100014, "sim_compute_sim_state": 0.022601126433411407, "sim_compute_performance-ego0": 0.001980852227127622, "sim_compute_performance-ego1": 0.0018457060154034237, "sim_compute_performance-ego2": 0.0018712981952219384, "sim_compute_performance-ego3": 0.0018575755285283708}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.4793285042172145, "get_ui_image": 0.045966464216564216, "step_physics": 0.7400444663633018, "survival_time": 59.99999999999873, "driven_lanedir": 0.4628754568232531, "get_state_dump": 0.00904176078370767, "get_robot_state": 0.013534745804773185, "sim_render-ego0": 0.003730573820928848, "sim_render-ego1": 0.0037336448745664014, "sim_render-ego2": 0.003631875874299392, "sim_render-ego3": 0.003642914197923341, "get_duckie_state": 1.2310021723636878e-06, "in-drivable-lane": 0.0, "deviation-heading": 32.863259973886734, "agent_compute-ego0": 0.040627359252091155, "agent_compute-ego1": 0.04034977888286759, "agent_compute-ego2": 0.04027102491837755, "agent_compute-ego3": 0.04101410257528466, "complete-iteration": 1.0247609132930302, "set_robot_commands": 0.0022827665772068807, "deviation-center-line": 6.161966315044638, "driven_lanedir_consec": 0.4628754568232531, "sim_compute_sim_state": 0.022601126433411407, "sim_compute_performance-ego0": 0.001980852227127622, "sim_compute_performance-ego1": 0.0018457060154034237, "sim_compute_performance-ego2": 0.0018712981952219384, "sim_compute_performance-ego3": 0.0018575755285283708}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.6654284747013746, "get_ui_image": 0.045966464216564216, "step_physics": 0.7400444663633018, "survival_time": 59.99999999999873, "driven_lanedir": 1.6179511871172645, "get_state_dump": 0.00904176078370767, "get_robot_state": 0.013534745804773185, "sim_render-ego0": 0.003730573820928848, "sim_render-ego1": 0.0037336448745664014, "sim_render-ego2": 0.003631875874299392, "sim_render-ego3": 0.003642914197923341, "get_duckie_state": 1.2310021723636878e-06, "in-drivable-lane": 0.0, "deviation-heading": 30.87524052246227, "agent_compute-ego0": 0.040627359252091155, "agent_compute-ego1": 0.04034977888286759, "agent_compute-ego2": 0.04027102491837755, "agent_compute-ego3": 0.04101410257528466, "complete-iteration": 1.0247609132930302, "set_robot_commands": 0.0022827665772068807, "deviation-center-line": 5.828145309681163, "driven_lanedir_consec": 1.2494510788333448, "sim_compute_sim_state": 0.022601126433411407, "sim_compute_performance-ego0": 0.001980852227127622, "sim_compute_performance-ego1": 0.0018457060154034237, "sim_compute_performance-ego2": 0.0018712981952219384, "sim_compute_performance-ego3": 0.0018575755285283708}}
set_robot_commands_max0.0023630735379869395
set_robot_commands_mean0.00232292005759691
set_robot_commands_median0.00232292005759691
set_robot_commands_min0.0022827665772068807
sim_compute_performance-ego0_max0.001980852227127622
sim_compute_performance-ego0_mean0.0019759552167119034
sim_compute_performance-ego0_median0.0019759552167119034
sim_compute_performance-ego0_min0.001971058206296186
sim_compute_performance-ego1_max0.0018927068337115716
sim_compute_performance-ego1_mean0.0018692064245574977
sim_compute_performance-ego1_median0.0018692064245574977
sim_compute_performance-ego1_min0.0018457060154034237
sim_compute_performance-ego2_max0.0018712981952219384
sim_compute_performance-ego2_mean0.001870001285498982
sim_compute_performance-ego2_median0.001870001285498982
sim_compute_performance-ego2_min0.0018687043757760256
sim_compute_performance-ego3_max0.0018575755285283708
sim_compute_performance-ego3_mean0.0018475972841820252
sim_compute_performance-ego3_median0.0018475972841820252
sim_compute_performance-ego3_min0.0018376190398356796
sim_compute_sim_state_max0.0242200501256938
sim_compute_sim_state_mean0.023410588279552603
sim_compute_sim_state_median0.023410588279552603
sim_compute_sim_state_min0.022601126433411407
sim_render-ego0_max0.003765170719105437
sim_render-ego0_mean0.0037478722700171425
sim_render-ego0_median0.0037478722700171425
sim_render-ego0_min0.003730573820928848
sim_render-ego1_max0.0037336448745664014
sim_render-ego1_mean0.0037301033363056424
sim_render-ego1_median0.0037301033363056424
sim_render-ego1_min0.003726561798044883
sim_render-ego2_max0.0036411487887443657
sim_render-ego2_mean0.0036365123315218783
sim_render-ego2_median0.0036365123315218783
sim_render-ego2_min0.003631875874299392
sim_render-ego3_max0.0036476823709886536
sim_render-ego3_mean0.0036452982844559978
sim_render-ego3_median0.0036452982844559978
sim_render-ego3_min0.003642914197923341
simulation-passed1
step_physics_max0.8012010201526423
step_physics_mean0.770622743257972
step_physics_median0.770622743257972
step_physics_min0.7400444663633018
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5576611303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:18
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5574911303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5573111310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:46
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5566111301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5562111282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5559211307Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:01:03
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5501211417Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-testingLFt-simsuccessyesnogpu-prod-040:34:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median13.95083732366199
survival_time_median59.99999999999873
deviation-center-line_median2.783630874380797
in-drivable-lane_median1.0750000000000082


other stats
agent_compute-ego0_max0.04517646832430392
agent_compute-ego0_mean0.03977851749558333
agent_compute-ego0_median0.03839733429892077
agent_compute-ego0_min0.03714293306018788
complete-iteration_max0.23125122806412493
complete-iteration_mean0.1944996082316231
complete-iteration_median0.19279561719727656
complete-iteration_min0.1611559704678144
deviation-center-line_max3.141656150136964
deviation-center-line_mean2.8213148039276796
deviation-center-line_min2.5763413168121603
deviation-heading_max16.01389255831746
deviation-heading_mean10.915284318410963
deviation-heading_median9.921295155045486
deviation-heading_min7.804654405235421
driven_any_max14.590320637943917
driven_any_mean14.590177028926131
driven_any_median14.590197084064846
driven_any_min14.58999330963091
driven_lanedir_consec_max14.376451629386544
driven_lanedir_consec_mean12.923141108896983
driven_lanedir_consec_min9.414438158877408
driven_lanedir_max14.376451629386544
driven_lanedir_mean12.967168769771243
driven_lanedir_median13.95083732366199
driven_lanedir_min9.590548802374446
get_duckie_state_max1.283807619525233e-06
get_duckie_state_mean1.0944226699308194e-06
get_duckie_state_median1.0613696362751903e-06
get_duckie_state_min9.711437876476634e-07
get_robot_state_max0.003909655355791764
get_robot_state_mean0.003476286956809343
get_robot_state_median0.00336984125005514
get_robot_state_min0.003255809971335329
get_state_dump_max0.00520093712977426
get_state_dump_mean0.004420336537515988
get_state_dump_median0.004217598757874856
get_state_dump_min0.004045211504539979
get_ui_image_max0.03277820572070932
get_ui_image_mean0.02812588780646916
get_ui_image_median0.02848223881558713
get_ui_image_min0.02276086787399305
in-drivable-lane_max16.349999999999522
in-drivable-lane_mean4.6249999999998845
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.590320637943917, "get_ui_image": 0.02587113987893288, "step_physics": 0.08711182028923702, "survival_time": 59.99999999999873, "driven_lanedir": 14.30401875520247, "get_state_dump": 0.004307482065904349, "get_robot_state": 0.003396979577336879, "sim_render-ego0": 0.003464629310652378, "get_duckie_state": 1.1158624755452812e-06, "in-drivable-lane": 0.19999999999998863, "deviation-heading": 7.804654405235421, "agent_compute-ego0": 0.03845895081138134, "complete-iteration": 0.1745883850729733, "set_robot_commands": 0.002045029108967015, "deviation-center-line": 2.5763413168121603, "driven_lanedir_consec": 14.30401875520247, "sim_compute_sim_state": 0.008075616242585829, "sim_compute_performance-ego0": 0.0017741782579890496}, "LF-norm-zigzag-000-ego0": {"driven_any": 14.58999330963091, "get_ui_image": 0.03109333775224138, "step_physics": 0.11620398822374683, "survival_time": 59.99999999999873, "driven_lanedir": 9.590548802374446, "get_state_dump": 0.004127715449845364, "get_robot_state": 0.003255809971335329, "sim_render-ego0": 0.0033677291314270375, "get_duckie_state": 9.711437876476634e-07, "in-drivable-lane": 16.349999999999522, "deviation-heading": 16.01389255831746, "agent_compute-ego0": 0.03714293306018788, "complete-iteration": 0.21100284932157976, "set_robot_commands": 0.0019454380356203407, "deviation-center-line": 3.141656150136964, "driven_lanedir_consec": 9.414438158877408, "sim_compute_sim_state": 0.01205949779354861, "sim_compute_performance-ego0": 0.0017275627606318058}, "LF-norm-techtrack-000-ego0": {"driven_any": 14.590199117300926, "get_ui_image": 0.03277820572070932, "step_physics": 0.122814184025265, "survival_time": 59.99999999999873, "driven_lanedir": 13.597655892121509, "get_state_dump": 0.00520093712977426, "get_robot_state": 0.003909655355791764, "sim_render-ego0": 0.003919042020316525, "get_duckie_state": 1.283807619525233e-06, "in-drivable-lane": 1.9500000000000275, "deviation-heading": 11.236496682774993, "agent_compute-ego0": 0.04517646832430392, "complete-iteration": 0.23125122806412493, "set_robot_commands": 0.002267983632718991, "deviation-center-line": 2.848420774328232, "driven_lanedir_consec": 13.597655892121509, "sim_compute_sim_state": 0.012964650455065115, "sim_compute_performance-ego0": 0.002124085017386126}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.590195050828765, "get_ui_image": 0.02276086787399305, "step_physics": 0.08006507808421673, "survival_time": 59.99999999999873, "driven_lanedir": 14.376451629386544, "get_state_dump": 0.004045211504539979, "get_robot_state": 0.003342702922773401, "sim_render-ego0": 0.003384417637897272, "get_duckie_state": 1.0068767970050998e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.60609362731598, "agent_compute-ego0": 0.038335717786460194, "complete-iteration": 0.1611559704678144, "set_robot_commands": 0.001925233599546053, "deviation-center-line": 2.718840974433362, "driven_lanedir_consec": 14.376451629386544, "sim_compute_sim_state": 0.005448703067090291, "sim_compute_performance-ego0": 0.0017732626988826246}}
set_robot_commands_max0.002267983632718991
set_robot_commands_mean0.0020459210942131
set_robot_commands_median0.0019952335722936776
set_robot_commands_min0.001925233599546053
sim_compute_performance-ego0_max0.002124085017386126
sim_compute_performance-ego0_mean0.0018497721837224016
sim_compute_performance-ego0_median0.001773720478435837
sim_compute_performance-ego0_min0.0017275627606318058
sim_compute_sim_state_max0.012964650455065115
sim_compute_sim_state_mean0.009637116889572462
sim_compute_sim_state_median0.01006755701806722
sim_compute_sim_state_min0.005448703067090291
sim_render-ego0_max0.003919042020316525
sim_render-ego0_mean0.003533954525073303
sim_render-ego0_median0.0034245234742748248
sim_render-ego0_min0.0033677291314270375
simulation-passed1
step_physics_max0.122814184025265
step_physics_mean0.1015487676556164
step_physics_median0.10165790425649192
step_physics_min0.08006507808421673
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5498311308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5494311311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:01:17
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5492911436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5490211332Olga (Ge Ya) Xu 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:02:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5489111450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-040:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5486911344Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:02:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5486411424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:54
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5485811424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5465011412Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:32:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.4901186827624
survival_time_median59.99999999999873
deviation-center-line_median2.966268979843775
in-drivable-lane_median6.599999999999989


other stats
agent_compute-ego0_max0.044053300632028954
agent_compute-ego0_mean0.042299663941040754
agent_compute-ego0_median0.042267996603801386
agent_compute-ego0_min0.04060936192453126
complete-iteration_max0.2396885890227098
complete-iteration_mean0.21479716830202297
complete-iteration_median0.2117627548436936
complete-iteration_min0.1959745744979947
deviation-center-line_max3.5854841634205568
deviation-center-line_mean2.733073818116665
deviation-center-line_min1.414273149358554
deviation-heading_max15.643813251081312
deviation-heading_mean11.67060193572102
deviation-heading_median11.68053701072405
deviation-heading_min7.677520470354664
driven_any_max14.590331279396567
driven_any_mean12.544963994720092
driven_any_median14.589918132447142
driven_any_min6.409688434589515
driven_lanedir_consec_max14.273203992920322
driven_lanedir_consec_mean10.389418465384686
driven_lanedir_consec_min4.3042325030936235
driven_lanedir_max14.273203992920322
driven_lanedir_mean10.389418465384686
driven_lanedir_median11.4901186827624
driven_lanedir_min4.3042325030936235
get_duckie_state_max1.397756216031725e-06
get_duckie_state_mean1.3536401474200954e-06
get_duckie_state_median1.3527014651153683e-06
get_duckie_state_min1.31140144341792e-06
get_robot_state_max0.0036657531493708654
get_robot_state_mean0.0036105155575423143
get_robot_state_median0.0036344998682865393
get_robot_state_min0.003507309344225314
get_state_dump_max0.004663297675432115
get_state_dump_mean0.004584533874365948
get_state_dump_median0.004628112274443081
get_state_dump_min0.004418613273145515
get_ui_image_max0.03368694572658329
get_ui_image_mean0.029800247031473017
get_ui_image_median0.029885073982607216
get_ui_image_min0.02574389443409433
in-drivable-lane_max12.449999999999685
in-drivable-lane_mean6.4999999999999165
in-drivable-lane_min0.350000000000005
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.590331279396567, "get_ui_image": 0.028183333383412484, "step_physics": 0.09888836942445628, "survival_time": 59.99999999999873, "driven_lanedir": 14.273203992920322, "get_state_dump": 0.0046421371828407965, "get_robot_state": 0.003636536848336632, "sim_render-ego0": 0.0037601956916192888, "get_duckie_state": 1.397756216031725e-06, "in-drivable-lane": 0.350000000000005, "deviation-heading": 7.786808909748183, "agent_compute-ego0": 0.04294816302220887, "complete-iteration": 0.1959745744979947, "set_robot_commands": 0.002228236615310402, "deviation-center-line": 2.485091425613998, "driven_lanedir_consec": 14.273203992920322, "sim_compute_sim_state": 0.009614325284362336, "sim_compute_performance-ego0": 0.0019817711610182636}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.409688434589515, "get_ui_image": 0.03368694572658329, "step_physics": 0.13892078486991016, "survival_time": 27.250000000000252, "driven_lanedir": 4.3042325030936235, "get_state_dump": 0.004418613273145515, "get_robot_state": 0.003507309344225314, "sim_render-ego0": 0.003554548536028181, "get_duckie_state": 1.3278954195015596e-06, "in-drivable-lane": 7.350000000000075, "deviation-heading": 7.677520470354664, "agent_compute-ego0": 0.04060936192453126, "complete-iteration": 0.2396885890227098, "set_robot_commands": 0.0020906501637273658, "deviation-center-line": 1.414273149358554, "driven_lanedir_consec": 4.3042325030936235, "sim_compute_sim_state": 0.010974760457272931, "sim_compute_performance-ego0": 0.0018394041410732616}, "LF-norm-techtrack-000-ego0": {"driven_any": 14.590018608670707, "get_ui_image": 0.03158681458180195, "step_physics": 0.12238110948065536, "survival_time": 59.99999999999873, "driven_lanedir": 12.283709466177864, "get_state_dump": 0.004663297675432115, "get_robot_state": 0.0036657531493708654, "sim_render-ego0": 0.0038216677831670424, "get_duckie_state": 1.31140144341792e-06, "in-drivable-lane": 5.849999999999904, "deviation-heading": 15.574265111699916, "agent_compute-ego0": 0.044053300632028954, "complete-iteration": 0.2266745595114118, "set_robot_commands": 0.0022708261936133746, "deviation-center-line": 3.447446534073552, "driven_lanedir_consec": 12.283709466177864, "sim_compute_sim_state": 0.012151432672607015, "sim_compute_performance-ego0": 0.001991088146174778}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.58981765622358, "get_ui_image": 0.02574389443409433, "step_physics": 0.10731529415298956, "survival_time": 59.99999999999873, "driven_lanedir": 10.696527899346938, "get_state_dump": 0.004614087366045365, "get_robot_state": 0.003632462888236447, "sim_render-ego0": 0.0036616005766500937, "get_duckie_state": 1.3775075107291775e-06, "in-drivable-lane": 12.449999999999685, "deviation-heading": 15.643813251081312, "agent_compute-ego0": 0.04158783018539391, "complete-iteration": 0.19685095017597537, "set_robot_commands": 0.002219706947460063, "deviation-center-line": 3.5854841634205568, "driven_lanedir_consec": 10.696527899346938, "sim_compute_sim_state": 0.0060938822041939535, "sim_compute_performance-ego0": 0.0018934758874796312}}
set_robot_commands_max0.0022708261936133746
set_robot_commands_mean0.0022023549800278017
set_robot_commands_median0.0022239717813852325
set_robot_commands_min0.0020906501637273658
sim_compute_performance-ego0_max0.001991088146174778
sim_compute_performance-ego0_mean0.0019264348339364835
sim_compute_performance-ego0_median0.0019376235242489475
sim_compute_performance-ego0_min0.0018394041410732616
sim_compute_sim_state_max0.012151432672607015
sim_compute_sim_state_mean0.00970860015460906
sim_compute_sim_state_median0.010294542870817634
sim_compute_sim_state_min0.0060938822041939535
sim_render-ego0_max0.0038216677831670424
sim_render-ego0_mean0.003699503146866151
sim_render-ego0_median0.003710898134134691
sim_render-ego0_min0.003554548536028181
simulation-passed1
step_physics_max0.13892078486991016
step_physics_mean0.11687638948200284
step_physics_median0.11484820181682248
step_physics_min0.09888836942445628
survival_time_max59.99999999999873
survival_time_mean51.812499999999105
survival_time_min27.250000000000252
No reset possible
5462411439Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:55
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5457111444Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:09:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6717269562916164
survival_time_median11.750000000000032
deviation-center-line_median0.13942557870936717
in-drivable-lane_median9.000000000000034


other stats
agent_compute-ego0_max0.04777364867074149
agent_compute-ego0_mean0.02853229203528555
agent_compute-ego0_median0.027133809018545892
agent_compute-ego0_min0.01208790143330892
complete-iteration_max0.2406798986827626
complete-iteration_mean0.1971294081299184
complete-iteration_median0.1880398628011009
complete-iteration_min0.1717580082347092
deviation-center-line_max0.7021858705434142
deviation-center-line_mean0.2672592990089397
deviation-center-line_min0.08800016807361014
deviation-heading_max2.966667813290648
deviation-heading_mean1.242396460927631
deviation-heading_median0.7282050411700633
deviation-heading_min0.5465079480797496
driven_any_max7.1474310271354105
driven_any_mean3.3853688202141647
driven_any_median2.548008345272711
driven_any_min1.2980275631758251
driven_lanedir_consec_max3.8978787838034177
driven_lanedir_consec_mean1.4767952680228231
driven_lanedir_consec_min0.6658483757046421
driven_lanedir_max3.8978787838034177
driven_lanedir_mean1.4767952680228231
driven_lanedir_median0.6717269562916164
driven_lanedir_min0.6658483757046421
get_duckie_state_max1.664686357319162e-06
get_duckie_state_mean1.4377455428911418e-06
get_duckie_state_median1.4357064537499715e-06
get_duckie_state_min1.214882906745462e-06
get_robot_state_max0.004767151439891142
get_robot_state_mean0.0040141589209763285
get_robot_state_median0.003972382246736787
get_robot_state_min0.003344719750540597
get_state_dump_max0.01087063901564654
get_state_dump_mean0.006339959532725313
get_state_dump_median0.005121302274999706
get_state_dump_min0.004246594565255301
get_ui_image_max0.03546894823803621
get_ui_image_mean0.030018574040933717
get_ui_image_median0.030579325209056433
get_ui_image_min0.0234466975075858
in-drivable-lane_max15.600000000000222
in-drivable-lane_mean9.262500000000069
in-drivable-lane_min3.4499999999999877
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.1474310271354105, "get_ui_image": 0.027583485668145336, "step_physics": 0.1034791137794075, "survival_time": 30.850000000000303, "driven_lanedir": 3.8978787838034177, "get_state_dump": 0.00517814599194573, "get_robot_state": 0.003909200912154608, "sim_render-ego0": 0.0040247694959918276, "get_duckie_state": 1.664686357319162e-06, "in-drivable-lane": 15.600000000000222, "deviation-heading": 2.966667813290648, "agent_compute-ego0": 0.01208790143330892, "complete-iteration": 0.1717580082347092, "set_robot_commands": 0.0025112906705985947, "deviation-center-line": 0.7021858705434142, "driven_lanedir_consec": 3.8978787838034177, "sim_compute_sim_state": 0.010728434065784838, "sim_compute_performance-ego0": 0.0021636906565200165}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2980275631758251, "get_ui_image": 0.03546894823803621, "step_physics": 0.1286247845958261, "survival_time": 6.749999999999984, "driven_lanedir": 0.6658483757046421, "get_state_dump": 0.01087063901564654, "get_robot_state": 0.004767151439891142, "sim_render-ego0": 0.004082632415434893, "get_duckie_state": 1.214882906745462e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 0.8732090594559083, "agent_compute-ego0": 0.04082665022681741, "complete-iteration": 0.2406798986827626, "set_robot_commands": 0.0033382738337797277, "deviation-center-line": 0.1620681106273428, "driven_lanedir_consec": 0.6658483757046421, "sim_compute_sim_state": 0.010665115188149846, "sim_compute_performance-ego0": 0.0019557248143588796}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.2518641683697354, "get_ui_image": 0.03357516474996753, "step_physics": 0.12406073756490892, "survival_time": 14.800000000000075, "driven_lanedir": 0.6708036807278215, "get_state_dump": 0.005064458558053681, "get_robot_state": 0.004035563581318968, "sim_render-ego0": 0.004205100062720302, "get_duckie_state": 1.652072174380524e-06, "in-drivable-lane": 12.050000000000075, "deviation-heading": 0.5465079480797496, "agent_compute-ego0": 0.013440967810274375, "complete-iteration": 0.2000647450135613, "set_robot_commands": 0.0024670205935083253, "deviation-center-line": 0.11678304679139156, "driven_lanedir_consec": 0.6708036807278215, "sim_compute_sim_state": 0.010937587179318822, "sim_compute_performance-ego0": 0.0021797719627919825}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8441525221756871, "get_ui_image": 0.0234466975075858, "step_physics": 0.08545004163469587, "survival_time": 8.699999999999989, "driven_lanedir": 0.6726502318554113, "get_state_dump": 0.004246594565255301, "get_robot_state": 0.003344719750540597, "sim_render-ego0": 0.0034193829127720423, "get_duckie_state": 1.2193407331194195e-06, "in-drivable-lane": 5.94999999999999, "deviation-heading": 0.5832010228842184, "agent_compute-ego0": 0.04777364867074149, "complete-iteration": 0.17601498058864049, "set_robot_commands": 0.0020277350289481027, "deviation-center-line": 0.08800016807361014, "driven_lanedir_consec": 0.6726502318554113, "sim_compute_sim_state": 0.004516849517822266, "sim_compute_performance-ego0": 0.0017117609296526228}}
set_robot_commands_max0.0033382738337797277
set_robot_commands_mean0.002586080031708688
set_robot_commands_median0.00248915563205346
set_robot_commands_min0.0020277350289481027
sim_compute_performance-ego0_max0.0021797719627919825
sim_compute_performance-ego0_mean0.002002737090830875
sim_compute_performance-ego0_median0.002059707735439448
sim_compute_performance-ego0_min0.0017117609296526228
sim_compute_sim_state_max0.010937587179318822
sim_compute_sim_state_mean0.009211996487768943
sim_compute_sim_state_median0.010696774626967342
sim_compute_sim_state_min0.004516849517822266
sim_render-ego0_max0.004205100062720302
sim_render-ego0_mean0.003932971221729767
sim_render-ego0_median0.00405370095571336
sim_render-ego0_min0.0034193829127720423
simulation-passed1
step_physics_max0.1286247845958261
step_physics_mean0.1104036693937096
step_physics_median0.1137699256721582
step_physics_min0.08545004163469587
survival_time_max30.850000000000303
survival_time_mean15.275000000000087
survival_time_min6.749999999999984
No reset possible
5454911451Aleksandar Petrov 🇨🇭exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:05:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.48892942179856824
survival_time_median5.249999999999989
deviation-center-line_median0.13191648840869452
in-drivable-lane_median3.2499999999999902


other stats
agent_compute-ego0_max0.012795732134864443
agent_compute-ego0_mean0.01210554924594062
agent_compute-ego0_median0.012144491418331418
agent_compute-ego0_min0.011337482012235202
complete-iteration_max0.2213536472547622
complete-iteration_mean0.18288899824299992
complete-iteration_median0.18390008273877595
complete-iteration_min0.1424021802396856
deviation-center-line_max0.1643959468172477
deviation-center-line_mean0.12557847619610993
deviation-center-line_min0.07408498114980296
deviation-heading_max1.3085060007319516
deviation-heading_mean0.8127054713150081
deviation-heading_median0.7946842392500675
deviation-heading_min0.35294740602794605
driven_any_max3.0258559942245338
driven_any_mean1.7592592311392878
driven_any_median1.470999276751933
driven_any_min1.0691823768287514
driven_lanedir_consec_max0.6494315759471684
driven_lanedir_consec_mean0.4751876951392385
driven_lanedir_consec_min0.27346036101264914
driven_lanedir_max0.6494315759471684
driven_lanedir_mean0.4751876951392385
driven_lanedir_median0.48892942179856824
driven_lanedir_min0.27346036101264914
get_duckie_state_max1.5128226507277715e-06
get_duckie_state_mean1.3830064463206331e-06
get_duckie_state_median1.3834390884790665e-06
get_duckie_state_min1.2523249575966285e-06
get_robot_state_max0.004104250953311012
get_robot_state_mean0.003729064373712323
get_robot_state_median0.003670009331181947
get_robot_state_min0.0034719878791743875
get_state_dump_max0.005253882635207404
get_state_dump_mean0.004829997418357478
get_state_dump_median0.004809861401958182
get_state_dump_min0.00444638423430614
get_ui_image_max0.0337726700873602
get_ui_image_mean0.030397146185836697
get_ui_image_median0.03157653271267128
get_ui_image_min0.02466284923064403
in-drivable-lane_max8.100000000000005
in-drivable-lane_mean4.099999999999995
in-drivable-lane_min1.7999999999999936
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.0258559942245338, "get_ui_image": 0.029561165051582537, "step_physics": 0.10202730985788198, "survival_time": 9.700000000000005, "driven_lanedir": 0.27346036101264914, "get_state_dump": 0.0048735643044496195, "get_robot_state": 0.0036893257727989783, "sim_render-ego0": 0.003804508845011393, "get_duckie_state": 1.3913863744491183e-06, "in-drivable-lane": 8.100000000000005, "deviation-heading": 1.175100072434885, "agent_compute-ego0": 0.012439260727319962, "complete-iteration": 0.1702411651611328, "set_robot_commands": 0.0022010962168375653, "deviation-center-line": 0.1643959468172477, "driven_lanedir_consec": 0.27346036101264914, "sim_compute_sim_state": 0.009605181522858448, "sim_compute_performance-ego0": 0.0019534722352639224}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.278825974691371, "get_ui_image": 0.033591900373760024, "step_physics": 0.1260218017979672, "survival_time": 4.699999999999991, "driven_lanedir": 0.3629620387619259, "get_state_dump": 0.004746158499466745, "get_robot_state": 0.003650692889564916, "sim_render-ego0": 0.00381064164011102, "get_duckie_state": 1.2523249575966285e-06, "in-drivable-lane": 2.8499999999999934, "deviation-heading": 1.3085060007319516, "agent_compute-ego0": 0.011849722109342877, "complete-iteration": 0.1975590003164191, "set_robot_commands": 0.0024248424329255756, "deviation-center-line": 0.1429278448490799, "driven_lanedir_consec": 0.3629620387619259, "sim_compute_sim_state": 0.009442841379266036, "sim_compute_performance-ego0": 0.0019386442084061472}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0691823768287514, "get_ui_image": 0.0337726700873602, "step_physics": 0.1476434071858724, "survival_time": 4.149999999999993, "driven_lanedir": 0.6494315759471684, "get_state_dump": 0.005253882635207404, "get_robot_state": 0.004104250953311012, "sim_render-ego0": 0.00419898544039045, "get_duckie_state": 1.5128226507277715e-06, "in-drivable-lane": 1.7999999999999936, "deviation-heading": 0.41426840606525006, "agent_compute-ego0": 0.012795732134864443, "complete-iteration": 0.2213536472547622, "set_robot_commands": 0.0024103749366033646, "deviation-center-line": 0.07408498114980296, "driven_lanedir_consec": 0.6494315759471684, "sim_compute_sim_state": 0.00884273506346203, "sim_compute_performance-ego0": 0.00223628112248012}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6631725788124958, "get_ui_image": 0.02466284923064403, "step_physics": 0.08617720848474747, "survival_time": 5.799999999999987, "driven_lanedir": 0.6148968048352106, "get_state_dump": 0.00444638423430614, "get_robot_state": 0.0034719878791743875, "sim_render-ego0": 0.0035608263097257698, "get_duckie_state": 1.3754918025090144e-06, "in-drivable-lane": 3.649999999999987, "deviation-heading": 0.35294740602794605, "agent_compute-ego0": 0.011337482012235202, "complete-iteration": 0.1424021802396856, "set_robot_commands": 0.002053588883489625, "deviation-center-line": 0.12090513196830915, "driven_lanedir_consec": 0.6148968048352106, "sim_compute_sim_state": 0.004776510417970837, "sim_compute_performance-ego0": 0.0018339625790587857}}
set_robot_commands_max0.0024248424329255756
set_robot_commands_mean0.0022724756174640325
set_robot_commands_median0.002305735576720465
set_robot_commands_min0.002053588883489625
sim_compute_performance-ego0_max0.00223628112248012
sim_compute_performance-ego0_mean0.0019905900363022437
sim_compute_performance-ego0_median0.0019460582218350348
sim_compute_performance-ego0_min0.0018339625790587857
sim_compute_sim_state_max0.009605181522858448
sim_compute_sim_state_mean0.008166817095889338
sim_compute_sim_state_median0.009142788221364034
sim_compute_sim_state_min0.004776510417970837
sim_render-ego0_max0.00419898544039045
sim_render-ego0_mean0.0038437405588096583
sim_render-ego0_median0.0038075752425612065
sim_render-ego0_min0.0035608263097257698
simulation-passed1
step_physics_max0.1476434071858724
step_physics_mean0.11546743183161728
step_physics_median0.1140245558279246
step_physics_min0.08617720848474747
survival_time_max9.700000000000005
survival_time_mean6.087499999999993
survival_time_min4.149999999999993
No reset possible
5446211534Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:37:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.465583233386322
survival_time_median59.99999999999873
deviation-center-line_median3.841597991453291
in-drivable-lane_median11.59999999999979


other stats
agent_compute-ego0_max0.012604058731803291
agent_compute-ego0_mean0.012320505158637014
agent_compute-ego0_median0.0123195793415244
agent_compute-ego0_min0.012038803219695969
complete-iteration_max0.24948599566584048
complete-iteration_mean0.20775295155470347
complete-iteration_median0.2002215406281267
complete-iteration_min0.18108272929672
deviation-center-line_max5.123844936099861
deviation-center-line_mean4.039600375707031
deviation-center-line_min3.351360583821681
deviation-heading_max15.764193696221788
deviation-heading_mean13.941287623012636
deviation-heading_median13.98094090395701
deviation-heading_min12.03907498791474
driven_any_max19.170612605652337
driven_any_mean16.50582047528968
driven_any_median16.267411418985017
driven_any_min14.317846457536357
driven_lanedir_consec_max13.008449258147277
driven_lanedir_consec_mean9.415822445217689
driven_lanedir_consec_min5.723674055950835
driven_lanedir_max16.231003001523135
driven_lanedir_mean13.007982258307193
driven_lanedir_median12.328694028845788
driven_lanedir_min11.143537974014052
get_duckie_state_max1.5605014303456185e-06
get_duckie_state_mean1.5239039669900673e-06
get_duckie_state_median1.5282809585456942e-06
get_duckie_state_min1.478552520523262e-06
get_robot_state_max0.003911493422089766
get_robot_state_mean0.003815412782325478
get_robot_state_median0.003806618951169067
get_robot_state_min0.0037369198048740103
get_state_dump_max0.0048718006714530615
get_state_dump_mean0.0047967319516921915
get_state_dump_median0.004783727942060967
get_state_dump_min0.004747671251193768
get_ui_image_max0.036564515777256175
get_ui_image_mean0.031281528297903594
get_ui_image_median0.03102403229023396
get_ui_image_min0.026513532833890255
in-drivable-lane_max15.69999999999929
in-drivable-lane_mean10.137499999999717
in-drivable-lane_min1.649999999999987
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 19.170612605652337, "get_ui_image": 0.02851654012236965, "step_physics": 0.1186452862821352, "survival_time": 59.99999999999873, "driven_lanedir": 13.008449258147277, "get_state_dump": 0.004792024253508531, "get_robot_state": 0.0037369198048740103, "sim_render-ego0": 0.0038392152714788862, "get_duckie_state": 1.5158736636299177e-06, "in-drivable-lane": 15.69999999999929, "deviation-heading": 13.12119982344632, "agent_compute-ego0": 0.012038803219695969, "complete-iteration": 0.1853206445533568, "set_robot_commands": 0.0022400027012249315, "deviation-center-line": 4.094121679760953, "driven_lanedir_consec": 13.008449258147277, "sim_compute_sim_state": 0.00940250913666051, "sim_compute_performance-ego0": 0.0020176643733676525}, "LF-norm-zigzag-000-ego0": {"driven_any": 14.317846457536357, "get_ui_image": 0.036564515777256175, "step_physics": 0.17118393504101298, "survival_time": 57.44999999999887, "driven_lanedir": 11.143537974014052, "get_state_dump": 0.0048718006714530615, "get_robot_state": 0.003824108994525412, "sim_render-ego0": 0.003989037223484205, "get_duckie_state": 1.5605014303456185e-06, "in-drivable-lane": 10.949999999999545, "deviation-heading": 15.764193696221788, "agent_compute-ego0": 0.01253925261290177, "complete-iteration": 0.24948599566584048, "set_robot_commands": 0.0023472253136012865, "deviation-center-line": 3.58907430314563, "driven_lanedir_consec": 5.723674055950835, "sim_compute_sim_state": 0.01191789834395699, "sim_compute_performance-ego0": 0.002153099930804709}, "LF-norm-techtrack-000-ego0": {"driven_any": 17.042812470014617, "get_ui_image": 0.033531524458098275, "step_physics": 0.13921482993800077, "survival_time": 59.99999999999873, "driven_lanedir": 16.231003001523135, "get_state_dump": 0.004747671251193768, "get_robot_state": 0.003911493422089766, "sim_render-ego0": 0.003954754780968659, "get_duckie_state": 1.478552520523262e-06, "in-drivable-lane": 1.649999999999987, "deviation-heading": 12.03907498791474, "agent_compute-ego0": 0.012604058731803291, "complete-iteration": 0.2151224367028966, "set_robot_commands": 0.002343051737293812, "deviation-center-line": 5.123844936099861, "driven_lanedir_consec": 11.60063129797322, "sim_compute_sim_state": 0.012572740138718529, "sim_compute_performance-ego0": 0.0021464709536816854}, "LF-norm-small_loop-000-ego0": {"driven_any": 15.492010367955416, "get_ui_image": 0.026513532833890255, "step_physics": 0.11939447745990991, "survival_time": 59.99999999999873, "driven_lanedir": 11.648938799544302, "get_state_dump": 0.0047754316306134045, "get_robot_state": 0.003789128907812723, "sim_render-ego0": 0.0038354912963536854, "get_duckie_state": 1.540688253461471e-06, "in-drivable-lane": 12.250000000000036, "deviation-heading": 14.8406819844677, "agent_compute-ego0": 0.01209990607014703, "complete-iteration": 0.18108272929672, "set_robot_commands": 0.002301142872819098, "deviation-center-line": 3.351360583821681, "driven_lanedir_consec": 7.330535168799424, "sim_compute_sim_state": 0.006259027468374032, "sim_compute_performance-ego0": 0.0020231704330761963}}
set_robot_commands_max0.0023472253136012865
set_robot_commands_mean0.0023078556562347824
set_robot_commands_median0.0023220973050564553
set_robot_commands_min0.0022400027012249315
sim_compute_performance-ego0_max0.002153099930804709
sim_compute_performance-ego0_mean0.002085101422732561
sim_compute_performance-ego0_median0.002084820693378941
sim_compute_performance-ego0_min0.0020176643733676525
sim_compute_sim_state_max0.012572740138718529
sim_compute_sim_state_mean0.010038043771927517
sim_compute_sim_state_median0.010660203740308748
sim_compute_sim_state_min0.006259027468374032
sim_render-ego0_max0.003989037223484205
sim_render-ego0_mean0.003904624643071359
sim_render-ego0_median0.0038969850262237727
sim_render-ego0_min0.0038354912963536854
simulation-passed1
step_physics_max0.17118393504101298
step_physics_mean0.1371096321802647
step_physics_median0.12930465369895533
step_physics_min0.1186452862821352
survival_time_max59.99999999999873
survival_time_mean59.36249999999876
survival_time_min57.44999999999887
No reset possible
5445911624Anthony Courchesne 🇨🇦TNetR1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:18
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5441611545Himanshu Arora 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:15:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5835426633258373
survival_time_median12.35000000000004
deviation-center-line_median0.25732335934085865
in-drivable-lane_median6.625000000000032


other stats
agent_compute-ego0_max0.013198478801830397
agent_compute-ego0_mean0.012853377514869813
agent_compute-ego0_median0.012849380759501048
agent_compute-ego0_min0.01251626973864676
complete-iteration_max0.22728306534646572
complete-iteration_mean0.20308525095926536
complete-iteration_median0.20819594448941625
complete-iteration_min0.1686660495117633
deviation-center-line_max4.068276095023685
deviation-center-line_mean1.1682353454432233
deviation-center-line_min0.09001856806749133
deviation-heading_max10.842330123701569
deviation-heading_mean3.6726458824034616
deviation-heading_median1.638205464200709
deviation-heading_min0.5718424775108606
driven_any_max15.748344480710667
driven_any_mean5.113241156846559
driven_any_median1.705235938161141
driven_any_min1.2941482703532885
driven_lanedir_consec_max14.467480490478106
driven_lanedir_consec_mean3.998377157910697
driven_lanedir_consec_min0.35894281451300925
driven_lanedir_max14.467480490478106
driven_lanedir_mean4.000532669796471
driven_lanedir_median0.5878536870973855
driven_lanedir_min0.35894281451300925
get_duckie_state_max1.6120103028443484e-06
get_duckie_state_mean1.4632644994389849e-06
get_duckie_state_median1.4607620897695748e-06
get_duckie_state_min1.3195235153724407e-06
get_robot_state_max0.003965403019240457
get_robot_state_mean0.0038470481493822544
get_robot_state_median0.003846210569059971
get_robot_state_min0.0037303684401686177
get_state_dump_max0.005050497012095408
get_state_dump_mean0.004825376072646481
get_state_dump_median0.004803385861608805
get_state_dump_min0.004644235555272903
get_ui_image_max0.03713348953203223
get_ui_image_mean0.03249166303715602
get_ui_image_median0.03298049706218257
get_ui_image_min0.026872168492226706
in-drivable-lane_max9.350000000000025
in-drivable-lane_mean6.3749999999999964
in-drivable-lane_min2.8999999999999027
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 15.748344480710667, "get_ui_image": 0.03079569925376517, "step_physics": 0.1294532705603988, "survival_time": 59.99999999999873, "driven_lanedir": 14.467480490478106, "get_state_dump": 0.004912548319286947, "get_robot_state": 0.003965403019240457, "sim_render-ego0": 0.003999597524028337, "get_duckie_state": 1.4892724233304929e-06, "in-drivable-lane": 2.8999999999999027, "deviation-heading": 10.842330123701569, "agent_compute-ego0": 0.01300845058831843, "complete-iteration": 0.2010225366295426, "set_robot_commands": 0.002409122865662587, "deviation-center-line": 4.068276095023685, "driven_lanedir_consec": 14.467480490478106, "sim_compute_sim_state": 0.010182870615531166, "sim_compute_performance-ego0": 0.0022041247746628786}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2941482703532885, "get_ui_image": 0.03713348953203223, "step_physics": 0.15066442818477235, "survival_time": 8.649999999999988, "driven_lanedir": 0.45328663816910986, "get_state_dump": 0.004694223403930664, "get_robot_state": 0.003757811140740055, "sim_render-ego0": 0.0039617152049623685, "get_duckie_state": 1.3195235153724407e-06, "in-drivable-lane": 5.74999999999999, "deviation-heading": 1.2470163354550372, "agent_compute-ego0": 0.01251626973864676, "complete-iteration": 0.22728306534646572, "set_robot_commands": 0.002365876888406688, "deviation-center-line": 0.13659172143267573, "driven_lanedir_consec": 0.45328663816910986, "sim_compute_sim_state": 0.01004195350340043, "sim_compute_performance-ego0": 0.0020593500685417787}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.6481063910035378, "get_ui_image": 0.03516529487059997, "step_physics": 0.1406772974375132, "survival_time": 11.050000000000022, "driven_lanedir": 0.35894281451300925, "get_state_dump": 0.005050497012095408, "get_robot_state": 0.003934609997379887, "sim_render-ego0": 0.004060819342329695, "get_duckie_state": 1.6120103028443484e-06, "in-drivable-lane": 9.350000000000025, "deviation-heading": 0.5718424775108606, "agent_compute-ego0": 0.013198478801830397, "complete-iteration": 0.21536935234928992, "set_robot_commands": 0.002464038831693632, "deviation-center-line": 0.09001856806749133, "driven_lanedir_consec": 0.35894281451300925, "sim_compute_sim_state": 0.00857370715957504, "sim_compute_performance-ego0": 0.0021498192538012256}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7623654853187445, "get_ui_image": 0.026872168492226706, "step_physics": 0.10678418535385688, "survival_time": 13.65000000000006, "driven_lanedir": 0.7224207360256611, "get_state_dump": 0.004644235555272903, "get_robot_state": 0.0037303684401686177, "sim_render-ego0": 0.0042113753130836205, "get_duckie_state": 1.4322517562086566e-06, "in-drivable-lane": 7.500000000000073, "deviation-heading": 2.02939459294638, "agent_compute-ego0": 0.012690310930683664, "complete-iteration": 0.1686660495117633, "set_robot_commands": 0.002289687630033841, "deviation-center-line": 0.3780549972490416, "driven_lanedir_consec": 0.7137986884825647, "sim_compute_sim_state": 0.005276354560016716, "sim_compute_performance-ego0": 0.002083386817987818}}
set_robot_commands_max0.002464038831693632
set_robot_commands_mean0.002382181553949187
set_robot_commands_median0.002387499877034637
set_robot_commands_min0.002289687630033841
sim_compute_performance-ego0_max0.0022041247746628786
sim_compute_performance-ego0_mean0.0021241702287484255
sim_compute_performance-ego0_median0.0021166030358945216
sim_compute_performance-ego0_min0.0020593500685417787
sim_compute_sim_state_max0.010182870615531166
sim_compute_sim_state_mean0.008518721459630839
sim_compute_sim_state_median0.009307830331487736
sim_compute_sim_state_min0.005276354560016716
sim_render-ego0_max0.0042113753130836205
sim_render-ego0_mean0.004058376846101005
sim_render-ego0_median0.004030208433179016
sim_render-ego0_min0.0039617152049623685
simulation-passed1
step_physics_max0.15066442818477235
step_physics_mean0.13189479538413532
step_physics_median0.135065283998956
step_physics_min0.10678418535385688
survival_time_max59.99999999999873
survival_time_mean23.3374999999997
survival_time_min8.649999999999988
No reset possible
5435711566Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:15:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.672599165435222
survival_time_median16.800000000000104
deviation-center-line_median0.22586476209285664
in-drivable-lane_median12.800000000000113


other stats
agent_compute-ego0_max0.01314410855693202
agent_compute-ego0_mean0.012538469295544396
agent_compute-ego0_median0.01255317519860768
agent_compute-ego0_min0.011903418228030205
complete-iteration_max0.2143211518564532
complete-iteration_mean0.17239191728198971
complete-iteration_median0.16318718871128474
complete-iteration_min0.1488721398489362
deviation-center-line_max3.914186438219622
deviation-center-line_mean1.1080723547358011
deviation-center-line_min0.06637345653786889
deviation-heading_max3.9460830854349114
deviation-heading_mean1.8133932658611511
deviation-heading_median1.4789630263299842
deviation-heading_min0.34956392534972375
driven_any_max13.623684727021784
driven_any_mean5.284086024754471
driven_any_median3.0437668231750608
driven_any_min1.4251257256459802
driven_lanedir_consec_max8.262062241808687
driven_lanedir_consec_mean2.559828354168104
driven_lanedir_consec_min0.632052843993286
driven_lanedir_max8.262062241808687
driven_lanedir_mean2.559828354168104
driven_lanedir_median0.672599165435222
driven_lanedir_min0.632052843993286
get_duckie_state_max1.6940267462479442e-06
get_duckie_state_mean1.550682030217348e-06
get_duckie_state_median1.56517198209527e-06
get_duckie_state_min1.3783574104309082e-06
get_robot_state_max0.004108775046563918
get_robot_state_mean0.00381632295876895
get_robot_state_median0.003807949221685236
get_robot_state_min0.003540618345141411
get_state_dump_max0.0054802627973659064
get_state_dump_mean0.004991005418951763
get_state_dump_median0.005022666266427184
get_state_dump_min0.004438426345586777
get_ui_image_max0.03934705641961867
get_ui_image_mean0.030407254040951105
get_ui_image_median0.02780377855034251
get_ui_image_min0.02667440264350072
in-drivable-lane_max26.199999999999637
in-drivable-lane_mean13.99999999999996
in-drivable-lane_min4.199999999999985
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 13.623684727021784, "get_ui_image": 0.02667440264350072, "step_physics": 0.08481875446614973, "survival_time": 59.99999999999873, "driven_lanedir": 8.262062241808687, "get_state_dump": 0.004706993388891419, "get_robot_state": 0.003599136298542515, "sim_render-ego0": 0.003763019790458838, "get_duckie_state": 1.5408867701801233e-06, "in-drivable-lane": 26.199999999999637, "deviation-heading": 3.9460830854349114, "agent_compute-ego0": 0.012052612638195587, "complete-iteration": 0.1488721398489362, "set_robot_commands": 0.0021790020868839768, "deviation-center-line": 3.914186438219622, "driven_lanedir_consec": 8.262062241808687, "sim_compute_sim_state": 0.008973007892986619, "sim_compute_performance-ego0": 0.0020094370464798215}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.361197169327848, "get_ui_image": 0.03934705641961867, "step_physics": 0.1308273494884532, "survival_time": 23.200000000000195, "driven_lanedir": 0.632052843993286, "get_state_dump": 0.0054802627973659064, "get_robot_state": 0.004108775046563918, "sim_render-ego0": 0.004339456558227539, "get_duckie_state": 1.5894571940104167e-06, "in-drivable-lane": 19.00000000000021, "deviation-heading": 2.020809686986294, "agent_compute-ego0": 0.01314410855693202, "complete-iteration": 0.2143211518564532, "set_robot_commands": 0.002460762249526157, "deviation-center-line": 0.32427554744717535, "driven_lanedir_consec": 0.632052843993286, "sim_compute_sim_state": 0.012208259746592532, "sim_compute_performance-ego0": 0.0022996979375039376}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4251257256459802, "get_ui_image": 0.02820839360356331, "step_physics": 0.09909743629395962, "survival_time": 6.349999999999985, "driven_lanedir": 0.657815617920912, "get_state_dump": 0.004438426345586777, "get_robot_state": 0.003540618345141411, "sim_render-ego0": 0.003653300926089287, "get_duckie_state": 1.3783574104309082e-06, "in-drivable-lane": 4.199999999999985, "deviation-heading": 0.34956392534972375, "agent_compute-ego0": 0.011903418228030205, "complete-iteration": 0.16240481846034527, "set_robot_commands": 0.0020644627511501312, "deviation-center-line": 0.06637345653786889, "driven_lanedir_consec": 0.657815617920912, "sim_compute_sim_state": 0.007521675899624824, "sim_compute_performance-ego0": 0.0018885266035795212}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.726336477022273, "get_ui_image": 0.02739916349712171, "step_physics": 0.09969734232961848, "survival_time": 10.400000000000013, "driven_lanedir": 0.687382712949532, "get_state_dump": 0.005338339143962951, "get_robot_state": 0.004016762144827957, "sim_render-ego0": 0.004089435321862618, "get_duckie_state": 1.6940267462479442e-06, "in-drivable-lane": 6.600000000000018, "deviation-heading": 0.9371163656736746, "agent_compute-ego0": 0.01305373775901977, "complete-iteration": 0.1639695589622242, "set_robot_commands": 0.002436171308088531, "deviation-center-line": 0.12745397673853798, "driven_lanedir_consec": 0.687382712949532, "sim_compute_sim_state": 0.005625286741119823, "sim_compute_performance-ego0": 0.0022012651251833975}}
set_robot_commands_max0.002460762249526157
set_robot_commands_mean0.002285099598912199
set_robot_commands_median0.002307586697486254
set_robot_commands_min0.0020644627511501312
sim_compute_performance-ego0_max0.0022996979375039376
sim_compute_performance-ego0_mean0.0020997316781866697
sim_compute_performance-ego0_median0.0021053510858316093
sim_compute_performance-ego0_min0.0018885266035795212
sim_compute_sim_state_max0.012208259746592532
sim_compute_sim_state_mean0.00858205757008095
sim_compute_sim_state_median0.008247341896305722
sim_compute_sim_state_min0.005625286741119823
sim_render-ego0_max0.004339456558227539
sim_render-ego0_mean0.00396130314915957
sim_render-ego0_median0.003926227556160728
sim_render-ego0_min0.003653300926089287
simulation-passed1
step_physics_max0.1308273494884532
step_physics_mean0.10361022064454524
step_physics_median0.09939738931178904
step_physics_min0.08481875446614973
survival_time_max59.99999999999873
survival_time_mean24.987499999999727
survival_time_min6.349999999999985
No reset possible
5422012728Raphael Jeansim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:39:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median13.571383714990784
survival_time_median59.99999999999873
deviation-center-line_median3.0489114594922953
in-drivable-lane_median0.425000000000001


other stats
agent_compute-ego0_max0.05157861860467432
agent_compute-ego0_mean0.03756878000810482
agent_compute-ego0_median0.04318908261419037
agent_compute-ego0_min0.012318336199364198
complete-iteration_max0.2733300661266495
complete-iteration_mean0.2276809133161216
complete-iteration_median0.21884383190482187
complete-iteration_min0.1997059233281932
deviation-center-line_max3.552532508110009
deviation-center-line_mean3.134796963021787
deviation-center-line_min2.888832424992549
deviation-heading_max12.243275877327914
deviation-heading_mean11.068964690545444
deviation-heading_median11.02334741316236
deviation-heading_min9.98588805852915
driven_any_max17.215493634518563
driven_any_mean14.696231473535672
driven_any_median14.05548531701859
driven_any_min13.458461625586942
driven_lanedir_consec_max16.620065404976714
driven_lanedir_consec_mean14.238890523166932
driven_lanedir_consec_min13.192729257709445
driven_lanedir_max16.620065404976714
driven_lanedir_mean14.238890523166932
driven_lanedir_median13.571383714990784
driven_lanedir_min13.192729257709445
get_duckie_state_max1.98675532027347e-06
get_duckie_state_mean1.9323121101830428e-06
get_duckie_state_median1.921840353274127e-06
get_duckie_state_min1.8988124139104456e-06
get_robot_state_max0.003741229602835955
get_robot_state_mean0.0036992411827862417
get_robot_state_median0.00370565242910266
get_robot_state_min0.0036444302701036896
get_state_dump_max0.00505741053477215
get_state_dump_mean0.004704633868802695
get_state_dump_median0.0046055879719946215
get_state_dump_min0.004549948996449391
get_ui_image_max0.03559133293825224
get_ui_image_mean0.03059613987567721
get_ui_image_median0.03047713729165972
get_ui_image_min0.02583895198113714
in-drivable-lane_max0.8999999999999488
in-drivable-lane_mean0.4374999999999877
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 17.215493634518563, "get_ui_image": 0.02818026332235853, "step_physics": 0.11011768419677072, "survival_time": 59.99999999999873, "driven_lanedir": 16.620065404976714, "get_state_dump": 0.00505741053477215, "get_robot_state": 0.003703036772817696, "sim_render-ego0": 0.003732438885500588, "get_duckie_state": 1.926009204365828e-06, "in-drivable-lane": 0.850000000000002, "deviation-heading": 10.810874472384215, "agent_compute-ego0": 0.035143811140925955, "complete-iteration": 0.1997059233281932, "set_robot_commands": 0.0024454667109633167, "deviation-center-line": 2.888832424992549, "driven_lanedir_consec": 16.620065404976714, "sim_compute_sim_state": 0.009280678632356642, "sim_compute_performance-ego0": 0.001959227205414657}, "LF-norm-zigzag-000-ego0": {"driven_any": 13.86099943319696, "get_ui_image": 0.03559133293825224, "step_physics": 0.15550162135115472, "survival_time": 59.99999999999873, "driven_lanedir": 13.32456507798478, "get_state_dump": 0.004609986209154725, "get_robot_state": 0.003741229602835955, "sim_render-ego0": 0.003893253308946544, "get_duckie_state": 1.98675532027347e-06, "in-drivable-lane": 0.8999999999999488, "deviation-heading": 11.2358203539405, "agent_compute-ego0": 0.05157861860467432, "complete-iteration": 0.2733300661266495, "set_robot_commands": 0.0023809737905078287, "deviation-center-line": 3.1523400422352044, "driven_lanedir_consec": 13.32456507798478, "sim_compute_sim_state": 0.013854042675771084, "sim_compute_performance-ego0": 0.002089834332366867}, "LF-norm-techtrack-000-ego0": {"driven_any": 14.24997120084022, "get_ui_image": 0.03277401126096092, "step_physics": 0.14810843034945956, "survival_time": 59.99999999999873, "driven_lanedir": 13.818202351996788, "get_state_dump": 0.004601189734834517, "get_robot_state": 0.0036444302701036896, "sim_render-ego0": 0.003807534186865864, "get_duckie_state": 1.917671502182426e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.243275877327914, "agent_compute-ego0": 0.012318336199364198, "complete-iteration": 0.2220217631718797, "set_robot_commands": 0.0021978633588398623, "deviation-center-line": 3.552532508110009, "driven_lanedir_consec": 13.818202351996788, "sim_compute_sim_state": 0.01248128428050223, "sim_compute_performance-ego0": 0.0020047125470926126}, "LF-norm-small_loop-000-ego0": {"driven_any": 13.458461625586942, "get_ui_image": 0.02583895198113714, "step_physics": 0.11598996814343455, "survival_time": 59.99999999999873, "driven_lanedir": 13.192729257709445, "get_state_dump": 0.004549948996449391, "get_robot_state": 0.0037082680853876247, "sim_render-ego0": 0.003792957898282091, "get_duckie_state": 1.8988124139104456e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.98588805852915, "agent_compute-ego0": 0.05123435408745479, "complete-iteration": 0.21566590063776403, "set_robot_commands": 0.002338192445054638, "deviation-center-line": 2.9454828767493866, "driven_lanedir_consec": 13.192729257709445, "sim_compute_sim_state": 0.006102420805296632, "sim_compute_performance-ego0": 0.0020235724294314673}}
set_robot_commands_max0.0024454667109633167
set_robot_commands_mean0.0023406240763414114
set_robot_commands_median0.0023595831177812333
set_robot_commands_min0.0021978633588398623
sim_compute_performance-ego0_max0.002089834332366867
sim_compute_performance-ego0_mean0.002019336628576401
sim_compute_performance-ego0_median0.00201414248826204
sim_compute_performance-ego0_min0.001959227205414657
sim_compute_sim_state_max0.013854042675771084
sim_compute_sim_state_mean0.010429606598481647
sim_compute_sim_state_median0.010880981456429436
sim_compute_sim_state_min0.006102420805296632
sim_render-ego0_max0.003893253308946544
sim_render-ego0_mean0.003806546069898772
sim_render-ego0_median0.003800246042573978
sim_render-ego0_min0.003732438885500588
simulation-passed1
step_physics_max0.15550162135115472
step_physics_mean0.13242942601020488
step_physics_median0.13204919924644706
step_physics_min0.11011768419677072
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5418111641Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:17:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.409038203234201
survival_time_median20.175000000000153
deviation-center-line_median1.0458796199340692
in-drivable-lane_median7.325000000000061


other stats
agent_compute-ego0_max0.012826187133789062
agent_compute-ego0_mean0.01257219445614616
agent_compute-ego0_median0.01270837455579988
agent_compute-ego0_min0.01204584157919582
complete-iteration_max0.28081138526337057
complete-iteration_mean0.25085334686496147
complete-iteration_median0.2522709590926158
complete-iteration_min0.21806008401124377
deviation-center-line_max2.3396267881950465
deviation-center-line_mean1.154201887800855
deviation-center-line_min0.18542152314023533
deviation-heading_max11.264726217619542
deviation-heading_mean6.059184394468222
deviation-heading_median6.102952779298684
deviation-heading_min0.766105801655981
driven_any_max15.840331285656992
driven_any_mean6.839431090197317
driven_any_median5.080315643039408
driven_any_min1.3567617890534636
driven_lanedir_consec_max7.015756827365665
driven_lanedir_consec_mean3.16580942894084
driven_lanedir_consec_min0.8294044819292936
driven_lanedir_max7.015756827365665
driven_lanedir_mean3.3496954891983903
driven_lanedir_median2.776810323749301
driven_lanedir_min0.8294044819292936
get_duckie_state_max1.396533947635964e-06
get_duckie_state_mean1.2600074530273264e-06
get_duckie_state_median1.250497016709327e-06
get_duckie_state_min1.1425018310546877e-06
get_robot_state_max0.003853626873182214
get_robot_state_mean0.003761875163422402
get_robot_state_median0.003764534383292599
get_robot_state_min0.003664805013922197
get_state_dump_max0.0049088836292137845
get_state_dump_mean0.0048322252111065046
get_state_dump_median0.004838357261464566
get_state_dump_min0.004743302692283103
get_ui_image_max0.035410069212128845
get_ui_image_mean0.03182973656793204
get_ui_image_median0.031995699907917466
get_ui_image_min0.02791747724376439
in-drivable-lane_max30.09999999999895
in-drivable-lane_mean11.824999999999768
in-drivable-lane_min2.549999999999991
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 15.840331285656992, "get_ui_image": 0.02984903912857907, "step_physics": 0.16646795189450125, "survival_time": 59.99999999999873, "driven_lanedir": 7.015756827365665, "get_state_dump": 0.004743302692283103, "get_robot_state": 0.0037613647565754326, "sim_render-ego0": 0.003862029408336579, "get_duckie_state": 1.3028652245158656e-06, "in-drivable-lane": 30.09999999999895, "deviation-heading": 11.264726217619542, "agent_compute-ego0": 0.012610493651238407, "complete-iteration": 0.23648435249614477, "set_robot_commands": 0.002259957800300592, "deviation-center-line": 2.3396267881950465, "driven_lanedir_consec": 7.015756827365665, "sim_compute_sim_state": 0.010792961724096294, "sim_compute_performance-ego0": 0.0020493587586008243}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.9542608350386965, "get_ui_image": 0.035410069212128845, "step_physics": 0.20577097240882583, "survival_time": 19.700000000000145, "driven_lanedir": 3.0615618552140993, "get_state_dump": 0.004799784286112725, "get_robot_state": 0.003664805013922197, "sim_render-ego0": 0.003763675086105926, "get_duckie_state": 1.1981288089027888e-06, "in-drivable-lane": 6.000000000000068, "deviation-heading": 6.115468708320702, "agent_compute-ego0": 0.01204584157919582, "complete-iteration": 0.28081138526337057, "set_robot_commands": 0.002200558819348299, "deviation-center-line": 1.2514078376853244, "driven_lanedir_consec": 3.0615618552140993, "sim_compute_sim_state": 0.011099526851992064, "sim_compute_performance-ego0": 0.00197106373460987}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.3567617890534636, "get_ui_image": 0.03414236068725586, "step_physics": 0.19488027572631836, "survival_time": 6.199999999999986, "driven_lanedir": 0.8294044819292936, "get_state_dump": 0.004876930236816407, "get_robot_state": 0.0037677040100097658, "sim_render-ego0": 0.003935750961303711, "get_duckie_state": 1.1425018310546877e-06, "in-drivable-lane": 2.549999999999991, "deviation-heading": 0.766105801655981, "agent_compute-ego0": 0.012826187133789062, "complete-iteration": 0.2680575656890869, "set_robot_commands": 0.0023785171508789063, "deviation-center-line": 0.18542152314023533, "driven_lanedir_consec": 0.8294044819292936, "sim_compute_sim_state": 0.009073593139648438, "sim_compute_performance-ego0": 0.002087686538696289}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.20637045104012, "get_ui_image": 0.02791747724376439, "step_physics": 0.1531947344397577, "survival_time": 20.65000000000016, "driven_lanedir": 2.4920587922845026, "get_state_dump": 0.0049088836292137845, "get_robot_state": 0.003853626873182214, "sim_render-ego0": 0.003919543275510631, "get_duckie_state": 1.396533947635964e-06, "in-drivable-lane": 8.650000000000055, "deviation-heading": 6.0904368502766655, "agent_compute-ego0": 0.012806255460361352, "complete-iteration": 0.21806008401124377, "set_robot_commands": 0.0023805513474100455, "deviation-center-line": 0.8403514021828139, "driven_lanedir_consec": 1.756514551254302, "sim_compute_sim_state": 0.006900654898749458, "sim_compute_performance-ego0": 0.002089533828882779}}
set_robot_commands_max0.0023805513474100455
set_robot_commands_mean0.0023048962794844606
set_robot_commands_median0.002319237475589749
set_robot_commands_min0.002200558819348299
sim_compute_performance-ego0_max0.002089533828882779
sim_compute_performance-ego0_mean0.0020494107151974405
sim_compute_performance-ego0_median0.0020685226486485565
sim_compute_performance-ego0_min0.00197106373460987
sim_compute_sim_state_max0.011099526851992064
sim_compute_sim_state_mean0.009466684153621565
sim_compute_sim_state_median0.009933277431872363
sim_compute_sim_state_min0.006900654898749458
sim_render-ego0_max0.003935750961303711
sim_render-ego0_mean0.003870249682814211
sim_render-ego0_median0.003890786341923605
sim_render-ego0_min0.003763675086105926
simulation-passed1
step_physics_max0.20577097240882583
step_physics_mean0.1800784836173508
step_physics_median0.18067411381040985
step_physics_min0.1531947344397577
survival_time_max59.99999999999873
survival_time_mean26.63749999999975
survival_time_min6.199999999999986
No reset possible
5414411649Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:11:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6527209350266872
survival_time_median17.800000000000118
deviation-center-line_median0.6207655392576605
in-drivable-lane_median9.9000000000001


other stats
agent_compute-ego0_max0.013171058325540452
agent_compute-ego0_mean0.01236951396718803
agent_compute-ego0_median0.012237798450476688
agent_compute-ego0_min0.011831400642258292
complete-iteration_max0.19971353103374612
complete-iteration_mean0.1852987603297886
complete-iteration_median0.18693069536839765
complete-iteration_min0.16762011954861303
deviation-center-line_max0.6815053307265029
deviation-center-line_mean0.5725464464742588
deviation-center-line_min0.36714937665521136
deviation-heading_max4.383356661970414
deviation-heading_mean2.5898570943341728
deviation-heading_median2.343747356617615
deviation-heading_min1.2885770021310468
driven_any_max5.542884735626274
driven_any_mean3.9234663803707295
driven_any_median3.785860416762098
driven_any_min2.5792599523324484
driven_lanedir_consec_max1.9768068481313317
driven_lanedir_consec_mean1.6111740529317815
driven_lanedir_consec_min1.1624474935424214
driven_lanedir_max1.9768068481313317
driven_lanedir_mean1.6111740529317815
driven_lanedir_median1.6527209350266872
driven_lanedir_min1.1624474935424214
get_duckie_state_max2.2663956596737817e-06
get_duckie_state_mean2.1952650770851516e-06
get_duckie_state_median2.2382851717218956e-06
get_duckie_state_min2.0380943052230344e-06
get_robot_state_max0.004073836027629792
get_robot_state_mean0.003810300422900414
get_robot_state_median0.0037545912523025663
get_robot_state_min0.003658183159366731
get_state_dump_max0.005263654958634149
get_state_dump_mean0.004883637850026781
get_state_dump_median0.004785017567723456
get_state_dump_min0.0047008613060260645
get_ui_image_max0.03686742672975036
get_ui_image_mean0.03198384312366529
get_ui_image_median0.031671664887858976
get_ui_image_min0.02772461598919284
in-drivable-lane_max16.050000000000225
in-drivable-lane_mean10.06250000000012
in-drivable-lane_min4.4000000000000625
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.887890552739922, "get_ui_image": 0.029303266156104305, "step_physics": 0.11111006343663808, "survival_time": 13.900000000000064, "driven_lanedir": 1.9768068481313317, "get_state_dump": 0.004856964166019126, "get_robot_state": 0.0037282666852397305, "sim_render-ego0": 0.0038312130931457736, "get_duckie_state": 2.262840134268593e-06, "in-drivable-lane": 4.4000000000000625, "deviation-heading": 1.905631908299862, "agent_compute-ego0": 0.011831400642258292, "complete-iteration": 0.17896779549164585, "set_robot_commands": 0.002173664749309581, "deviation-center-line": 0.6578690762476208, "driven_lanedir_consec": 1.9768068481313317, "sim_compute_sim_state": 0.010022224918488531, "sim_compute_performance-ego0": 0.0020197164200540085}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.683830280784274, "get_ui_image": 0.03686742672975036, "step_physics": 0.12224913575183388, "survival_time": 21.700000000000173, "driven_lanedir": 1.53061809981252, "get_state_dump": 0.0047008613060260645, "get_robot_state": 0.003780915819365403, "sim_render-ego0": 0.0038164045618868424, "get_duckie_state": 2.2137302091751976e-06, "in-drivable-lane": 12.900000000000148, "deviation-heading": 4.383356661970414, "agent_compute-ego0": 0.012306919317135866, "complete-iteration": 0.19971353103374612, "set_robot_commands": 0.0022210565106622103, "deviation-center-line": 0.6815053307265029, "driven_lanedir_consec": 1.53061809981252, "sim_compute_sim_state": 0.011640522945886371, "sim_compute_performance-ego0": 0.0020412828730440686}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.542884735626274, "get_ui_image": 0.03404006361961365, "step_physics": 0.11549534069167244, "survival_time": 25.150000000000222, "driven_lanedir": 1.7748237702408542, "get_state_dump": 0.005263654958634149, "get_robot_state": 0.004073836027629792, "sim_render-ego0": 0.004198308974977524, "get_duckie_state": 2.2663956596737817e-06, "in-drivable-lane": 16.050000000000225, "deviation-heading": 2.781862804935368, "agent_compute-ego0": 0.013171058325540452, "complete-iteration": 0.1948935952451494, "set_robot_commands": 0.00235881455360897, "deviation-center-line": 0.5836620022677002, "driven_lanedir_consec": 1.7748237702408542, "sim_compute_sim_state": 0.013928283301610797, "sim_compute_performance-ego0": 0.0022610794930231003}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.5792599523324484, "get_ui_image": 0.02772461598919284, "step_physics": 0.10565284567494546, "survival_time": 12.35000000000004, "driven_lanedir": 1.1624474935424214, "get_state_dump": 0.004713070969427785, "get_robot_state": 0.003658183159366731, "sim_render-ego0": 0.0037411624385464575, "get_duckie_state": 2.0380943052230344e-06, "in-drivable-lane": 6.900000000000052, "deviation-heading": 1.2885770021310468, "agent_compute-ego0": 0.012168677583817513, "complete-iteration": 0.16762011954861303, "set_robot_commands": 0.002173354548792685, "deviation-center-line": 0.36714937665521136, "driven_lanedir_consec": 1.1624474935424214, "sim_compute_sim_state": 0.005752381778532459, "sim_compute_performance-ego0": 0.001950040940315493}}
set_robot_commands_max0.00235881455360897
set_robot_commands_mean0.0022317225905933618
set_robot_commands_median0.0021973606299858957
set_robot_commands_min0.002173354548792685
sim_compute_performance-ego0_max0.0022610794930231003
sim_compute_performance-ego0_mean0.0020680299316091677
sim_compute_performance-ego0_median0.0020304996465490385
sim_compute_performance-ego0_min0.001950040940315493
sim_compute_sim_state_max0.013928283301610797
sim_compute_sim_state_mean0.01033585323612954
sim_compute_sim_state_median0.010831373932187452
sim_compute_sim_state_min0.005752381778532459
sim_render-ego0_max0.004198308974977524
sim_render-ego0_mean0.0038967722671391495
sim_render-ego0_median0.003823808827516308
sim_render-ego0_min0.0037411624385464575
simulation-passed1
step_physics_max0.12224913575183388
step_physics_mean0.11362684638877246
step_physics_median0.11330270206415524
step_physics_min0.10565284567494546
survival_time_max25.150000000000222
survival_time_mean18.275000000000123
survival_time_min12.35000000000004
No reset possible
5412611655Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:09:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.544963655892598
survival_time_median12.37500000000004
deviation-center-line_median0.3804110710025609
in-drivable-lane_median6.625000000000045


other stats
agent_compute-ego0_max0.012907622478626393
agent_compute-ego0_mean0.012473064935353145
agent_compute-ego0_median0.012465300748444827
agent_compute-ego0_min0.012054035765896537
complete-iteration_max0.2750537592192294
complete-iteration_mean0.2415551796304735
complete-iteration_median0.2387890713602708
complete-iteration_min0.21358881658212295
deviation-center-line_max0.5445655649747693
deviation-center-line_mean0.4037327649587544
deviation-center-line_min0.30954335285512685
deviation-heading_max2.539187963474677
deviation-heading_mean1.6397841716421442
deviation-heading_median1.5039069619204364
deviation-heading_min1.012134799253028
driven_any_max5.569076664237804
driven_any_mean4.374526809803767
driven_any_median4.462851533990399
driven_any_min3.0033275069964644
driven_lanedir_consec_max2.6288304380770553
driven_lanedir_consec_mean1.715964326069097
driven_lanedir_consec_min1.1450995544141374
driven_lanedir_max2.6288304380770553
driven_lanedir_mean1.715964326069097
driven_lanedir_median1.544963655892598
driven_lanedir_min1.1450995544141374
get_duckie_state_max1.3916502965179309e-06
get_duckie_state_mean1.307811688424607e-06
get_duckie_state_median1.3012344705878614e-06
get_duckie_state_min1.2371275160047744e-06
get_robot_state_max0.003917863190436678
get_robot_state_mean0.003830626814338633
get_robot_state_median0.003839068641450262
get_robot_state_min0.00372650678401733
get_state_dump_max0.0049750681276674626
get_state_dump_mean0.004829573551828987
get_state_dump_median0.0048689380759014585
get_state_dump_min0.004605349927845568
get_ui_image_max0.03677967987438239
get_ui_image_mean0.032511466233983884
get_ui_image_median0.03269823868712121
get_ui_image_min0.02786970768731071
in-drivable-lane_max10.40000000000006
in-drivable-lane_mean7.037500000000036
in-drivable-lane_min4.499999999999994
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.0033275069964644, "get_ui_image": 0.031144920801151693, "step_physics": 0.14291617773860865, "survival_time": 8.599999999999987, "driven_lanedir": 1.4447490295300331, "get_state_dump": 0.004902592973212975, "get_robot_state": 0.0037941891333960385, "sim_render-ego0": 0.003915449098355508, "get_duckie_state": 1.3450666659140173e-06, "in-drivable-lane": 4.499999999999994, "deviation-heading": 1.012134799253028, "agent_compute-ego0": 0.012482313751485306, "complete-iteration": 0.21358881658212295, "set_robot_commands": 0.0023261563626327956, "deviation-center-line": 0.35288792253312934, "driven_lanedir_consec": 1.4447490295300331, "sim_compute_sim_state": 0.00992594840209608, "sim_compute_performance-ego0": 0.002089716795551984}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.569076664237804, "get_ui_image": 0.03677967987438239, "step_physics": 0.19866966099628913, "survival_time": 15.10000000000008, "driven_lanedir": 1.6451782822551628, "get_state_dump": 0.004605349927845568, "get_robot_state": 0.00372650678401733, "sim_render-ego0": 0.003870405379695074, "get_duckie_state": 1.2574022752617058e-06, "in-drivable-lane": 10.40000000000006, "deviation-heading": 1.4561377290785384, "agent_compute-ego0": 0.012054035765896537, "complete-iteration": 0.2750537592192294, "set_robot_commands": 0.002224778971656321, "deviation-center-line": 0.4079342194719924, "driven_lanedir_consec": 1.6451782822551628, "sim_compute_sim_state": 0.0109662395892757, "sim_compute_performance-ego0": 0.0020704662839178207}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.884113727225866, "get_ui_image": 0.03425155657309073, "step_physics": 0.18637094056164777, "survival_time": 13.450000000000056, "driven_lanedir": 2.6288304380770553, "get_state_dump": 0.0049750681276674626, "get_robot_state": 0.003883948149504485, "sim_render-ego0": 0.003955747463085033, "get_duckie_state": 1.2371275160047744e-06, "in-drivable-lane": 5.800000000000059, "deviation-heading": 2.539187963474677, "agent_compute-ego0": 0.012907622478626393, "complete-iteration": 0.26263913136941414, "set_robot_commands": 0.002408670496057581, "deviation-center-line": 0.5445655649747693, "driven_lanedir_consec": 2.6288304380770553, "sim_compute_sim_state": 0.011685023484406648, "sim_compute_performance-ego0": 0.0021116230222913953}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.041589340754933, "get_ui_image": 0.02786970768731071, "step_physics": 0.15117396132011246, "survival_time": 11.300000000000026, "driven_lanedir": 1.1450995544141374, "get_state_dump": 0.004835283178589942, "get_robot_state": 0.003917863190436678, "sim_render-ego0": 0.003856734557298837, "get_duckie_state": 1.3916502965179309e-06, "in-drivable-lane": 7.450000000000031, "deviation-heading": 1.5516761947623343, "agent_compute-ego0": 0.012448287745404348, "complete-iteration": 0.21493901135112745, "set_robot_commands": 0.0023022874336410724, "deviation-center-line": 0.30954335285512685, "driven_lanedir_consec": 1.1450995544141374, "sim_compute_sim_state": 0.006397126529710409, "sim_compute_performance-ego0": 0.002048407357169668}}
set_robot_commands_max0.002408670496057581
set_robot_commands_mean0.0023154733159969428
set_robot_commands_median0.0023142218981369337
set_robot_commands_min0.002224778971656321
sim_compute_performance-ego0_max0.0021116230222913953
sim_compute_performance-ego0_mean0.002080053364732717
sim_compute_performance-ego0_median0.0020800915397349022
sim_compute_performance-ego0_min0.002048407357169668
sim_compute_sim_state_max0.011685023484406648
sim_compute_sim_state_mean0.009743584501372207
sim_compute_sim_state_median0.010446093995685891
sim_compute_sim_state_min0.006397126529710409
sim_render-ego0_max0.003955747463085033
sim_render-ego0_mean0.0038995841246086127
sim_render-ego0_median0.003892927239025291
sim_render-ego0_min0.003856734557298837
simulation-passed1
step_physics_max0.19866966099628913
step_physics_mean0.1697826851541645
step_physics_median0.16877245094088011
step_physics_min0.14291617773860865
survival_time_max15.10000000000008
survival_time_mean12.112500000000036
survival_time_min8.599999999999987
No reset possible
5408211675Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:13:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7551956088066822
survival_time_median8.100000000000005
deviation-center-line_median0.45910853166543214
in-drivable-lane_median2.8750000000000138


other stats
agent_compute-ego0_max0.01325629342277095
agent_compute-ego0_mean0.012825305256793956
agent_compute-ego0_median0.01292956554612448
agent_compute-ego0_min0.012185796512155908
complete-iteration_max0.33563350522240926
complete-iteration_mean0.26314367052677684
complete-iteration_median0.2565675950479753
complete-iteration_min0.2038059867887473
deviation-center-line_max2.9948719568581836
deviation-center-line_mean1.037780467156174
deviation-center-line_min0.2380328484356475
deviation-heading_max15.482995665358116
deviation-heading_mean5.066864135658571
deviation-heading_median1.8530342353850089
deviation-heading_min1.0783924065061492
driven_any_max23.593014169599893
driven_any_mean7.613379222145467
driven_any_median2.79449353623638
driven_any_min1.2715156465092128
driven_lanedir_consec_max12.111050257920992
driven_lanedir_consec_mean4.162818345356515
driven_lanedir_consec_min1.0298319058917036
driven_lanedir_max12.111050257920992
driven_lanedir_mean4.162818345356515
driven_lanedir_median1.7551956088066822
driven_lanedir_min1.0298319058917036
get_duckie_state_max2.6059705157612645e-06
get_duckie_state_mean2.423070451054019e-06
get_duckie_state_median2.4240176428243594e-06
get_duckie_state_min2.2382760028060927e-06
get_robot_state_max0.004199084245933677
get_robot_state_mean0.004081276457063517
get_robot_state_median0.004097283453568344
get_robot_state_min0.003931454675183705
get_state_dump_max0.0054014201434153435
get_state_dump_mean0.005337223298695643
get_state_dump_median0.005383524128548943
get_state_dump_min0.0051804247942693425
get_ui_image_max0.03876178486402645
get_ui_image_mean0.0326626690923918
get_ui_image_median0.03253864588704772
get_ui_image_min0.026811599731445312
in-drivable-lane_max24.54999999999957
in-drivable-lane_mean7.824999999999899
in-drivable-lane_min0.9999999999999964
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.93971081286246, "get_ui_image": 0.03168692046945745, "step_physics": 0.1720716487277638, "survival_time": 10.95000000000002, "driven_lanedir": 2.461679983182483, "get_state_dump": 0.005382999506863681, "get_robot_state": 0.004073809493671764, "sim_render-ego0": 0.004126645218242298, "get_duckie_state": 2.5380741466175424e-06, "in-drivable-lane": 3.8000000000000345, "deviation-heading": 2.603990213920719, "agent_compute-ego0": 0.01281670331954956, "complete-iteration": 0.246089552749287, "set_robot_commands": 0.0024643193591724743, "deviation-center-line": 0.6683852631220304, "driven_lanedir_consec": 2.461679983182483, "sim_compute_sim_state": 0.011060748317024924, "sim_compute_performance-ego0": 0.0023013602603565563}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2715156465092128, "get_ui_image": 0.03876178486402645, "step_physics": 0.2548365260279456, "survival_time": 4.249999999999993, "driven_lanedir": 1.048711234430881, "get_state_dump": 0.005384048750234204, "get_robot_state": 0.004120757413464923, "sim_render-ego0": 0.004124466762986294, "get_duckie_state": 2.6059705157612645e-06, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 1.0783924065061492, "agent_compute-ego0": 0.0130424277726994, "complete-iteration": 0.33563350522240926, "set_robot_commands": 0.0023968857388163723, "deviation-center-line": 0.2498318002088339, "driven_lanedir_consec": 1.048711234430881, "sim_compute_sim_state": 0.010595371556836503, "sim_compute_performance-ego0": 0.002265239870825479}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.649276259610299, "get_ui_image": 0.033390371304637984, "step_physics": 0.1923119302065867, "survival_time": 5.249999999999989, "driven_lanedir": 1.0298319058917036, "get_state_dump": 0.0054014201434153435, "get_robot_state": 0.004199084245933677, "sim_render-ego0": 0.004221756503267109, "get_duckie_state": 2.3099611390311764e-06, "in-drivable-lane": 1.949999999999993, "deviation-heading": 1.1020782568492988, "agent_compute-ego0": 0.01325629342277095, "complete-iteration": 0.2670456373466636, "set_robot_commands": 0.002534351258907678, "deviation-center-line": 0.2380328484356475, "driven_lanedir_consec": 1.0298319058917036, "sim_compute_sim_state": 0.009410727698847932, "sim_compute_performance-ego0": 0.002215826286459869}, "LF-norm-small_loop-000-ego0": {"driven_any": 23.593014169599893, "get_ui_image": 0.026811599731445312, "step_physics": 0.14057795153767938, "survival_time": 59.99999999999873, "driven_lanedir": 12.111050257920992, "get_state_dump": 0.0051804247942693425, "get_robot_state": 0.003931454675183705, "sim_render-ego0": 0.003937929099445835, "get_duckie_state": 2.2382760028060927e-06, "in-drivable-lane": 24.54999999999957, "deviation-heading": 15.482995665358116, "agent_compute-ego0": 0.012185796512155908, "complete-iteration": 0.2038059867887473, "set_robot_commands": 0.002371488661690616, "deviation-center-line": 2.9948719568581836, "driven_lanedir_consec": 12.111050257920992, "sim_compute_sim_state": 0.006514425380938655, "sim_compute_performance-ego0": 0.0022012129314336847}}
set_robot_commands_max0.002534351258907678
set_robot_commands_mean0.002441761254646785
set_robot_commands_median0.0024306025489944233
set_robot_commands_min0.002371488661690616
sim_compute_performance-ego0_max0.0023013602603565563
sim_compute_performance-ego0_mean0.002245909837268898
sim_compute_performance-ego0_median0.0022405330786426743
sim_compute_performance-ego0_min0.0022012129314336847
sim_compute_sim_state_max0.011060748317024924
sim_compute_sim_state_mean0.009395318238412003
sim_compute_sim_state_median0.01000304962784222
sim_compute_sim_state_min0.006514425380938655
sim_render-ego0_max0.004221756503267109
sim_render-ego0_mean0.004102699395985384
sim_render-ego0_median0.004125555990614297
sim_render-ego0_min0.003937929099445835
simulation-passed1
step_physics_max0.2548365260279456
step_physics_mean0.18994951412499383
step_physics_median0.1821917894671753
step_physics_min0.14057795153767938
survival_time_max59.99999999999873
survival_time_mean20.112499999999685
survival_time_min4.249999999999993
No reset possible
5402411689Mo Kleit 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:16:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.888701981206721
survival_time_median26.700000000000088
deviation-center-line_median1.19251596391243
in-drivable-lane_median10.550000000000022


other stats
agent_compute-ego0_max0.013022783289088648
agent_compute-ego0_mean0.012912543603924707
agent_compute-ego0_median0.012920137032327531
agent_compute-ego0_min0.01278711706195512
complete-iteration_max0.2829570422569911
complete-iteration_mean0.24750133363331123
complete-iteration_median0.25298740362010186
complete-iteration_min0.20107348503605013
deviation-center-line_max2.262849534868761
deviation-center-line_mean1.1905099224047069
deviation-center-line_min0.1141582269252077
deviation-heading_max9.943268617547533
deviation-heading_mean5.871773548591414
deviation-heading_median6.368633736465682
deviation-heading_min0.8065581038867561
driven_any_max15.159544096153176
driven_any_mean9.236123919686785
driven_any_median10.162275974117708
driven_any_min1.4603996343585504
driven_lanedir_consec_max8.998609010568613
driven_lanedir_consec_mean4.829326210978145
driven_lanedir_consec_min0.5412918709305261
driven_lanedir_max8.998609010568613
driven_lanedir_mean4.859431869923382
driven_lanedir_median4.946651592923067
driven_lanedir_min0.5458152832787806
get_duckie_state_max1.564621925354004e-06
get_duckie_state_mean1.3873942517963963e-06
get_duckie_state_median1.3967806805212712e-06
get_duckie_state_min1.1913937207890396e-06
get_robot_state_max0.003907748864674928
get_robot_state_mean0.003794297503357814
get_robot_state_median0.0037912953885789152
get_robot_state_min0.0036868503715984983
get_state_dump_max0.006271353215416156
get_state_dump_mean0.005189362070103244
get_state_dump_median0.0048561203810903765
get_state_dump_min0.004773854302816065
get_ui_image_max0.036399103701114655
get_ui_image_mean0.03183726503315551
get_ui_image_median0.03193124411274944
get_ui_image_min0.02708746820600851
in-drivable-lane_max15.849999999999886
in-drivable-lane_mean9.94999999999998
in-drivable-lane_min2.8499999999999908
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.032948782765946, "get_ui_image": 0.030121852013963404, "step_physics": 0.16589110803538715, "survival_time": 36.40000000000007, "driven_lanedir": 8.998609010568613, "get_state_dump": 0.004912005530463325, "get_robot_state": 0.003907748864674928, "sim_render-ego0": 0.003966908396026234, "get_duckie_state": 1.457329476648234e-06, "in-drivable-lane": 11.199999999999958, "deviation-heading": 9.3240090558775, "agent_compute-ego0": 0.01278711706195512, "complete-iteration": 0.2363897148310239, "set_robot_commands": 0.002448591185204777, "deviation-center-line": 2.262849534868761, "driven_lanedir_consec": 8.998609010568613, "sim_compute_sim_state": 0.010053606844406232, "sim_compute_performance-ego0": 0.0022066790707644447}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.4603996343585504, "get_ui_image": 0.036399103701114655, "step_physics": 0.20642392337322235, "survival_time": 4.749999999999991, "driven_lanedir": 0.5458152832787806, "get_state_dump": 0.004800235231717427, "get_robot_state": 0.00371419886747996, "sim_render-ego0": 0.003899720807870229, "get_duckie_state": 1.564621925354004e-06, "in-drivable-lane": 2.8499999999999908, "deviation-heading": 0.8065581038867561, "agent_compute-ego0": 0.013009930650393168, "complete-iteration": 0.2829570422569911, "set_robot_commands": 0.002345395584901174, "deviation-center-line": 0.1141582269252077, "driven_lanedir_consec": 0.5412918709305261, "sim_compute_sim_state": 0.01020933190981547, "sim_compute_performance-ego0": 0.0020623629291852317}, "LF-norm-techtrack-000-ego0": {"driven_any": 15.159544096153176, "get_ui_image": 0.033740636211535474, "step_physics": 0.1928279868247995, "survival_time": 39.3999999999999, "driven_lanedir": 7.741301393242652, "get_state_dump": 0.004773854302816065, "get_robot_state": 0.0038683919096778705, "sim_render-ego0": 0.003948114972906269, "get_duckie_state": 1.3362318843943085e-06, "in-drivable-lane": 15.849999999999886, "deviation-heading": 9.943268617547533, "agent_compute-ego0": 0.013022783289088648, "complete-iteration": 0.2695850924091798, "set_robot_commands": 0.002356534675046971, "deviation-center-line": 1.9066464938221457, "driven_lanedir_consec": 7.62540216980996, "sim_compute_sim_state": 0.012812912086419128, "sim_compute_performance-ego0": 0.002140206529160416}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.291603165469468, "get_ui_image": 0.02708746820600851, "step_physics": 0.136509935177666, "survival_time": 17.000000000000107, "driven_lanedir": 2.152001792603483, "get_state_dump": 0.006271353215416156, "get_robot_state": 0.0036868503715984983, "sim_render-ego0": 0.003871659729138148, "get_duckie_state": 1.1913937207890396e-06, "in-drivable-lane": 9.900000000000084, "deviation-heading": 3.413258417053865, "agent_compute-ego0": 0.012830343414261891, "complete-iteration": 0.20107348503605013, "set_robot_commands": 0.0023991872837816164, "deviation-center-line": 0.4783854340027145, "driven_lanedir_consec": 2.152001792603483, "sim_compute_sim_state": 0.006275272788889597, "sim_compute_performance-ego0": 0.0020531608212378716}}
set_robot_commands_max0.002448591185204777
set_robot_commands_mean0.002387427182233635
set_robot_commands_median0.002377860979414294
set_robot_commands_min0.002345395584901174
sim_compute_performance-ego0_max0.0022066790707644447
sim_compute_performance-ego0_mean0.0021156023375869908
sim_compute_performance-ego0_median0.002101284729172824
sim_compute_performance-ego0_min0.0020531608212378716
sim_compute_sim_state_max0.012812912086419128
sim_compute_sim_state_mean0.009837780907382607
sim_compute_sim_state_median0.01013146937711085
sim_compute_sim_state_min0.006275272788889597
sim_render-ego0_max0.003966908396026234
sim_render-ego0_mean0.00392160097648522
sim_render-ego0_median0.003923917890388249
sim_render-ego0_min0.003871659729138148
simulation-passed1
step_physics_max0.20642392337322235
step_physics_mean0.17541323835276876
step_physics_median0.17935954743009336
step_physics_min0.136509935177666
survival_time_max39.3999999999999
survival_time_mean24.387500000000017
survival_time_min4.749999999999991
No reset possible
5395311707Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:37:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.434574587429797
survival_time_median57.949999999998845
deviation-center-line_median2.866753009988283
in-drivable-lane_median6.649999999999622


other stats
agent_compute-ego0_max0.0136578432463236
agent_compute-ego0_mean0.013338000158940736
agent_compute-ego0_median0.0133216334522119
agent_compute-ego0_min0.01305089048501554
complete-iteration_max0.24077420707682184
complete-iteration_mean0.2209420574199259
complete-iteration_median0.2264302201711764
complete-iteration_min0.1901335822605289
deviation-center-line_max3.4598827736688027
deviation-center-line_mean2.913963384094215
deviation-center-line_min2.462464742731491
deviation-heading_max15.53131535592944
deviation-heading_mean13.224057336101689
deviation-heading_median13.380383136222497
deviation-heading_min10.604147716032315
driven_any_max11.724027045326793
driven_any_mean10.742029882152169
driven_any_median10.801598964627654
driven_any_min9.640894554026575
driven_lanedir_consec_max11.213132112119046
driven_lanedir_consec_mean9.187721426903064
driven_lanedir_consec_min6.668604420633611
driven_lanedir_max11.213132112119046
driven_lanedir_mean9.187721426903064
driven_lanedir_median9.434574587429797
driven_lanedir_min6.668604420633611
get_duckie_state_max1.970873982781276e-06
get_duckie_state_mean1.8596113110364864e-06
get_duckie_state_median1.8506354873615331e-06
get_duckie_state_min1.7663002866416024e-06
get_robot_state_max0.004017171018030324
get_robot_state_mean0.003932151962542024
get_robot_state_median0.0039253215951874035
get_robot_state_min0.003860793641762968
get_state_dump_max0.004916162117633295
get_state_dump_mean0.004811924418917394
get_state_dump_median0.004823099079732968
get_state_dump_min0.004685337398570345
get_ui_image_max0.03786200825915944
get_ui_image_mean0.03324431347550673
get_ui_image_median0.03359818931191906
get_ui_image_min0.02791886701902935
in-drivable-lane_max16.19999999999908
in-drivable-lane_mean7.374999999999581
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.724027045326793, "get_ui_image": 0.03197335799865977, "step_physics": 0.13919790479960192, "survival_time": 59.99999999999873, "driven_lanedir": 11.213132112119046, "get_state_dump": 0.004916162117633295, "get_robot_state": 0.004017171018030324, "sim_render-ego0": 0.004092889661892169, "get_duckie_state": 1.970873982781276e-06, "in-drivable-lane": 0.0, "deviation-heading": 15.058190068485484, "agent_compute-ego0": 0.013490064654322488, "complete-iteration": 0.21268352243326585, "set_robot_commands": 0.002474702466635978, "deviation-center-line": 3.2141036087645056, "driven_lanedir_consec": 11.213132112119046, "sim_compute_sim_state": 0.010194823108644509, "sim_compute_performance-ego0": 0.0022336833185200686}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.70012399734769, "get_ui_image": 0.03786200825915944, "step_physics": 0.15786330805134516, "survival_time": 59.99999999999873, "driven_lanedir": 11.134116424479414, "get_state_dump": 0.004685337398570345, "get_robot_state": 0.003860793641762968, "sim_render-ego0": 0.003952996121358117, "get_duckie_state": 1.800348121458843e-06, "in-drivable-lane": 0.0, "deviation-heading": 15.53131535592944, "agent_compute-ego0": 0.01305089048501554, "complete-iteration": 0.240176917909087, "set_robot_commands": 0.00234626492890192, "deviation-center-line": 3.4598827736688027, "driven_lanedir_consec": 11.134116424479414, "sim_compute_sim_state": 0.014278114288673116, "sim_compute_performance-ego0": 0.002187358449638932}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.903073931907617, "get_ui_image": 0.03522302062517836, "step_physics": 0.16025502070238593, "survival_time": 55.89999999999896, "driven_lanedir": 7.735032750380181, "get_state_dump": 0.004843855032013185, "get_robot_state": 0.00394968692482956, "sim_render-ego0": 0.004059177727652406, "get_duckie_state": 1.7663002866416024e-06, "in-drivable-lane": 13.299999999999244, "deviation-heading": 11.702576203959508, "agent_compute-ego0": 0.0136578432463236, "complete-iteration": 0.24077420707682184, "set_robot_commands": 0.002449276406813989, "deviation-center-line": 2.519402411212061, "driven_lanedir_consec": 7.735032750380181, "sim_compute_sim_state": 0.014042262417381634, "sim_compute_performance-ego0": 0.0022025138166357726}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.640894554026575, "get_ui_image": 0.02791886701902935, "step_physics": 0.1255445792772513, "survival_time": 53.74999999999908, "driven_lanedir": 6.668604420633611, "get_state_dump": 0.004802343127452751, "get_robot_state": 0.003900956265545246, "sim_render-ego0": 0.003925644110569723, "get_duckie_state": 1.900922853264224e-06, "in-drivable-lane": 16.19999999999908, "deviation-heading": 10.604147716032315, "agent_compute-ego0": 0.013153202250101309, "complete-iteration": 0.1901335822605289, "set_robot_commands": 0.002377297798497083, "deviation-center-line": 2.462464742731491, "driven_lanedir_consec": 6.668604420633611, "sim_compute_sim_state": 0.006274638565942701, "sim_compute_performance-ego0": 0.0021470395162646212}}
set_robot_commands_max0.002474702466635978
set_robot_commands_mean0.0024118854002122426
set_robot_commands_median0.002413287102655536
set_robot_commands_min0.00234626492890192
sim_compute_performance-ego0_max0.0022336833185200686
sim_compute_performance-ego0_mean0.002192648775264849
sim_compute_performance-ego0_median0.0021949361331373525
sim_compute_performance-ego0_min0.0021470395162646212
sim_compute_sim_state_max0.014278114288673116
sim_compute_sim_state_mean0.01119745959516049
sim_compute_sim_state_median0.012118542763013072
sim_compute_sim_state_min0.006274638565942701
sim_render-ego0_max0.004092889661892169
sim_render-ego0_mean0.004007676905368104
sim_render-ego0_median0.004006086924505261
sim_render-ego0_min0.003925644110569723
simulation-passed1
step_physics_max0.16025502070238593
step_physics_mean0.14571520320764608
step_physics_median0.14853060642547355
step_physics_min0.1255445792772513
survival_time_max59.99999999999873
survival_time_mean57.41249999999888
survival_time_min53.74999999999908
No reset possible
539199782Anastasiya Nikolskaya 🇷🇺jbr_sim2realaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:03:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible