Duckietown Challenges Home Challenges Submissions

Evaluator 4865

ID4865
evaluatornogpu-prod-02
ownerI don't have one 😀
machinenogpu-prod_a8e30adf9fbd
processnogpu-prod-02_a8e30adf9fbd
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success19 53907
# timeout1 57522
# failed2 55031
# error1 54127
# aborted2 57304
# host-error39 54427
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5752210904Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutyesnogpu-prod-02----No reset possible
5741710928Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:25:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8965144012501016
survival_time_median55.174999999999
deviation-center-line_median0.8168455691842168
in-drivable-lane_median17.324999999999665


other stats
agent_compute-ego0_max0.025558872087909024
agent_compute-ego0_mean0.01653865026527337
agent_compute-ego0_median0.014480644511798072
agent_compute-ego0_min0.011634439949588316
complete-iteration_max0.2008525862985728
complete-iteration_mean0.17449657884177278
complete-iteration_median0.17497556860984612
complete-iteration_min0.14718259184882604
deviation-center-line_max1.1555265755730286
deviation-center-line_mean0.7533356049267621
deviation-center-line_min0.2241247057655863
deviation-heading_max7.777702336477427
deviation-heading_mean4.738993891060474
deviation-heading_median4.712951216395885
deviation-heading_min1.7523707949726983
driven_any_max7.7425178219113
driven_any_mean5.104245996882837
driven_any_median6.171186987426598
driven_any_min0.3320921907668547
driven_lanedir_consec_max6.769790520087862
driven_lanedir_consec_mean2.683697823781471
driven_lanedir_consec_min0.1719719725378197
driven_lanedir_max6.769790520087862
driven_lanedir_mean2.7079531498052063
driven_lanedir_median1.9450250532975717
driven_lanedir_min0.1719719725378197
get_duckie_state_max1.4144276815747458e-06
get_duckie_state_mean1.176164489071414e-06
get_duckie_state_median1.1299642524524125e-06
get_duckie_state_min1.0303017698060862e-06
get_robot_state_max0.003876820679694887
get_robot_state_mean0.003504049648874196
get_robot_state_median0.003443399337209532
get_robot_state_min0.0032525792413828324
get_state_dump_max0.00480856734608847
get_state_dump_mean0.004566691560645472
get_state_dump_median0.0046250952902775104
get_state_dump_min0.004208008315938399
get_ui_image_max0.031968344535146444
get_ui_image_mean0.028533002034476132
get_ui_image_median0.028504604589268817
get_ui_image_min0.025154454424220457
in-drivable-lane_max41.94999999999861
in-drivable-lane_mean19.149999999999483
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.7425178219113, "get_ui_image": 0.025956802225232025, "step_physics": 0.08631740660591983, "survival_time": 59.99999999999873, "driven_lanedir": 2.040668587298849, "get_state_dump": 0.004208008315938399, "get_robot_state": 0.00333106666679287, "sim_render-ego0": 0.0035059219792323943, "get_duckie_state": 1.0303017698060862e-06, "in-drivable-lane": 41.94999999999861, "deviation-heading": 3.427407961173817, "agent_compute-ego0": 0.011634439949588316, "complete-iteration": 0.14718259184882604, "set_robot_commands": 0.0019167670600122456, "deviation-center-line": 0.6809278041202681, "driven_lanedir_consec": 2.040668587298849, "sim_compute_sim_state": 0.00847930654101725, "sim_compute_performance-ego0": 0.0017534016967316057}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3320921907668547, "get_ui_image": 0.031052406953305613, "step_physics": 0.13042960361558564, "survival_time": 4.849999999999991, "driven_lanedir": 0.1719719725378197, "get_state_dump": 0.0044654534787547835, "get_robot_state": 0.0032525792413828324, "sim_render-ego0": 0.0034452944385762116, "get_duckie_state": 1.1069434029715405e-06, "in-drivable-lane": 1.8999999999999932, "deviation-heading": 1.7523707949726983, "agent_compute-ego0": 0.015538300786699568, "complete-iteration": 0.2008525862985728, "set_robot_commands": 0.001917235705317283, "deviation-center-line": 0.2241247057655863, "driven_lanedir_consec": 0.1719719725378197, "sim_compute_sim_state": 0.008959419873295998, "sim_compute_performance-ego0": 0.0017095658243918906}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.488316054502533, "get_ui_image": 0.031968344535146444, "step_physics": 0.11468105514844258, "survival_time": 50.34999999999928, "driven_lanedir": 1.8493815192962944, "get_state_dump": 0.00480856734608847, "get_robot_state": 0.003876820679694887, "sim_render-ego0": 0.0041246915620470805, "get_duckie_state": 1.4144276815747458e-06, "in-drivable-lane": 32.74999999999934, "deviation-heading": 5.998494471617953, "agent_compute-ego0": 0.013422988236896576, "complete-iteration": 0.18746224589764127, "set_robot_commands": 0.0023155801353000457, "deviation-center-line": 0.9527633342481656, "driven_lanedir_consec": 1.752360215201354, "sim_compute_sim_state": 0.00999644777131459, "sim_compute_performance-ego0": 0.0021651649758929296}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.854057920350663, "get_ui_image": 0.025154454424220457, "step_physics": 0.08975872727456835, "survival_time": 59.99999999999873, "driven_lanedir": 6.769790520087862, "get_state_dump": 0.004784737101800237, "get_robot_state": 0.003555732007626193, "sim_render-ego0": 0.0036510075260260816, "get_duckie_state": 1.152985101933285e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.777702336477427, "agent_compute-ego0": 0.025558872087909024, "complete-iteration": 0.16248889132205097, "set_robot_commands": 0.0021046401062774023, "deviation-center-line": 1.1555265755730286, "driven_lanedir_consec": 6.769790520087862, "sim_compute_sim_state": 0.005966483107415167, "sim_compute_performance-ego0": 0.0018670173807009173}}
set_robot_commands_max0.0023155801353000457
set_robot_commands_mean0.002063555751726744
set_robot_commands_median0.0020109379057973425
set_robot_commands_min0.0019167670600122456
sim_compute_performance-ego0_max0.0021651649758929296
sim_compute_performance-ego0_mean0.0018737874694293357
sim_compute_performance-ego0_median0.0018102095387162616
sim_compute_performance-ego0_min0.0017095658243918906
sim_compute_sim_state_max0.00999644777131459
sim_compute_sim_state_mean0.008350414323260752
sim_compute_sim_state_median0.008719363207156624
sim_compute_sim_state_min0.005966483107415167
sim_render-ego0_max0.0041246915620470805
sim_render-ego0_mean0.003681728876470442
sim_render-ego0_median0.003578464752629238
sim_render-ego0_min0.0034452944385762116
simulation-passed1
step_physics_max0.13042960361558564
step_physics_mean0.1052966981611291
step_physics_median0.10221989121150546
step_physics_min0.08631740660591983
survival_time_max59.99999999999873
survival_time_mean43.79999999999918
survival_time_min4.849999999999991
No reset possible
5739611012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-020:04:23
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5738311426Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-testingLFP-simhost-erroryesnogpu-prod-020:02:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5733910958Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:05:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.32030713358090535
survival_time_median9.100000000000003
deviation-center-line_median0.12134842803003924
in-drivable-lane_median6.224999999999993


other stats
agent_compute-ego0_max0.013695750203165977
agent_compute-ego0_mean0.012795678646355613
agent_compute-ego0_median0.01255850283019746
agent_compute-ego0_min0.012369958721861548
complete-iteration_max0.22518764466655497
complete-iteration_mean0.1777071615383468
complete-iteration_median0.1682694059355646
complete-iteration_min0.14910218961570296
deviation-center-line_max0.3427116906268281
deviation-center-line_mean0.16891125467680612
deviation-center-line_min0.09023647202031788
deviation-heading_max1.9666583636390955
deviation-heading_mean1.0045028091277708
deviation-heading_median0.800649291381822
deviation-heading_min0.4500542901083434
driven_any_max2.4131910380208654
driven_any_mean1.5336196089416916
driven_any_median1.4938643883740794
driven_any_min0.7335586209977425
driven_lanedir_consec_max0.5836217339116626
driven_lanedir_consec_mean0.38284293357136207
driven_lanedir_consec_min0.30713573321197485
driven_lanedir_max0.5836217339116626
driven_lanedir_mean0.38284293357136207
driven_lanedir_median0.32030713358090535
driven_lanedir_min0.30713573321197485
get_duckie_state_max2.2236181765186544e-06
get_duckie_state_mean2.0602762338893965e-06
get_duckie_state_median2.0262022396345517e-06
get_duckie_state_min1.965082279769829e-06
get_robot_state_max0.003708605863610093
get_robot_state_mean0.0035677230183387794
get_robot_state_median0.0035818220997930316
get_robot_state_min0.0033986420101589625
get_state_dump_max0.004728246708305514
get_state_dump_mean0.004560573815826061
get_state_dump_median0.0045549786248979115
get_state_dump_min0.004404091305202908
get_ui_image_max0.034579250277305136
get_ui_image_mean0.02923382744279982
get_ui_image_median0.028416855985468087
get_ui_image_min0.025522347522957976
in-drivable-lane_max9.50000000000002
in-drivable-lane_mean6.025
in-drivable-lane_min2.1499999999999924
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4131910380208654, "get_ui_image": 0.0264106559753418, "step_physics": 0.08882145563761393, "survival_time": 11.200000000000024, "driven_lanedir": 0.5836217339116626, "get_state_dump": 0.004404091305202908, "get_robot_state": 0.0033986420101589625, "sim_render-ego0": 0.003754316965738932, "get_duckie_state": 1.9900004069010415e-06, "in-drivable-lane": 7.000000000000005, "deviation-heading": 1.9666583636390955, "agent_compute-ego0": 0.012425460815429688, "complete-iteration": 0.15221436394585502, "set_robot_commands": 0.0020996507008870444, "deviation-center-line": 0.3427116906268281, "driven_lanedir_consec": 0.5836217339116626, "sim_compute_sim_state": 0.00893641471862793, "sim_compute_performance-ego0": 0.0018779818216959636}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.7335586209977425, "get_ui_image": 0.034579250277305136, "step_physics": 0.15158758114795295, "survival_time": 4.849999999999991, "driven_lanedir": 0.30713573321197485, "get_state_dump": 0.004728246708305514, "get_robot_state": 0.003708605863610093, "sim_render-ego0": 0.0038634465665233378, "get_duckie_state": 2.2236181765186544e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 1.1061713881252733, "agent_compute-ego0": 0.012369958721861548, "complete-iteration": 0.22518764466655497, "set_robot_commands": 0.002193339016972756, "deviation-center-line": 0.14463582949929563, "driven_lanedir_consec": 0.30713573321197485, "sim_compute_sim_state": 0.010125658950027157, "sim_compute_performance-ego0": 0.0019398465448496292}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.5820847195257814, "get_ui_image": 0.030423055995594372, "step_physics": 0.11629133124451538, "survival_time": 7.099999999999983, "driven_lanedir": 0.3234022870673947, "get_state_dump": 0.00452751046294099, "get_robot_state": 0.0034934307311798307, "sim_render-ego0": 0.00373927363148936, "get_duckie_state": 2.0624040723680615e-06, "in-drivable-lane": 5.4499999999999815, "deviation-heading": 0.49512719463837074, "agent_compute-ego0": 0.013695750203165977, "complete-iteration": 0.1843244479252742, "set_robot_commands": 0.0020352910448621204, "deviation-center-line": 0.09023647202031788, "driven_lanedir_consec": 0.3234022870673947, "sim_compute_sim_state": 0.008147348057140003, "sim_compute_performance-ego0": 0.001885842610072423}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.4056440572223772, "get_ui_image": 0.025522347522957976, "step_physics": 0.08896444517400767, "survival_time": 11.100000000000025, "driven_lanedir": 0.317211980094416, "get_state_dump": 0.0045824467868548335, "get_robot_state": 0.003670213468406233, "sim_render-ego0": 0.003944744443679604, "get_duckie_state": 1.965082279769829e-06, "in-drivable-lane": 9.50000000000002, "deviation-heading": 0.4500542901083434, "agent_compute-ego0": 0.012691544844965229, "complete-iteration": 0.14910218961570296, "set_robot_commands": 0.002326069391361801, "deviation-center-line": 0.09806102656078286, "driven_lanedir_consec": 0.317211980094416, "sim_compute_sim_state": 0.005310252108381468, "sim_compute_performance-ego0": 0.0020033767939683033}}
set_robot_commands_max0.002326069391361801
set_robot_commands_mean0.0021635875385209303
set_robot_commands_median0.0021464948589299
set_robot_commands_min0.0020352910448621204
sim_compute_performance-ego0_max0.0020033767939683033
sim_compute_performance-ego0_mean0.0019267619426465796
sim_compute_performance-ego0_median0.001912844577461026
sim_compute_performance-ego0_min0.0018779818216959636
sim_compute_sim_state_max0.010125658950027157
sim_compute_sim_state_mean0.00812991845854414
sim_compute_sim_state_median0.008541881387883966
sim_compute_sim_state_min0.005310252108381468
sim_render-ego0_max0.003944744443679604
sim_render-ego0_mean0.003825445401857809
sim_render-ego0_median0.003808881766131135
sim_render-ego0_min0.00373927363148936
simulation-passed1
step_physics_max0.15158758114795295
step_physics_mean0.11141620330102248
step_physics_median0.10262788820926153
step_physics_min0.08882145563761393
survival_time_max11.200000000000024
survival_time_mean8.562500000000005
survival_time_min4.849999999999991
No reset possible
5731811313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-020:03:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5730411010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-020:02:50
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5712511014Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:42:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012762842527734151
agent_compute-ego0_mean0.01251531232902152
agent_compute-ego0_median0.012459026883781995
agent_compute-ego0_min0.012380353020787934
complete-iteration_max0.34571400788503326
complete-iteration_mean0.2930612764092508
complete-iteration_median0.2922909082123679
complete-iteration_min0.24194928132723412
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.2988948901428172e-06
get_duckie_state_mean1.227428871427944e-06
get_duckie_state_median1.220877819712414e-06
get_duckie_state_min1.1690649561441312e-06
get_robot_state_max0.0037017565384991065
get_robot_state_mean0.003655775699091394
get_robot_state_median0.0036708419269368014
get_robot_state_min0.003579662403992868
get_state_dump_max0.004661305758677156
get_state_dump_mean0.004588018746102085
get_state_dump_median0.004607730463680677
get_state_dump_min0.004475308298369828
get_ui_image_max0.03530497674044721
get_ui_image_mean0.030501395339870535
get_ui_image_median0.030169769588060724
get_ui_image_min0.026361065442913476
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.028137911964117936, "step_physics": 0.21051306927035393, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004615980024440997, "get_robot_state": 0.003579662403992868, "sim_render-ego0": 0.0038132097798521374, "get_duckie_state": 1.253037528134107e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.012454801951717278, "complete-iteration": 0.27571318350068535, "set_robot_commands": 0.0021581929688846736, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008404567180128518, "sim_compute_performance-ego0": 0.001951017546514786}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03530497674044721, "step_physics": 0.26931573330214575, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004661305758677156, "get_robot_state": 0.003691906337436291, "sim_render-ego0": 0.003941070030968354, "get_duckie_state": 1.1690649561441312e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.012762842527734151, "complete-iteration": 0.34571400788503326, "set_robot_commands": 0.0022180435758744747, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.011522167032703968, "sim_compute_performance-ego0": 0.0022080966971696763}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03220162721200351, "step_physics": 0.239232346973848, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004475308298369828, "get_robot_state": 0.003649777516437311, "sim_render-ego0": 0.003799899829416648, "get_duckie_state": 1.1887181112907213e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012463251815846718, "complete-iteration": 0.30886863292405053, "set_robot_commands": 0.00217640151786963, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008837472389977143, "sim_compute_performance-ego0": 0.0019452333648834104}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.026361065442913476, "step_physics": 0.18064641813552945, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004599480902920357, "get_robot_state": 0.0037017565384991065, "sim_render-ego0": 0.003856423296201834, "get_duckie_state": 1.2988948901428172e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.012380353020787934, "complete-iteration": 0.24194928132723412, "set_robot_commands": 0.002215699887494064, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0061072392030917634, "sim_compute_performance-ego0": 0.0019926528549511963}}
set_robot_commands_max0.0022180435758744747
set_robot_commands_mean0.00219208448753071
set_robot_commands_median0.0021960507026818473
set_robot_commands_min0.0021581929688846736
sim_compute_performance-ego0_max0.0022080966971696763
sim_compute_performance-ego0_mean0.002024250115879767
sim_compute_performance-ego0_median0.001971835200732991
sim_compute_performance-ego0_min0.0019452333648834104
sim_compute_sim_state_max0.011522167032703968
sim_compute_sim_state_mean0.008717861451475349
sim_compute_sim_state_median0.00862101978505283
sim_compute_sim_state_min0.0061072392030917634
sim_render-ego0_max0.003941070030968354
sim_render-ego0_mean0.003852650734109743
sim_render-ego0_median0.0038348165380269863
sim_render-ego0_min0.003799899829416648
simulation-passed1
step_physics_max0.26931573330214575
step_physics_mean0.22492689192046927
step_physics_median0.22487270812210097
step_physics_min0.18064641813552945
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5712011312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-020:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5697911045Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:24:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.423241119801212
survival_time_median40.14999999999967
deviation-center-line_median1.2237636068275957
in-drivable-lane_median11.25000000000016


other stats
agent_compute-ego0_max0.012688317628049138
agent_compute-ego0_mean0.01221108659023355
agent_compute-ego0_median0.012095273320134842
agent_compute-ego0_min0.011965482092615384
complete-iteration_max0.19894250019176588
complete-iteration_mean0.18139664733123023
complete-iteration_median0.18322312920840816
complete-iteration_min0.16019783071633878
deviation-center-line_max1.70224764388127
deviation-center-line_mean1.2301125753574849
deviation-center-line_min0.7706754438934779
deviation-heading_max13.201256968504396
deviation-heading_mean7.991483425791287
deviation-heading_median6.9063653164167675
deviation-heading_min4.951946101827219
driven_any_max5.329585632509499
driven_any_mean3.800797662164461
driven_any_median3.793661665266468
driven_any_min2.286281685615407
driven_lanedir_consec_max3.665393939993251
driven_lanedir_consec_mean2.5667573461556388
driven_lanedir_consec_min1.75515320502688
driven_lanedir_max3.665393939993251
driven_lanedir_mean2.5667573461556388
driven_lanedir_median2.423241119801212
driven_lanedir_min1.75515320502688
get_duckie_state_max2.03100603018234e-06
get_duckie_state_mean1.9187801532919223e-06
get_duckie_state_median1.8917415520929968e-06
get_duckie_state_min1.860631478799356e-06
get_robot_state_max0.0036929002893504818
get_robot_state_mean0.003554919673516053
get_robot_state_median0.0035541656033095913
get_robot_state_min0.0034184471980945484
get_state_dump_max0.004657520509477871
get_state_dump_mean0.004517307776292674
get_state_dump_median0.004505200799754723
get_state_dump_min0.0044013089961833785
get_ui_image_max0.03334975564802015
get_ui_image_mean0.029480122777564857
get_ui_image_median0.029579312498889752
get_ui_image_min0.025412110464459754
in-drivable-lane_max22.39999999999947
in-drivable-lane_mean11.937499999999956
in-drivable-lane_min2.8500000000000405
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.57173854336769, "get_ui_image": 0.02708317183736545, "step_physics": 0.10797873139381409, "survival_time": 26.750000000000245, "driven_lanedir": 1.75515320502688, "get_state_dump": 0.004438696957346219, "get_robot_state": 0.0035071888966346854, "sim_render-ego0": 0.0036685738100934386, "get_duckie_state": 1.8828840398076756e-06, "in-drivable-lane": 8.850000000000126, "deviation-heading": 4.951946101827219, "agent_compute-ego0": 0.011965482092615384, "complete-iteration": 0.1718969167168461, "set_robot_commands": 0.0020412193305456815, "deviation-center-line": 0.9511352046037148, "driven_lanedir_consec": 1.75515320502688, "sim_compute_sim_state": 0.009281763834739798, "sim_compute_performance-ego0": 0.0018527223103082}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.286281685615407, "get_ui_image": 0.03334975564802015, "step_physics": 0.12776765039375235, "survival_time": 22.15000000000018, "driven_lanedir": 1.873644705740616, "get_state_dump": 0.0044013089961833785, "get_robot_state": 0.0034184471980945484, "sim_render-ego0": 0.0036686444067740224, "get_duckie_state": 1.860631478799356e-06, "in-drivable-lane": 2.8500000000000405, "deviation-heading": 5.86674343516079, "agent_compute-ego0": 0.012043069611798535, "complete-iteration": 0.19894250019176588, "set_robot_commands": 0.002026119210698583, "deviation-center-line": 0.7706754438934779, "driven_lanedir_consec": 1.873644705740616, "sim_compute_sim_state": 0.010334393999598047, "sim_compute_performance-ego0": 0.0018513245625538868}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.329585632509499, "get_ui_image": 0.032075453160414054, "step_physics": 0.12285277492074824, "survival_time": 53.549999999999095, "driven_lanedir": 2.9728375338618083, "get_state_dump": 0.004657520509477871, "get_robot_state": 0.0036929002893504818, "sim_render-ego0": 0.003879157464895675, "get_duckie_state": 2.03100603018234e-06, "in-drivable-lane": 22.39999999999947, "deviation-heading": 7.945987197672744, "agent_compute-ego0": 0.012688317628049138, "complete-iteration": 0.1945493416999703, "set_robot_commands": 0.0022233571134396453, "deviation-center-line": 1.4963920090514766, "driven_lanedir_consec": 2.9728375338618083, "sim_compute_sim_state": 0.010453104305623184, "sim_compute_performance-ego0": 0.001943245085317697}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.0155847871652455, "get_ui_image": 0.025412110464459754, "step_physics": 0.10057014926684886, "survival_time": 59.99999999999873, "driven_lanedir": 3.665393939993251, "get_state_dump": 0.004571704642163228, "get_robot_state": 0.0036011423099844976, "sim_render-ego0": 0.0037725599084071177, "get_duckie_state": 1.9005990643783176e-06, "in-drivable-lane": 13.650000000000194, "deviation-heading": 13.201256968504396, "agent_compute-ego0": 0.012147477028471148, "complete-iteration": 0.16019783071633878, "set_robot_commands": 0.002188247804538495, "deviation-center-line": 1.70224764388127, "driven_lanedir_consec": 3.665393939993251, "sim_compute_sim_state": 0.005926503825445755, "sim_compute_performance-ego0": 0.00192710640626982}}
set_robot_commands_max0.0022233571134396453
set_robot_commands_mean0.0021197358648056015
set_robot_commands_median0.002114733567542088
set_robot_commands_min0.002026119210698583
sim_compute_performance-ego0_max0.001943245085317697
sim_compute_performance-ego0_mean0.001893599591112401
sim_compute_performance-ego0_median0.00188991435828901
sim_compute_performance-ego0_min0.0018513245625538868
sim_compute_sim_state_max0.010453104305623184
sim_compute_sim_state_mean0.008998941491351695
sim_compute_sim_state_median0.009808078917168922
sim_compute_sim_state_min0.005926503825445755
sim_render-ego0_max0.003879157464895675
sim_render-ego0_mean0.003747233897542564
sim_render-ego0_median0.00372060215759057
sim_render-ego0_min0.0036685738100934386
simulation-passed1
step_physics_max0.12776765039375235
step_physics_mean0.1147923264937909
step_physics_median0.11541575315728116
step_physics_min0.10057014926684886
survival_time_max59.99999999999873
survival_time_mean40.61249999999957
survival_time_min22.15000000000018
No reset possible
5690611059Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:18:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6415677651771885
survival_time_median23.2750000000002
deviation-center-line_median0.5152306307981771
in-drivable-lane_median12.875000000000153


other stats
agent_compute-ego0_max0.012821030307125735
agent_compute-ego0_mean0.012652807711042876
agent_compute-ego0_median0.012623912476403596
agent_compute-ego0_min0.012542375584238584
complete-iteration_max0.2017501249826463
complete-iteration_mean0.17534334031967558
complete-iteration_median0.1763648552175414
complete-iteration_min0.14689352586097323
deviation-center-line_max1.0640427094148648
deviation-center-line_mean0.5612210047972688
deviation-center-line_min0.15038004817785625
deviation-heading_max6.0666502401368
deviation-heading_mean2.9318644653218673
deviation-heading_median2.446725018140678
deviation-heading_min0.7673575848693127
driven_any_max9.383481853416914
driven_any_mean4.739427217186665
driven_any_median3.999870852275131
driven_any_min1.5744853107794827
driven_lanedir_consec_max4.0010744800428775
driven_lanedir_consec_mean1.9902214004841348
driven_lanedir_consec_min0.6766755915392841
driven_lanedir_max4.0010744800428775
driven_lanedir_mean1.9956511979238485
driven_lanedir_median1.6524273600566155
driven_lanedir_min0.6766755915392841
get_duckie_state_max1.2609745277968826e-06
get_duckie_state_mean1.1880548046756033e-06
get_duckie_state_median1.1834628023427355e-06
get_duckie_state_min1.1243190862200587e-06
get_robot_state_max0.0037432920608075214
get_robot_state_mean0.0035860365892583027
get_robot_state_median0.0035739558764013185
get_robot_state_min0.0034529425434230527
get_state_dump_max0.004863602332148791
get_state_dump_mean0.0045585790993222
get_state_dump_median0.004501820753737185
get_state_dump_min0.004367072557665638
get_ui_image_max0.03521877847929832
get_ui_image_mean0.02957034615774675
get_ui_image_median0.029198647355969283
get_ui_image_min0.02466531143975012
in-drivable-lane_max30.34999999999924
in-drivable-lane_mean15.38749999999989
in-drivable-lane_min5.450000000000009
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.383481853416914, "get_ui_image": 0.02810575131776268, "step_physics": 0.10611987369069792, "survival_time": 51.34999999999922, "driven_lanedir": 4.0010744800428775, "get_state_dump": 0.004591542923033006, "get_robot_state": 0.0037432920608075214, "sim_render-ego0": 0.003933467753666384, "get_duckie_state": 1.2609745277968826e-06, "in-drivable-lane": 30.34999999999924, "deviation-heading": 4.028946042260998, "agent_compute-ego0": 0.012615356927715852, "complete-iteration": 0.17467351089655658, "set_robot_commands": 0.002240478064763407, "deviation-center-line": 0.8591830437886864, "driven_lanedir_consec": 4.0010744800428775, "sim_compute_sim_state": 0.011148455541885316, "sim_compute_performance-ego0": 0.0020886559894576612}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.666939888538362, "get_ui_image": 0.03521877847929832, "step_physics": 0.1262142087621459, "survival_time": 26.900000000000247, "driven_lanedir": 2.5883389762428126, "get_state_dump": 0.004863602332148791, "get_robot_state": 0.003692403573936788, "sim_render-ego0": 0.0038883084490038246, "get_duckie_state": 1.219075332103722e-06, "in-drivable-lane": 10.50000000000015, "deviation-heading": 6.0666502401368, "agent_compute-ego0": 0.012821030307125735, "complete-iteration": 0.2017501249826463, "set_robot_commands": 0.0022501481043827997, "deviation-center-line": 1.0640427094148648, "driven_lanedir_consec": 2.5666197864839586, "sim_compute_sim_state": 0.010709635180754651, "sim_compute_performance-ego0": 0.002005244893797696}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.3328018160118993, "get_ui_image": 0.030291543394175884, "step_physics": 0.1099885653723315, "survival_time": 19.650000000000144, "driven_lanedir": 0.7165157438704186, "get_state_dump": 0.004412098584441364, "get_robot_state": 0.003455508178865849, "sim_render-ego0": 0.003762958618590069, "get_duckie_state": 1.1243190862200587e-06, "in-drivable-lane": 15.250000000000153, "deviation-heading": 0.7673575848693127, "agent_compute-ego0": 0.012632468025091336, "complete-iteration": 0.1780561995385262, "set_robot_commands": 0.0020914961238802992, "deviation-center-line": 0.1712782178076679, "driven_lanedir_consec": 0.7165157438704186, "sim_compute_sim_state": 0.009496657376361982, "sim_compute_performance-ego0": 0.001841870661314369}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.5744853107794827, "get_ui_image": 0.02466531143975012, "step_physics": 0.08907271168895603, "survival_time": 9.650000000000002, "driven_lanedir": 0.6766755915392841, "get_state_dump": 0.004367072557665638, "get_robot_state": 0.0034529425434230527, "sim_render-ego0": 0.0037155434028389527, "get_duckie_state": 1.1478502725817493e-06, "in-drivable-lane": 5.450000000000009, "deviation-heading": 0.8645039940203587, "agent_compute-ego0": 0.012542375584238584, "complete-iteration": 0.14689352586097323, "set_robot_commands": 0.0020335126168949088, "deviation-center-line": 0.15038004817785625, "driven_lanedir_consec": 0.6766755915392841, "sim_compute_sim_state": 0.005102348081844369, "sim_compute_performance-ego0": 0.001861800852510118}}
set_robot_commands_max0.0022501481043827997
set_robot_commands_mean0.0021539087274803537
set_robot_commands_median0.002165987094321853
set_robot_commands_min0.0020335126168949088
sim_compute_performance-ego0_max0.0020886559894576612
sim_compute_performance-ego0_mean0.001949393099269961
sim_compute_performance-ego0_median0.0019335228731539068
sim_compute_performance-ego0_min0.001841870661314369
sim_compute_sim_state_max0.011148455541885316
sim_compute_sim_state_mean0.00911427404521158
sim_compute_sim_state_median0.010103146278558316
sim_compute_sim_state_min0.005102348081844369
sim_render-ego0_max0.003933467753666384
sim_render-ego0_mean0.003825069556024808
sim_render-ego0_median0.003825633533796947
sim_render-ego0_min0.0037155434028389527
simulation-passed1
step_physics_max0.1262142087621459
step_physics_mean0.10784883987853285
step_physics_median0.10805421953151471
step_physics_min0.08907271168895603
survival_time_max51.34999999999922
survival_time_mean26.887499999999903
survival_time_min9.650000000000002
No reset possible
5682811072Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:10:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3264719685841865
survival_time_median9.45
deviation-center-line_median0.1255113327781534
in-drivable-lane_median7.399999999999999


other stats
agent_compute-ego0_max0.013141268775576635
agent_compute-ego0_mean0.012642855337383465
agent_compute-ego0_median0.012749312467012268
agent_compute-ego0_min0.01193152763993268
complete-iteration_max0.2155224567367917
complete-iteration_mean0.17502750015841506
complete-iteration_median0.16765168499795707
complete-iteration_min0.1492841739009544
deviation-center-line_max0.357397465412462
deviation-center-line_mean0.17455550001906095
deviation-center-line_min0.08980186910747492
deviation-heading_max1.6669269178438102
deviation-heading_mean0.9314900222027728
deviation-heading_median0.7471545328921072
deviation-heading_min0.5647241051830658
driven_any_max2.388534450861288
driven_any_mean1.5778529183051844
driven_any_median1.6529147170966874
driven_any_min0.6170477881660742
driven_lanedir_consec_max0.5718601609531586
driven_lanedir_consec_mean0.3510479892384266
driven_lanedir_consec_min0.1793878588321749
driven_lanedir_max0.5718601609531586
driven_lanedir_mean0.3510479892384266
driven_lanedir_median0.3264719685841865
driven_lanedir_min0.1793878588321749
get_duckie_state_max1.4219965253557478e-06
get_duckie_state_mean1.291621806730844e-06
get_duckie_state_median1.2996273183173447e-06
get_duckie_state_min1.145236064932939e-06
get_robot_state_max0.003724863406697752
get_robot_state_mean0.003548348040707863
get_robot_state_median0.0035237206353081595
get_robot_state_min0.0034210874855173804
get_state_dump_max0.004665208899456522
get_state_dump_mean0.004514644994091234
get_state_dump_median0.004483843462643251
get_state_dump_min0.004425684151621912
get_ui_image_max0.03439009189605713
get_ui_image_mean0.029628613493575755
get_ui_image_median0.029056070916884565
get_ui_image_min0.02601222024447676
in-drivable-lane_max9.000000000000014
in-drivable-lane_mean6.600000000000001
in-drivable-lane_min2.5999999999999925
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.388534450861288, "get_ui_image": 0.02787927959276282, "step_physics": 0.09402177739049136, "survival_time": 12.600000000000044, "driven_lanedir": 0.5718601609531586, "get_state_dump": 0.004665208899456522, "get_robot_state": 0.003724863406697752, "sim_render-ego0": 0.0037976281916199937, "get_duckie_state": 1.3749118850165203e-06, "in-drivable-lane": 9.000000000000014, "deviation-heading": 1.6669269178438102, "agent_compute-ego0": 0.01295575699787366, "complete-iteration": 0.16065880055484094, "set_robot_commands": 0.0021634045325720263, "deviation-center-line": 0.357397465412462, "driven_lanedir_consec": 0.5718601609531586, "sim_compute_sim_state": 0.009406753208326258, "sim_compute_performance-ego0": 0.0019609202509341035}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6170477881660742, "get_ui_image": 0.03439009189605713, "step_physics": 0.14226508708227248, "survival_time": 4.149999999999993, "driven_lanedir": 0.1793878588321749, "get_state_dump": 0.004523756958189465, "get_robot_state": 0.003494739532470703, "sim_render-ego0": 0.003760357697804769, "get_duckie_state": 1.4219965253557478e-06, "in-drivable-lane": 2.5999999999999925, "deviation-heading": 0.8628012319107017, "agent_compute-ego0": 0.013141268775576635, "complete-iteration": 0.2155224567367917, "set_robot_commands": 0.0021578470865885415, "deviation-center-line": 0.08980186910747492, "driven_lanedir_consec": 0.1793878588321749, "sim_compute_sim_state": 0.009801910037086125, "sim_compute_performance-ego0": 0.001903417564573742}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.5185060520468647, "get_ui_image": 0.03023286224100631, "step_physics": 0.10860174377529608, "survival_time": 8.599999999999987, "driven_lanedir": 0.33224348777784574, "get_state_dump": 0.004425684151621912, "get_robot_state": 0.0034210874855173804, "sim_render-ego0": 0.0036628921596990154, "get_duckie_state": 1.145236064932939e-06, "in-drivable-lane": 6.499999999999987, "deviation-heading": 0.6315078338735128, "agent_compute-ego0": 0.012542867936150877, "complete-iteration": 0.1746445694410732, "set_robot_commands": 0.0020098548404054147, "deviation-center-line": 0.11989256967087109, "driven_lanedir_consec": 0.33224348777784574, "sim_compute_sim_state": 0.007877501449143955, "sim_compute_performance-ego0": 0.0017946248798701115}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7873233821465102, "get_ui_image": 0.02601222024447676, "step_physics": 0.0904607323632724, "survival_time": 10.300000000000011, "driven_lanedir": 0.3207004493905272, "get_state_dump": 0.004443929967097038, "get_robot_state": 0.0035527017381456164, "sim_render-ego0": 0.003715273262797922, "get_duckie_state": 1.2243427516181687e-06, "in-drivable-lane": 8.300000000000011, "deviation-heading": 0.5647241051830658, "agent_compute-ego0": 0.01193152763993268, "complete-iteration": 0.1492841739009544, "set_robot_commands": 0.0021215648466838153, "deviation-center-line": 0.13113009588543573, "driven_lanedir_consec": 0.3207004493905272, "sim_compute_sim_state": 0.005097780826587032, "sim_compute_performance-ego0": 0.001869650854580644}}
set_robot_commands_max0.0021634045325720263
set_robot_commands_mean0.0021131678265624496
set_robot_commands_median0.002139705966636178
set_robot_commands_min0.0020098548404054147
sim_compute_performance-ego0_max0.0019609202509341035
sim_compute_performance-ego0_mean0.0018821533874896503
sim_compute_performance-ego0_median0.001886534209577193
sim_compute_performance-ego0_min0.0017946248798701115
sim_compute_sim_state_max0.009801910037086125
sim_compute_sim_state_mean0.008045986380285843
sim_compute_sim_state_median0.008642127328735106
sim_compute_sim_state_min0.005097780826587032
sim_render-ego0_max0.0037976281916199937
sim_render-ego0_mean0.003734037827980425
sim_render-ego0_median0.003737815480301346
sim_render-ego0_min0.0036628921596990154
simulation-passed1
step_physics_max0.14226508708227248
step_physics_mean0.10883733515283309
step_physics_median0.1013117605828937
step_physics_min0.0904607323632724
survival_time_max12.600000000000044
survival_time_mean8.912500000000009
survival_time_min4.149999999999993
No reset possible
5682411282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5680811282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5679711285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5678111427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-020:02:21
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5674711427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-020:05:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5672111281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:03:53
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5669011289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:12
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5667811287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:15
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5633211420Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFVI-sim-validationLFVIv-simsuccessyesnogpu-prod-020:31:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.673913710504982
survival_time_median33.724999999999355
deviation-center-line_median1.6110754085459376
in-drivable-lane_median0.8249999999999971


other stats
agent_compute-ego0_max0.04424875418345133
agent_compute-ego0_mean0.04308916018930965
agent_compute-ego0_median0.04308916018930965
agent_compute-ego0_min0.04192956619516797
agent_compute-npc0_max0.038418448636375
agent_compute-npc0_mean0.036124795213064616
agent_compute-npc0_median0.036124795213064616
agent_compute-npc0_min0.03383114178975423
agent_compute-npc1_max0.04011879574746315
agent_compute-npc1_mean0.03597989227121286
agent_compute-npc1_median0.03597989227121286
agent_compute-npc1_min0.03184098879496256
agent_compute-npc2_max0.04040458776075377
agent_compute-npc2_mean0.03709272671500213
agent_compute-npc2_median0.03709272671500213
agent_compute-npc2_min0.03378086566925049
complete-iteration_max1.0856346384684246
complete-iteration_mean1.0297862416110437
complete-iteration_median1.0297862416110437
complete-iteration_min0.9739378447536624
deviation-center-line_max2.8305007562607853
deviation-center-line_mean1.6110754085459376
deviation-center-line_min0.3916500608310895
deviation-heading_max10.829028225443134
deviation-heading_mean6.599880571358292
deviation-heading_median6.599880571358292
deviation-heading_min2.3707329172734504
driven_any_max14.590269734375006
driven_any_mean8.078920400014972
driven_any_median8.078920400014972
driven_any_min1.567571065654938
driven_lanedir_consec_max14.2852209595819
driven_lanedir_consec_mean7.673913710504982
driven_lanedir_consec_min1.062606461428065
driven_lanedir_max14.285221064869503
driven_lanedir_mean7.674193401928416
driven_lanedir_median7.674193401928416
driven_lanedir_min1.063165738987328
get_duckie_state_max1.4162063598632811e-06
get_duckie_state_mean1.4038050204490645e-06
get_duckie_state_median1.4038050204490645e-06
get_duckie_state_min1.3914036810348472e-06
get_robot_state_max0.013539951707203124
get_robot_state_mean0.013448245557784504
get_robot_state_median0.013448245557784504
get_robot_state_min0.013356539408365883
get_state_dump_max0.008680183027904298
get_state_dump_mean0.008573431936264569
get_state_dump_median0.008573431936264569
get_state_dump_min0.008466680844624838
get_ui_image_max0.04754342365820739
get_ui_image_mean0.04608420276919769
get_ui_image_median0.04608420276919769
get_ui_image_min0.044624981880187986
in-drivable-lane_max1.649999999999994
in-drivable-lane_mean0.8249999999999971
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 14.590269734375006, "get_ui_image": 0.04754342365820739, "step_physics": 0.6743430199968528, "survival_time": 59.99999999999873, "driven_lanedir": 14.285221064869503, "get_state_dump": 0.008680183027904298, "get_robot_state": 0.013539951707203124, "sim_render-ego0": 0.0037087070058525657, "sim_render-npc0": 0.0036865015212542607, "sim_render-npc1": 0.0036664183788950697, "sim_render-npc2": 0.003702884907527927, "get_duckie_state": 1.3914036810348472e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.829028225443134, "agent_compute-ego0": 0.04192956619516797, "agent_compute-npc0": 0.038418448636375, "agent_compute-npc1": 0.04011879574746315, "agent_compute-npc2": 0.04040458776075377, "complete-iteration": 0.9739378447536624, "set_robot_commands": 0.00219224076981747, "deviation-center-line": 2.8305007562607853, "driven_lanedir_consec": 14.2852209595819, "sim_compute_sim_state": 0.0377399673271338, "sim_compute_performance-ego0": 0.001993634123091495, "sim_compute_performance-npc0": 0.0018727146120095233, "sim_compute_performance-npc1": 0.001904804045512813, "sim_compute_performance-npc2": 0.0018957340151543023}, "LFVI-norm-udem1-000-ego0": {"driven_any": 1.567571065654938, "get_ui_image": 0.044624981880187986, "step_physics": 0.811406618754069, "survival_time": 7.449999999999981, "driven_lanedir": 1.063165738987328, "get_state_dump": 0.008466680844624838, "get_robot_state": 0.013356539408365883, "sim_render-ego0": 0.0035105053583780925, "sim_render-npc0": 0.00343661626180013, "sim_render-npc1": 0.00353761355082194, "sim_render-npc2": 0.0034496561686197915, "get_duckie_state": 1.4162063598632811e-06, "in-drivable-lane": 1.649999999999994, "deviation-heading": 2.3707329172734504, "agent_compute-ego0": 0.04424875418345133, "agent_compute-npc0": 0.03383114178975423, "agent_compute-npc1": 0.03184098879496256, "agent_compute-npc2": 0.03378086566925049, "complete-iteration": 1.0856346384684246, "set_robot_commands": 0.0020204639434814454, "deviation-center-line": 0.3916500608310895, "driven_lanedir_consec": 1.062606461428065, "sim_compute_sim_state": 0.034964863459269205, "sim_compute_performance-ego0": 0.0018629169464111329, "sim_compute_performance-npc0": 0.0016988929112752278, "sim_compute_performance-npc1": 0.00177491029103597, "sim_compute_performance-npc2": 0.0017171573638916015}}
set_robot_commands_max0.00219224076981747
set_robot_commands_mean0.002106352356649458
set_robot_commands_median0.002106352356649458
set_robot_commands_min0.0020204639434814454
sim_compute_performance-ego0_max0.001993634123091495
sim_compute_performance-ego0_mean0.001928275534751314
sim_compute_performance-ego0_median0.001928275534751314
sim_compute_performance-ego0_min0.0018629169464111329
sim_compute_performance-npc0_max0.0018727146120095233
sim_compute_performance-npc0_mean0.0017858037616423756
sim_compute_performance-npc0_median0.0017858037616423756
sim_compute_performance-npc0_min0.0016988929112752278
sim_compute_performance-npc1_max0.001904804045512813
sim_compute_performance-npc1_mean0.0018398571682743917
sim_compute_performance-npc1_median0.0018398571682743917
sim_compute_performance-npc1_min0.00177491029103597
sim_compute_performance-npc2_max0.0018957340151543023
sim_compute_performance-npc2_mean0.001806445689522952
sim_compute_performance-npc2_median0.001806445689522952
sim_compute_performance-npc2_min0.0017171573638916015
sim_compute_sim_state_max0.0377399673271338
sim_compute_sim_state_mean0.0363524153932015
sim_compute_sim_state_median0.0363524153932015
sim_compute_sim_state_min0.034964863459269205
sim_render-ego0_max0.0037087070058525657
sim_render-ego0_mean0.003609606182115329
sim_render-ego0_median0.003609606182115329
sim_render-ego0_min0.0035105053583780925
sim_render-npc0_max0.0036865015212542607
sim_render-npc0_mean0.003561558891527195
sim_render-npc0_median0.003561558891527195
sim_render-npc0_min0.00343661626180013
sim_render-npc1_max0.0036664183788950697
sim_render-npc1_mean0.003602015964858505
sim_render-npc1_median0.003602015964858505
sim_render-npc1_min0.00353761355082194
sim_render-npc2_max0.003702884907527927
sim_render-npc2_mean0.0035762705380738592
sim_render-npc2_median0.0035762705380738592
sim_render-npc2_min0.0034496561686197915
simulation-passed1
step_physics_max0.811406618754069
step_physics_mean0.7428748193754608
step_physics_median0.7428748193754608
step_physics_min0.6743430199968528
survival_time_max59.99999999999873
survival_time_mean33.724999999999355
survival_time_min7.449999999999981
No reset possible
5631911430Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV-sim-validationLFVv-simhost-erroryesnogpu-prod-020:01:01
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5627111291Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5620811425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-020:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5616411302Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5614511302Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5580811419Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV-sim-testingLFVv-simsuccessyesnogpu-prod-020:30:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1253887402315756
survival_time_median11.575000000000053
deviation-center-line_median0.5267204178062265
in-drivable-lane_median0.7750000000000012


other stats
agent_compute-ego0_max0.047382235527038574
agent_compute-ego0_mean0.04108445950381327
agent_compute-ego0_median0.039293251031711815
agent_compute-ego0_min0.03836910042479086
agent_compute-npc0_max0.02254206666322512
agent_compute-npc0_mean0.0203132145702
agent_compute-npc0_median0.020343574756724013
agent_compute-npc0_min0.018023642104126873
agent_compute-npc1_max0.027757203467538422
agent_compute-npc1_mean0.026205966361000622
agent_compute-npc1_median0.026356806045308306
agent_compute-npc1_min0.024503889570155157
agent_compute-npc2_max0.030619601222956292
agent_compute-npc2_mean0.027654891915704416
agent_compute-npc2_median0.02811332118836089
agent_compute-npc2_min0.024231753335796063
agent_compute-npc3_max0.03865875484787415
agent_compute-npc3_mean0.03776413328687822
agent_compute-npc3_median0.03776413328687822
agent_compute-npc3_min0.03686951172588229
complete-iteration_max1.156526298090689
complete-iteration_mean0.8103568408865818
complete-iteration_median0.8687971195853422
complete-iteration_min0.3473068262849535
deviation-center-line_max1.9105102008993984
deviation-center-line_mean0.8047708266373695
deviation-center-line_min0.25513227003762645
deviation-heading_max6.290265571629366
deviation-heading_mean3.406372368581442
deviation-heading_median2.90307150625943
deviation-heading_min1.529080890177542
driven_any_max11.398827339954666
driven_any_mean4.39832922343836
driven_any_median2.5763470407527245
driven_any_min1.041795472293323
driven_lanedir_consec_max11.089455557538962
driven_lanedir_consec_mean4.029891559796834
driven_lanedir_consec_min0.7793332011852212
driven_lanedir_max11.089455557538962
driven_lanedir_mean4.029891559796834
driven_lanedir_median2.1253887402315756
driven_lanedir_min0.7793332011852212
get_duckie_state_max1.8690313611711777e-06
get_duckie_state_mean1.6694056288392273e-06
get_duckie_state_median1.618851192669494e-06
get_duckie_state_min1.5708887688467437e-06
get_robot_state_max0.016287160662686182
get_robot_state_mean0.01292716623575652
get_robot_state_median0.014345897514876764
get_robot_state_min0.006729709250586373
get_state_dump_max0.00969380157189734
get_state_dump_mean0.008288794641876858
get_state_dump_median0.008903414549953047
get_state_dump_min0.005654547895703997
get_ui_image_max0.04666235513776262
get_ui_image_mean0.03887621099997063
get_ui_image_median0.04062637524656593
get_ui_image_min0.027589738368988037
in-drivable-lane_max2.3000000000000096
in-drivable-lane_mean0.962500000000003
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 11.398827339954666, "get_ui_image": 0.03705979268255973, "step_physics": 0.4975180403491486, "survival_time": 47.64999999999943, "driven_lanedir": 11.089455557538962, "get_state_dump": 0.00822830475101431, "get_robot_state": 0.012858617730610526, "sim_render-ego0": 0.003515273520031815, "sim_render-npc0": 0.0035786053919442296, "sim_render-npc1": 0.003536692455379718, "sim_render-npc2": 0.003536001941193075, "get_duckie_state": 1.6396900392928211e-06, "in-drivable-lane": 0.4500000000000064, "deviation-heading": 6.290265571629366, "agent_compute-ego0": 0.03960508220600632, "agent_compute-npc0": 0.018023642104126873, "agent_compute-npc1": 0.026356806045308306, "agent_compute-npc2": 0.02811332118836089, "complete-iteration": 0.7264859788822677, "set_robot_commands": 0.0020385938120588065, "deviation-center-line": 1.9105102008993984, "driven_lanedir_consec": 11.089455557538962, "sim_compute_sim_state": 0.029215960132750823, "sim_compute_performance-ego0": 0.001839462816090454, "sim_compute_performance-npc0": 0.0017744877553336025, "sim_compute_performance-npc1": 0.0017558736121379604, "sim_compute_performance-npc2": 0.0017453289631777589}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.041795472293323, "get_ui_image": 0.04666235513776262, "step_physics": 0.6940165591017108, "survival_time": 5.299999999999989, "driven_lanedir": 0.9676818382990876, "get_state_dump": 0.009578524348891783, "get_robot_state": 0.015833177299143, "sim_render-ego0": 0.0034945523627450533, "sim_render-npc0": 0.003469792481894805, "sim_render-npc1": 0.0034488250161999853, "sim_render-npc2": 0.0034297582145049192, "sim_render-npc3": 0.003486033912016966, "get_duckie_state": 1.5708887688467437e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.039777560201971, "agent_compute-ego0": 0.038981419857417314, "agent_compute-npc0": 0.02254206666322512, "agent_compute-npc1": 0.027757203467538422, "agent_compute-npc2": 0.030619601222956292, "agent_compute-npc3": 0.03865875484787415, "complete-iteration": 1.0111082602884167, "set_robot_commands": 0.00199220113665144, "deviation-center-line": 0.3565211169349438, "driven_lanedir_consec": 0.9676818382990876, "sim_compute_sim_state": 0.05031728521685734, "sim_compute_performance-ego0": 0.0018413779891539956, "sim_compute_performance-npc0": 0.001760485016296957, "sim_compute_performance-npc1": 0.0017377995999059944, "sim_compute_performance-npc2": 0.0017079126054995529, "sim_compute_performance-npc3": 0.0017590879279876423}, "LFV-norm-techtrack-000-ego0": {"driven_any": 4.049784571756448, "get_ui_image": 0.04419295781057212, "step_physics": 0.8612616379605474, "survival_time": 17.600000000000115, "driven_lanedir": 3.283095642164064, "get_state_dump": 0.00969380157189734, "get_robot_state": 0.016287160662686182, "sim_render-ego0": 0.003559008536190217, "sim_render-npc0": 0.0035320881743606696, "sim_render-npc1": 0.0035394284948073434, "sim_render-npc2": 0.0035052231958837754, "sim_render-npc3": 0.003646949870728231, "get_duckie_state": 1.5980123460461668e-06, "in-drivable-lane": 2.3000000000000096, "deviation-heading": 3.7663654523168897, "agent_compute-ego0": 0.03836910042479086, "agent_compute-npc0": 0.018796204845223145, "agent_compute-npc1": 0.024503889570155157, "agent_compute-npc2": 0.024231753335796063, "agent_compute-npc3": 0.03686951172588229, "complete-iteration": 1.156526298090689, "set_robot_commands": 0.001984694186418658, "deviation-center-line": 0.6969197186775091, "driven_lanedir_consec": 3.283095642164064, "sim_compute_sim_state": 0.04513866165204359, "sim_compute_performance-ego0": 0.0018867804713694977, "sim_compute_performance-npc0": 0.00179858450849063, "sim_compute_performance-npc1": 0.0018159309797854328, "sim_compute_performance-npc2": 0.0017828887312675672, "sim_compute_performance-npc3": 0.001829426281850669}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.102909509749001, "get_ui_image": 0.027589738368988037, "step_physics": 0.2140660754271916, "survival_time": 5.549999999999988, "driven_lanedir": 0.7793332011852212, "get_state_dump": 0.005654547895703997, "get_robot_state": 0.006729709250586373, "sim_render-ego0": 0.0034870931080409457, "sim_render-npc0": 0.0035401753016880582, "get_duckie_state": 1.8690313611711777e-06, "in-drivable-lane": 1.099999999999996, "deviation-heading": 1.529080890177542, "agent_compute-ego0": 0.047382235527038574, "agent_compute-npc0": 0.02189094466822488, "complete-iteration": 0.3473068262849535, "set_robot_commands": 0.0021029838493892123, "deviation-center-line": 0.25513227003762645, "driven_lanedir_consec": 0.7793332011852212, "sim_compute_sim_state": 0.008998496191842216, "sim_compute_performance-ego0": 0.0017867343766348703, "sim_compute_performance-npc0": 0.0017879669155393327}}
set_robot_commands_max0.0021029838493892123
set_robot_commands_mean0.002029618246129529
set_robot_commands_median0.0020153974743551233
set_robot_commands_min0.001984694186418658
sim_compute_performance-ego0_max0.0018867804713694977
sim_compute_performance-ego0_mean0.001838588913312204
sim_compute_performance-ego0_median0.0018404204026222248
sim_compute_performance-ego0_min0.0017867343766348703
sim_compute_performance-npc0_max0.00179858450849063
sim_compute_performance-npc0_mean0.0017803810489151306
sim_compute_performance-npc0_median0.0017812273354364677
sim_compute_performance-npc0_min0.001760485016296957
sim_compute_performance-npc1_max0.0018159309797854328
sim_compute_performance-npc1_mean0.0017698680639431292
sim_compute_performance-npc1_median0.0017558736121379604
sim_compute_performance-npc1_min0.0017377995999059944
sim_compute_performance-npc2_max0.0017828887312675672
sim_compute_performance-npc2_mean0.0017453767666482931
sim_compute_performance-npc2_median0.0017453289631777589
sim_compute_performance-npc2_min0.0017079126054995529
sim_compute_performance-npc3_max0.001829426281850669
sim_compute_performance-npc3_mean0.0017942571049191557
sim_compute_performance-npc3_median0.0017942571049191557
sim_compute_performance-npc3_min0.0017590879279876423
sim_compute_sim_state_max0.05031728521685734
sim_compute_sim_state_mean0.0334176007983735
sim_compute_sim_state_median0.0371773108923972
sim_compute_sim_state_min0.008998496191842216
sim_render-ego0_max0.003559008536190217
sim_render-ego0_mean0.0035139818817520076
sim_render-ego0_median0.003504912941388434
sim_render-ego0_min0.0034870931080409457
sim_render-npc0_max0.0035786053919442296
sim_render-npc0_mean0.0035301653374719406
sim_render-npc0_median0.003536131738024364
sim_render-npc0_min0.003469792481894805
sim_render-npc1_max0.0035394284948073434
sim_render-npc1_mean0.003508315322129015
sim_render-npc1_median0.003536692455379718
sim_render-npc1_min0.0034488250161999853
sim_render-npc2_max0.003536001941193075
sim_render-npc2_mean0.0034903277838605894
sim_render-npc2_median0.0035052231958837754
sim_render-npc2_min0.0034297582145049192
sim_render-npc3_max0.003646949870728231
sim_render-npc3_mean0.0035664918913725988
sim_render-npc3_median0.0035664918913725988
sim_render-npc3_min0.003486033912016966
simulation-passed1
step_physics_max0.8612616379605474
step_physics_mean0.5667155782096496
step_physics_median0.5957672997254297
step_physics_min0.2140660754271916
survival_time_max47.64999999999943
survival_time_mean19.02499999999988
survival_time_min5.299999999999989
No reset possible
5577211303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5573611284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:01:12
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5554311414Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFP-sim-testingLFP-simsuccessyesnogpu-prod-020:10:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1735445671412927
survival_time_median13.000000000000083
deviation-center-line_median0.8761866347453381
in-drivable-lane_median1.0000000000000058


other stats
agent_compute-ego0_max0.045316118569601146
agent_compute-ego0_mean0.04315603418900407
agent_compute-ego0_median0.04293244347514876
agent_compute-ego0_min0.041443131236117633
complete-iteration_max0.2696826651928917
complete-iteration_mean0.25129783116727983
complete-iteration_median0.26449503343577807
complete-iteration_min0.2065185926046716
deviation-center-line_max1.58794067085882
deviation-center-line_mean0.849825102595425
deviation-center-line_min0.05898647003220407
deviation-heading_max7.744772683207828
deviation-heading_mean3.7796511396364663
deviation-heading_median3.537557343407942
deviation-heading_min0.2987171885221512
driven_any_max5.8961980238644776
driven_any_mean3.022675398647905
driven_any_median2.9248303345675164
driven_any_min0.34484290159210873
driven_lanedir_consec_max5.569925963667797
driven_lanedir_consec_mean2.5647893028828816
driven_lanedir_consec_min0.3421421135811449
driven_lanedir_max5.569925963667797
driven_lanedir_mean2.5647893028828816
driven_lanedir_median2.1735445671412927
driven_lanedir_min0.3421421135811449
get_duckie_state_max0.0232478666305542
get_duckie_state_mean0.01704095084701638
get_duckie_state_median0.020449824700986725
get_duckie_state_min0.004016287355537874
get_robot_state_max0.0036262060914720807
get_robot_state_mean0.0035215570842722604
get_robot_state_median0.0034960789723928534
get_robot_state_min0.003467864300831254
get_state_dump_max0.0080621337890625
get_state_dump_mean0.0070442347382838185
get_state_dump_median0.0075414000419076095
get_state_dump_min0.005032005080257554
get_ui_image_max0.03568886859076364
get_ui_image_mean0.030859533733724732
get_ui_image_median0.031567302385603915
get_ui_image_min0.02461466157292745
in-drivable-lane_max3.0500000000000433
in-drivable-lane_mean1.2625000000000135
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 0.34484290159210873, "get_ui_image": 0.030591673851013183, "step_physics": 0.14604130268096924, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3421421135811449, "get_state_dump": 0.0080621337890625, "get_robot_state": 0.0034865331649780273, "sim_render-ego0": 0.0034559011459350587, "get_duckie_state": 0.0232478666305542, "in-drivable-lane": 0.0, "deviation-heading": 0.2987171885221512, "agent_compute-ego0": 0.04430836200714111, "complete-iteration": 0.26891785621643066, "set_robot_commands": 0.0022158241271972657, "deviation-center-line": 0.05898647003220407, "driven_lanedir_consec": 0.3421421135811449, "sim_compute_sim_state": 0.005627970695495605, "sim_compute_performance-ego0": 0.0017881011962890623}, "LFP-norm-zigzag-000-ego0": {"driven_any": 5.8961980238644776, "get_ui_image": 0.03568886859076364, "step_physics": 0.1334480775727166, "survival_time": 25.150000000000222, "driven_lanedir": 5.569925963667797, "get_state_dump": 0.007654253925595965, "get_robot_state": 0.0036262060914720807, "sim_render-ego0": 0.0037251516940101743, "get_duckie_state": 0.020852095550960965, "in-drivable-lane": 1.050000000000015, "deviation-heading": 5.696779130663438, "agent_compute-ego0": 0.045316118569601146, "complete-iteration": 0.2696826651928917, "set_robot_commands": 0.002253941127232143, "deviation-center-line": 1.4708361691355007, "driven_lanedir_consec": 5.569925963667797, "sim_compute_sim_state": 0.015026664450055075, "sim_compute_performance-ego0": 0.001995986889279078}, "LFP-norm-techtrack-000-ego0": {"driven_any": 5.101340158032568, "get_ui_image": 0.032542930920194654, "step_physics": 0.13522307965098318, "survival_time": 21.900000000000176, "driven_lanedir": 3.8930160169300976, "get_state_dump": 0.007428546158219253, "get_robot_state": 0.0035056247798076795, "sim_render-ego0": 0.0035817541674220753, "get_duckie_state": 0.02004755385101249, "in-drivable-lane": 3.0500000000000433, "deviation-heading": 7.744772683207828, "agent_compute-ego0": 0.041443131236117633, "complete-iteration": 0.2600722106551255, "set_robot_commands": 0.0021352871132331447, "deviation-center-line": 1.58794067085882, "driven_lanedir_consec": 3.8930160169300976, "sim_compute_sim_state": 0.012196527798246414, "sim_compute_performance-ego0": 0.001877062956130043}, "LFP-norm-small_loop-000-ego0": {"driven_any": 0.7483205111024651, "get_ui_image": 0.02461466157292745, "step_physics": 0.11495466691901884, "survival_time": 4.099999999999993, "driven_lanedir": 0.45407311735248834, "get_state_dump": 0.005032005080257554, "get_robot_state": 0.003467864300831254, "sim_render-ego0": 0.003378509038902191, "get_duckie_state": 0.004016287355537874, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 1.3783355561524464, "agent_compute-ego0": 0.04155652494315641, "complete-iteration": 0.2065185926046716, "set_robot_commands": 0.0021400250584246165, "deviation-center-line": 0.28153710035517543, "driven_lanedir_consec": 0.45407311735248834, "sim_compute_sim_state": 0.005528912486800228, "sim_compute_performance-ego0": 0.0017433396304946348}}
set_robot_commands_max0.002253941127232143
set_robot_commands_mean0.0021862693565217924
set_robot_commands_median0.0021779245928109413
set_robot_commands_min0.0021352871132331447
sim_compute_performance-ego0_max0.001995986889279078
sim_compute_performance-ego0_mean0.0018511226680482048
sim_compute_performance-ego0_median0.0018325820762095527
sim_compute_performance-ego0_min0.0017433396304946348
sim_compute_sim_state_max0.015026664450055075
sim_compute_sim_state_mean0.00959501885764933
sim_compute_sim_state_median0.00891224924687101
sim_compute_sim_state_min0.005528912486800228
sim_render-ego0_max0.0037251516940101743
sim_render-ego0_mean0.003535329011567375
sim_render-ego0_median0.003518827656678567
sim_render-ego0_min0.003378509038902191
simulation-passed1
step_physics_max0.14604130268096924
step_physics_mean0.13241678170592197
step_physics_median0.1343355786118499
step_physics_min0.11495466691901884
survival_time_max25.150000000000222
survival_time_mean13.400000000000098
survival_time_min2.4499999999999993
No reset possible
5551311290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5546111305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:25
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5538711225Charlie Gauthier 🇨🇦template-rosaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:03:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5536911283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5535011301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5532511309Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:56
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5530711307Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:49
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5528611278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5525511306Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:01:11
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5523711311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:50
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5519311450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-020:01:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5515311286Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:11
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5513311299Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5509211308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:01:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5508011308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5503111292Charlie Gauthier 🇨🇦template-rosaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:03:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5497711300Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5495911436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5480011359Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:23:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.31654396102979
survival_time_median40.849999999999454
deviation-center-line_median0.7064636234842072
in-drivable-lane_median25.524999999999693


other stats
agent_compute-ego0_max0.04989820939523203
agent_compute-ego0_mean0.04362573868244782
agent_compute-ego0_median0.04506162722766287
agent_compute-ego0_min0.03448149087923353
complete-iteration_max0.25017233424716523
complete-iteration_mean0.2158124052899538
complete-iteration_median0.21206188251533475
complete-iteration_min0.18895352188198045
deviation-center-line_max1.3793266745814217
deviation-center-line_mean0.7498346903508974
deviation-center-line_min0.20708483985375345
deviation-heading_max7.375123910819174
deviation-heading_mean4.032722951229619
deviation-heading_median3.787953831345229
deviation-heading_min1.1798602314088438
driven_any_max13.872137705587653
driven_any_mean7.6018608763110125
driven_any_median7.946930808577619
driven_any_min0.6414441825011555
driven_lanedir_consec_max4.19517376431833
driven_lanedir_consec_mean2.2747536989303763
driven_lanedir_consec_min0.2707531093435951
driven_lanedir_max4.4038453856874895
driven_lanedir_mean2.3399848029349735
driven_lanedir_median2.342670358354405
driven_lanedir_min0.2707531093435951
get_duckie_state_max1.2945275223324638e-06
get_duckie_state_mean1.2459406188256542e-06
get_duckie_state_median1.2636434676398894e-06
get_duckie_state_min1.1619480176903736e-06
get_robot_state_max0.0036483215948227145
get_robot_state_mean0.003604381098320562
get_robot_state_median0.0036206144061197232
get_robot_state_min0.003527973986220086
get_state_dump_max0.004588790976137643
get_state_dump_mean0.00455480697593021
get_state_dump_median0.004574320320505606
get_state_dump_min0.004481796286571985
get_ui_image_max0.034222334402578845
get_ui_image_mean0.02971547649155229
get_ui_image_median0.02973662099671503
get_ui_image_min0.025166329570200253
in-drivable-lane_max49.24999999999888
in-drivable-lane_mean26.062499999999563
in-drivable-lane_min3.949999999999986
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 13.872137705587653, "get_ui_image": 0.027489417994846214, "step_physics": 0.10540935161409529, "survival_time": 59.99999999999873, "driven_lanedir": 2.221771886588552, "get_state_dump": 0.004588790976137643, "get_robot_state": 0.003624314769519358, "sim_render-ego0": 0.0037766934235228984, "get_duckie_state": 1.2645514978159475e-06, "in-drivable-lane": 49.24999999999888, "deviation-heading": 4.54213898425524, "agent_compute-ego0": 0.048360573064278406, "complete-iteration": 0.20582490916256108, "set_robot_commands": 0.0022643049194056427, "deviation-center-line": 0.7192488595937998, "driven_lanedir_consec": 2.1695190919393226, "sim_compute_sim_state": 0.00824878217774962, "sim_compute_performance-ego0": 0.001977238230264554}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6414441825011555, "get_ui_image": 0.034222334402578845, "step_physics": 0.1393531975922761, "survival_time": 6.699999999999984, "driven_lanedir": 0.2707531093435951, "get_state_dump": 0.004581822289360894, "get_robot_state": 0.003616914042720088, "sim_render-ego0": 0.003790994926735207, "get_duckie_state": 1.2627354374638311e-06, "in-drivable-lane": 3.949999999999986, "deviation-heading": 1.1798602314088438, "agent_compute-ego0": 0.04989820939523203, "complete-iteration": 0.25017233424716523, "set_robot_commands": 0.0022163832629168473, "deviation-center-line": 0.20708483985375345, "driven_lanedir_consec": 0.2707531093435951, "sim_compute_sim_state": 0.010424960101092303, "sim_compute_performance-ego0": 0.001979153244583695}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.369505669470238, "get_ui_image": 0.03198382399858384, "step_physics": 0.12462519646484985, "survival_time": 59.99999999999873, "driven_lanedir": 4.4038453856874895, "get_state_dump": 0.004566818351650318, "get_robot_state": 0.0036483215948227145, "sim_render-ego0": 0.003787807183499936, "get_duckie_state": 1.2945275223324638e-06, "in-drivable-lane": 39.69999999999932, "deviation-heading": 7.375123910819174, "agent_compute-ego0": 0.03448149087923353, "complete-iteration": 0.2182988558681085, "set_robot_commands": 0.0022170585359165213, "deviation-center-line": 1.3793266745814217, "driven_lanedir_consec": 4.19517376431833, "sim_compute_sim_state": 0.010911102993700725, "sim_compute_performance-ego0": 0.0019888911616494516}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.5243559476850015, "get_ui_image": 0.025166329570200253, "step_physics": 0.10044684464904084, "survival_time": 21.700000000000173, "driven_lanedir": 2.463568830120258, "get_state_dump": 0.004481796286571985, "get_robot_state": 0.003527973986220086, "sim_render-ego0": 0.0036025732413105583, "get_duckie_state": 1.1619480176903736e-06, "in-drivable-lane": 11.350000000000067, "deviation-heading": 3.0337686784352176, "agent_compute-ego0": 0.041762681391047336, "complete-iteration": 0.18895352188198045, "set_robot_commands": 0.002192028089501392, "deviation-center-line": 0.6936783873746147, "driven_lanedir_consec": 2.463568830120258, "sim_compute_sim_state": 0.0058324430180692124, "sim_compute_performance-ego0": 0.0018530390728479145}}
set_robot_commands_max0.0022643049194056427
set_robot_commands_mean0.0022224437019351005
set_robot_commands_median0.0022167208994166845
set_robot_commands_min0.002192028089501392
sim_compute_performance-ego0_max0.0019888911616494516
sim_compute_performance-ego0_mean0.0019495804273364037
sim_compute_performance-ego0_median0.0019781957374241247
sim_compute_performance-ego0_min0.0018530390728479145
sim_compute_sim_state_max0.010911102993700725
sim_compute_sim_state_mean0.008854322072652965
sim_compute_sim_state_median0.00933687113942096
sim_compute_sim_state_min0.0058324430180692124
sim_render-ego0_max0.003790994926735207
sim_render-ego0_mean0.00373951719376715
sim_render-ego0_median0.0037822503035114174
sim_render-ego0_min0.0036025732413105583
simulation-passed1
step_physics_max0.1393531975922761
step_physics_mean0.11745864758006552
step_physics_median0.11501727403947257
step_physics_min0.10044684464904084
survival_time_max59.99999999999873
survival_time_mean37.099999999999405
survival_time_min6.699999999999984
No reset possible
5478611424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:24
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5478011424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:52
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5467211389Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:14:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7061854960342252
survival_time_median19.550000000000143
deviation-center-line_median0.1824837990580079
in-drivable-lane_median16.450000000000145


other stats
agent_compute-ego0_max0.012193637558176549
agent_compute-ego0_mean0.011956945276417129
agent_compute-ego0_median0.011891551045129827
agent_compute-ego0_min0.011851041457232307
complete-iteration_max0.19721441601847745
complete-iteration_mean0.19020977511761836
complete-iteration_median0.19230539719942324
complete-iteration_min0.17901389005314952
deviation-center-line_max1.2209512761056331
deviation-center-line_mean0.43016699184616314
deviation-center-line_min0.13474909316300324
deviation-heading_max4.457952337450719
deviation-heading_mean1.9367712557594312
deviation-heading_median1.3494001792082095
deviation-heading_min0.5903323271705876
driven_any_max10.355541661981336
driven_any_mean4.926442041865494
driven_any_median3.640993726506741
driven_any_min2.0682390524671614
driven_lanedir_consec_max3.851857540061628
driven_lanedir_consec_mean1.3900862778761702
driven_lanedir_consec_min0.2961165793746021
driven_lanedir_max3.851857540061628
driven_lanedir_mean1.3973027695922522
driven_lanedir_median0.7061854960342252
driven_lanedir_min0.3249825462389295
get_duckie_state_max2.000905290434632e-06
get_duckie_state_mean1.8778512970380503e-06
get_duckie_state_median1.9200836908883114e-06
get_duckie_state_min1.670332515940947e-06
get_robot_state_max0.003702766281642994
get_robot_state_mean0.0035655799497529466
get_robot_state_median0.0036267011898681546
get_robot_state_min0.003306151137632482
get_state_dump_max0.004723674507551296
get_state_dump_mean0.004490016996194263
get_state_dump_median0.004524595161190679
get_state_dump_min0.0041872031548443964
get_ui_image_max0.03136414289474487
get_ui_image_mean0.02875785157056783
get_ui_image_median0.02885946955177819
get_ui_image_min0.025948324283970058
in-drivable-lane_max28.899999999999384
in-drivable-lane_mean17.637499999999925
in-drivable-lane_min8.750000000000036
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.355541661981336, "get_ui_image": 0.028038523786811417, "step_physics": 0.12452705085918468, "survival_time": 46.4499999999995, "driven_lanedir": 3.851857540061628, "get_state_dump": 0.004723674507551296, "get_robot_state": 0.003682735658461048, "sim_render-ego0": 0.003724400715161395, "get_duckie_state": 1.987590584703671e-06, "in-drivable-lane": 28.899999999999384, "deviation-heading": 4.457952337450719, "agent_compute-ego0": 0.011927948203138123, "complete-iteration": 0.1910143647142636, "set_robot_commands": 0.0021755533833657543, "deviation-center-line": 1.2209512761056331, "driven_lanedir_consec": 3.851857540061628, "sim_compute_sim_state": 0.010162879574683405, "sim_compute_performance-ego0": 0.00196685791015625}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.2653705268281756, "get_ui_image": 0.03136414289474487, "step_physics": 0.12643355622011074, "survival_time": 16.950000000000106, "driven_lanedir": 0.3249825462389295, "get_state_dump": 0.0041872031548443964, "get_robot_state": 0.003306151137632482, "sim_render-ego0": 0.003437634075389189, "get_duckie_state": 1.670332515940947e-06, "in-drivable-lane": 13.900000000000109, "deviation-heading": 1.899059160784163, "agent_compute-ego0": 0.011851041457232307, "complete-iteration": 0.19359642968458288, "set_robot_commands": 0.0020233876564923455, "deviation-center-line": 0.22411691358891017, "driven_lanedir_consec": 0.2961165793746021, "sim_compute_sim_state": 0.009145654650295482, "sim_compute_performance-ego0": 0.001770800001481}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.016616926185306, "get_ui_image": 0.02968041531674497, "step_physics": 0.12981102112177256, "survival_time": 22.15000000000018, "driven_lanedir": 0.7371447647111731, "get_state_dump": 0.00447695373414873, "get_robot_state": 0.003570666721275261, "sim_render-ego0": 0.0036099273879248816, "get_duckie_state": 1.852576797072952e-06, "in-drivable-lane": 19.000000000000185, "deviation-heading": 0.5903323271705876, "agent_compute-ego0": 0.011855153887121527, "complete-iteration": 0.19721441601847745, "set_robot_commands": 0.0020984185708535683, "deviation-center-line": 0.1408506845271057, "driven_lanedir_consec": 0.7371447647111731, "sim_compute_sim_state": 0.010145918206051664, "sim_compute_performance-ego0": 0.001883478852005692}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.0682390524671614, "get_ui_image": 0.025948324283970058, "step_physics": 0.11908256554905372, "survival_time": 11.800000000000033, "driven_lanedir": 0.6752262273572773, "get_state_dump": 0.004572236588232628, "get_robot_state": 0.003702766281642994, "sim_render-ego0": 0.003862170730462054, "get_duckie_state": 2.000905290434632e-06, "in-drivable-lane": 8.750000000000036, "deviation-heading": 0.7997411976322562, "agent_compute-ego0": 0.012193637558176549, "complete-iteration": 0.17901389005314952, "set_robot_commands": 0.002250558716335377, "deviation-center-line": 0.13474909316300324, "driven_lanedir_consec": 0.6752262273572773, "sim_compute_sim_state": 0.0053354496694315336, "sim_compute_performance-ego0": 0.0019826919217652912}}
set_robot_commands_max0.002250558716335377
set_robot_commands_mean0.002136979581761762
set_robot_commands_median0.0021369859771096615
set_robot_commands_min0.0020233876564923455
sim_compute_performance-ego0_max0.0019826919217652912
sim_compute_performance-ego0_mean0.0019009571713520584
sim_compute_performance-ego0_median0.0019251683810809711
sim_compute_performance-ego0_min0.001770800001481
sim_compute_sim_state_max0.010162879574683405
sim_compute_sim_state_mean0.00869747552511552
sim_compute_sim_state_median0.009645786428173571
sim_compute_sim_state_min0.0053354496694315336
sim_render-ego0_max0.003862170730462054
sim_render-ego0_mean0.00365853322723438
sim_render-ego0_median0.0036671640515431383
sim_render-ego0_min0.003437634075389189
simulation-passed1
step_physics_max0.12981102112177256
step_physics_mean0.12496354843753044
step_physics_median0.1254803035396477
step_physics_min0.11908256554905372
survival_time_max46.4499999999995
survival_time_mean24.337499999999956
survival_time_min11.800000000000033
No reset possible
5464511439Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:49
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5450111482Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:36:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.994124953229383
survival_time_median59.99999999999873
deviation-center-line_median4.1425602372654495
in-drivable-lane_median13.474999999999664


other stats
agent_compute-ego0_max0.013202888780986142
agent_compute-ego0_mean0.01289537070097276
agent_compute-ego0_median0.012935207844971618
agent_compute-ego0_min0.012508178332961669
complete-iteration_max0.23452893701024496
complete-iteration_mean0.2068608108904836
complete-iteration_median0.20372353862663983
complete-iteration_min0.18546722929840975
deviation-center-line_max4.37458232375376
deviation-center-line_mean4.1501890433104895
deviation-center-line_min3.9410533749572982
deviation-heading_max18.22492731742636
deviation-heading_mean15.16673354413772
deviation-heading_median15.815535648218356
deviation-heading_min10.810935562687805
driven_any_max7.920981575724781
driven_any_mean7.91753027752337
driven_any_median7.920731533856822
driven_any_min7.9076764666550545
driven_lanedir_consec_max5.389400595346961
driven_lanedir_consec_mean4.808384543297799
driven_lanedir_consec_min3.855887671385469
driven_lanedir_max6.1298385255116665
driven_lanedir_mean5.3768722568293486
driven_lanedir_median5.38894805886864
driven_lanedir_min4.599754384068447
get_duckie_state_max1.551011122831397e-06
get_duckie_state_mean1.4535394139730565e-06
get_duckie_state_median1.4735896025569512e-06
get_duckie_state_min1.3159673279469258e-06
get_robot_state_max0.0038183291289927463
get_robot_state_mean0.0037546187118130065
get_robot_state_median0.003745862983049302
get_robot_state_min0.003708419752160675
get_state_dump_max0.004986384627622529
get_state_dump_mean0.004749199879556572
get_state_dump_median0.004694262511724239
get_state_dump_min0.00462188986715528
get_ui_image_max0.03650014565251054
get_ui_image_mean0.031203781486450883
get_ui_image_median0.03061386885789908
get_ui_image_min0.027087242577494827
in-drivable-lane_max21.449999999999537
in-drivable-lane_mean14.8499999999997
in-drivable-lane_min10.999999999999936
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.920981575724781, "get_ui_image": 0.028449877811212724, "step_physics": 0.11818615006566742, "survival_time": 59.99999999999873, "driven_lanedir": 6.1298385255116665, "get_state_dump": 0.00462188986715528, "get_robot_state": 0.003708419752160675, "sim_render-ego0": 0.003723156243736401, "get_duckie_state": 1.5218291651894906e-06, "in-drivable-lane": 10.999999999999936, "deviation-heading": 10.810935562687805, "agent_compute-ego0": 0.012508178332961669, "complete-iteration": 0.18546722929840975, "set_robot_commands": 0.002187126780628265, "deviation-center-line": 4.019844191904939, "driven_lanedir_consec": 3.855887671385469, "sim_compute_sim_state": 0.0100149540579587, "sim_compute_performance-ego0": 0.0019759889645540743}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.920902072755292, "get_ui_image": 0.03650014565251054, "step_physics": 0.15506791274414572, "survival_time": 59.99999999999873, "driven_lanedir": 5.388495522390318, "get_state_dump": 0.004737133983767698, "get_robot_state": 0.0038183291289927463, "sim_render-ego0": 0.003838225070086248, "get_duckie_state": 1.425350039924412e-06, "in-drivable-lane": 13.599999999999664, "deviation-heading": 17.85428290876408, "agent_compute-ego0": 0.01315029475412996, "complete-iteration": 0.23452893701024496, "set_robot_commands": 0.002266035389642136, "deviation-center-line": 3.9410533749572982, "driven_lanedir_consec": 5.388495522390318, "sim_compute_sim_state": 0.012955935571116274, "sim_compute_performance-ego0": 0.0020990792559545104}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.9076764666550545, "get_ui_image": 0.032777859904585434, "step_physics": 0.13554111289342774, "survival_time": 59.99999999999873, "driven_lanedir": 5.389400595346961, "get_state_dump": 0.00465139103968078, "get_robot_state": 0.003720525897214256, "sim_render-ego0": 0.003735941911517928, "get_duckie_state": 1.3159673279469258e-06, "in-drivable-lane": 13.349999999999662, "deviation-heading": 18.22492731742636, "agent_compute-ego0": 0.012720120935813276, "complete-iteration": 0.2107214274553335, "set_robot_commands": 0.0022003730071970666, "deviation-center-line": 4.265276282625959, "driven_lanedir_consec": 5.389400595346961, "sim_compute_sim_state": 0.013280336703984168, "sim_compute_performance-ego0": 0.001999659899569471}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920560994958351, "get_ui_image": 0.027087242577494827, "step_physics": 0.1333660726046979, "survival_time": 59.99999999999873, "driven_lanedir": 4.599754384068447, "get_state_dump": 0.004986384627622529, "get_robot_state": 0.003771200068884349, "sim_render-ego0": 0.0037465730773519217, "get_duckie_state": 1.551011122831397e-06, "in-drivable-lane": 21.449999999999537, "deviation-heading": 13.776788387672632, "agent_compute-ego0": 0.013202888780986142, "complete-iteration": 0.19672564979794616, "set_robot_commands": 0.0022244433578503917, "deviation-center-line": 4.37458232375376, "driven_lanedir_consec": 4.599754384068447, "sim_compute_sim_state": 0.006283733469560482, "sim_compute_performance-ego0": 0.001964379905363999}}
set_robot_commands_max0.002266035389642136
set_robot_commands_mean0.002219494633829465
set_robot_commands_median0.002212408182523729
set_robot_commands_min0.002187126780628265
sim_compute_performance-ego0_max0.0020990792559545104
sim_compute_performance-ego0_mean0.0020097770063605136
sim_compute_performance-ego0_median0.0019878244320617727
sim_compute_performance-ego0_min0.001964379905363999
sim_compute_sim_state_max0.013280336703984168
sim_compute_sim_state_mean0.010633739950654903
sim_compute_sim_state_median0.011485444814537489
sim_compute_sim_state_min0.006283733469560482
sim_render-ego0_max0.003838225070086248
sim_render-ego0_mean0.0037609740756731247
sim_render-ego0_median0.003741257494434925
sim_render-ego0_min0.003723156243736401
simulation-passed1
step_physics_max0.15506791274414572
step_physics_mean0.1355403120769847
step_physics_median0.13445359274906282
step_physics_min0.11818615006566742
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5443111543Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:29:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.546395098742543
survival_time_median59.99999999999873
deviation-center-line_median3.667210347767006
in-drivable-lane_median0.4000000000000057


other stats
agent_compute-ego0_max0.01243366330277686
agent_compute-ego0_mean0.01224786266668719
agent_compute-ego0_median0.012242337646929053
agent_compute-ego0_min0.012073112070113792
complete-iteration_max0.2187060793670985
complete-iteration_mean0.19343229520622757
complete-iteration_median0.18989393603891055
complete-iteration_min0.17523522937999053
deviation-center-line_max4.320746953098856
deviation-center-line_mean2.9600011950270404
deviation-center-line_min0.18483713147529324
deviation-heading_max13.063588833488362
deviation-heading_mean9.895503097463362
deviation-heading_median12.908022922014746
deviation-heading_min0.7023777123355931
driven_any_max12.087015951178357
driven_any_mean8.918746746498782
driven_any_median10.942627582859064
driven_any_min1.70271586909865
driven_lanedir_consec_max11.590531951784811
driven_lanedir_consec_mean8.339308467118087
driven_lanedir_consec_min0.6739117192024404
driven_lanedir_max11.590531951784811
driven_lanedir_mean8.339308467118087
driven_lanedir_median10.546395098742543
driven_lanedir_min0.6739117192024404
get_duckie_state_max1.3884259302550608e-06
get_duckie_state_mean1.356485903937465e-06
get_duckie_state_median1.37248766517443e-06
get_duckie_state_min1.2925423551459397e-06
get_robot_state_max0.0037278556356243058
get_robot_state_mean0.0037116301409365338
get_robot_state_median0.003716356152797321
get_robot_state_min0.003685952622527186
get_state_dump_max0.004752681535833022
get_state_dump_mean0.004645147470656738
get_state_dump_median0.004614005080865484
get_state_dump_min0.004599898185062964
get_ui_image_max0.03505245215886836
get_ui_image_mean0.03028277880175159
get_ui_image_median0.029735999639385644
get_ui_image_min0.026606663769366694
in-drivable-lane_max6.7000000000000135
in-drivable-lane_mean1.8750000000000064
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.087015951178357, "get_ui_image": 0.027982106911550453, "step_physics": 0.11248650459524596, "survival_time": 59.99999999999873, "driven_lanedir": 11.590531951784811, "get_state_dump": 0.004613705816912115, "get_robot_state": 0.003725664303959855, "sim_render-ego0": 0.003661096939734873, "get_duckie_state": 1.3884259302550608e-06, "in-drivable-lane": 0.8000000000000114, "deviation-heading": 13.003477056294024, "agent_compute-ego0": 0.012253476817046078, "complete-iteration": 0.17836232725329243, "set_robot_commands": 0.002217411300125566, "deviation-center-line": 3.369850966757339, "driven_lanedir_consec": 11.590531951784811, "sim_compute_sim_state": 0.009359041717427656, "sim_compute_performance-ego0": 0.0019763959238273117}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.71284784182592, "get_ui_image": 0.03505245215886836, "step_physics": 0.14160760673853282, "survival_time": 59.99999999999873, "driven_lanedir": 10.327341827234868, "get_state_dump": 0.004599898185062964, "get_robot_state": 0.003685952622527186, "sim_render-ego0": 0.003811196423291564, "get_duckie_state": 1.3810808116649212e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.063588833488362, "agent_compute-ego0": 0.012073112070113792, "complete-iteration": 0.2187060793670985, "set_robot_commands": 0.0022380429441783947, "deviation-center-line": 4.320746953098856, "driven_lanedir_consec": 10.327341827234868, "sim_compute_sim_state": 0.013443898003266118, "sim_compute_performance-ego0": 0.002106352710009217}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.172407323892203, "get_ui_image": 0.031489892367220836, "step_physics": 0.12811086914322953, "survival_time": 59.99999999999873, "driven_lanedir": 10.765448370250224, "get_state_dump": 0.004614304344818852, "get_robot_state": 0.0037070480016347866, "sim_render-ego0": 0.003819190493034979, "get_duckie_state": 1.2925423551459397e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.812568787735469, "agent_compute-ego0": 0.012231198476812028, "complete-iteration": 0.20142554482452876, "set_robot_commands": 0.0022831002838109354, "deviation-center-line": 3.9645697287766737, "driven_lanedir_consec": 10.765448370250224, "sim_compute_sim_state": 0.012984193631949572, "sim_compute_performance-ego0": 0.002098646688024567}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.70271586909865, "get_ui_image": 0.026606663769366694, "step_physics": 0.11436666928085626, "survival_time": 10.15000000000001, "driven_lanedir": 0.6739117192024404, "get_state_dump": 0.004752681535833022, "get_robot_state": 0.0037278556356243058, "sim_render-ego0": 0.003782953701767267, "get_duckie_state": 1.3638945186839384e-06, "in-drivable-lane": 6.7000000000000135, "deviation-heading": 0.7023777123355931, "agent_compute-ego0": 0.01243366330277686, "complete-iteration": 0.17523522937999053, "set_robot_commands": 0.00224686253304575, "deviation-center-line": 0.18483713147529324, "driven_lanedir_consec": 0.6739117192024404, "sim_compute_sim_state": 0.005231566288891961, "sim_compute_performance-ego0": 0.001997058298073563}}
set_robot_commands_max0.0022831002838109354
set_robot_commands_mean0.0022463542652901617
set_robot_commands_median0.0022424527386120724
set_robot_commands_min0.002217411300125566
sim_compute_performance-ego0_max0.002106352710009217
sim_compute_performance-ego0_mean0.002044613404983665
sim_compute_performance-ego0_median0.0020478524930490653
sim_compute_performance-ego0_min0.0019763959238273117
sim_compute_sim_state_max0.013443898003266118
sim_compute_sim_state_mean0.010254674910383826
sim_compute_sim_state_median0.011171617674688614
sim_compute_sim_state_min0.005231566288891961
sim_render-ego0_max0.003819190493034979
sim_render-ego0_mean0.0037686093894571705
sim_render-ego0_median0.003797075062529416
sim_render-ego0_min0.003661096939734873
simulation-passed1
step_physics_max0.14160760673853282
step_physics_mean0.12414291243946614
step_physics_median0.1212387692120429
step_physics_min0.11248650459524596
survival_time_max59.99999999999873
survival_time_mean47.53749999999905
survival_time_min10.15000000000001
No reset possible
5442911624Anthony Courchesne 🇨🇦TNetR1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:46
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5442711624Anthony Courchesne 🇨🇦TNetR1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5428911599Yishu Malhotra 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:37:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.121091804916416
survival_time_median59.99999999999873
deviation-center-line_median3.897405800778463
in-drivable-lane_median1.0749999999999744


other stats
agent_compute-ego0_max0.012626901455068468
agent_compute-ego0_mean0.012118305840361228
agent_compute-ego0_median0.012217999993514065
agent_compute-ego0_min0.011410321919348316
complete-iteration_max0.24709627570756568
complete-iteration_mean0.21089670605504643
complete-iteration_median0.2081799568681296
complete-iteration_min0.1801306347763608
deviation-center-line_max4.196401331203442
deviation-center-line_mean3.960735528302865
deviation-center-line_min3.851729180451091
deviation-heading_max18.231996239663676
deviation-heading_mean17.963602948664477
deviation-heading_median18.149265446116452
deviation-heading_min17.323884662761326
driven_any_max12.645728287591105
driven_any_mean12.228006343751025
driven_any_median12.131366815767088
driven_any_min12.003563455878815
driven_lanedir_consec_max11.881995345890658
driven_lanedir_consec_mean10.68086127301638
driven_lanedir_consec_min8.599266136342024
driven_lanedir_max11.881995345890658
driven_lanedir_mean11.19202478118786
driven_lanedir_median11.121091804916416
driven_lanedir_min10.64392016902795
get_duckie_state_max1.2601841300055945e-06
get_duckie_state_mean1.2321932726756024e-06
get_duckie_state_median1.2408287499369828e-06
get_duckie_state_min1.1869314608228495e-06
get_robot_state_max0.0037335134564986535
get_robot_state_mean0.0036894444819791034
get_robot_state_median0.0036810437011083495
get_robot_state_min0.0036621770692010606
get_state_dump_max0.004701163151381316
get_state_dump_mean0.004626469350079513
get_state_dump_median0.004633300310368344
get_state_dump_min0.004538113628200052
get_ui_image_max0.036212994792280746
get_ui_image_mean0.03064523623646745
get_ui_image_median0.030145490298561013
get_ui_image_min0.026076969556467024
in-drivable-lane_max3.6999999999999984
in-drivable-lane_mean1.4624999999999868
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.21308075615644, "get_ui_image": 0.027779868202940015, "step_physics": 0.12655997057937762, "survival_time": 59.99999999999873, "driven_lanedir": 11.18306261677677, "get_state_dump": 0.004538113628200052, "get_robot_state": 0.0036621770692010606, "sim_render-ego0": 0.003682199862477781, "get_duckie_state": 1.259985613286942e-06, "in-drivable-lane": 1.0000000000000142, "deviation-heading": 18.231996239663676, "agent_compute-ego0": 0.012252543192918255, "complete-iteration": 0.19195028149416604, "set_robot_commands": 0.0021858745371670053, "deviation-center-line": 3.856240845441373, "driven_lanedir_consec": 11.18306261677677, "sim_compute_sim_state": 0.00922393798828125, "sim_compute_performance-ego0": 0.0019778873799345476}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.049652875377737, "get_ui_image": 0.036212994792280746, "step_physics": 0.16800202457831365, "survival_time": 59.99999999999873, "driven_lanedir": 10.64392016902795, "get_state_dump": 0.004701163151381316, "get_robot_state": 0.00368494892199768, "sim_render-ego0": 0.003789323454197003, "get_duckie_state": 1.2601841300055945e-06, "in-drivable-lane": 3.6999999999999984, "deviation-heading": 18.127791181656924, "agent_compute-ego0": 0.012183456794109869, "complete-iteration": 0.24709627570756568, "set_robot_commands": 0.0022039858129598217, "deviation-center-line": 3.938570756115554, "driven_lanedir_consec": 8.599266136342024, "sim_compute_sim_state": 0.014179372668365556, "sim_compute_performance-ego0": 0.0020468659841647056}, "LF-norm-techtrack-000-ego0": {"driven_any": 12.645728287591105, "get_ui_image": 0.032511112394182015, "step_physics": 0.15038518345822502, "survival_time": 59.99999999999873, "driven_lanedir": 11.881995345890658, "get_state_dump": 0.004607255214656224, "get_robot_state": 0.003677138480219019, "sim_render-ego0": 0.0038020493684462167, "get_duckie_state": 1.1869314608228495e-06, "in-drivable-lane": 0.0, "deviation-heading": 17.323884662761326, "agent_compute-ego0": 0.012626901455068468, "complete-iteration": 0.2244096322420932, "set_robot_commands": 0.002233681531869601, "deviation-center-line": 3.851729180451091, "driven_lanedir_consec": 11.881995345890658, "sim_compute_sim_state": 0.012466776678703112, "sim_compute_performance-ego0": 0.002008682682948942}, "LF-norm-small_loop-000-ego0": {"driven_any": 12.003563455878815, "get_ui_image": 0.026076969556467024, "step_physics": 0.11996567477592322, "survival_time": 59.99999999999873, "driven_lanedir": 11.059120993056062, "get_state_dump": 0.004659345406080463, "get_robot_state": 0.0037335134564986535, "sim_render-ego0": 0.003799931393574914, "get_duckie_state": 1.221671886587024e-06, "in-drivable-lane": 1.1499999999999346, "deviation-heading": 18.170739710575976, "agent_compute-ego0": 0.011410321919348316, "complete-iteration": 0.1801306347763608, "set_robot_commands": 0.002222488166688384, "deviation-center-line": 4.196401331203442, "driven_lanedir_consec": 11.059120993056062, "sim_compute_sim_state": 0.006121886560660814, "sim_compute_performance-ego0": 0.0020525951766650146}}
set_robot_commands_max0.002233681531869601
set_robot_commands_mean0.0022115075121712027
set_robot_commands_median0.002213236989824103
set_robot_commands_min0.0021858745371670053
sim_compute_performance-ego0_max0.0020525951766650146
sim_compute_performance-ego0_mean0.0020215078059283025
sim_compute_performance-ego0_median0.002027774333556824
sim_compute_performance-ego0_min0.0019778873799345476
sim_compute_sim_state_max0.014179372668365556
sim_compute_sim_state_mean0.010497993474002683
sim_compute_sim_state_median0.010845357333492182
sim_compute_sim_state_min0.006121886560660814
sim_render-ego0_max0.0038020493684462167
sim_render-ego0_mean0.0037683760196739785
sim_render-ego0_median0.0037946274238859585
sim_render-ego0_min0.003682199862477781
simulation-passed1
step_physics_max0.16800202457831365
step_physics_mean0.14122821334795987
step_physics_median0.1384725770188013
step_physics_min0.11996567477592322
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5423111628Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:18:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2056224232669916
survival_time_median26.12500000000023
deviation-center-line_median0.5309550952746294
in-drivable-lane_median17.424999999999862


other stats
agent_compute-ego0_max0.01254244476345414
agent_compute-ego0_mean0.012254340958289778
agent_compute-ego0_median0.01230585802037186
agent_compute-ego0_min0.011863203028961244
complete-iteration_max0.22969843687549715
complete-iteration_mean0.1988920393875336
complete-iteration_median0.20208387337680683
complete-iteration_min0.1617019739210235
deviation-center-line_max2.767576499115981
deviation-center-line_mean1.0104840878232595
deviation-center-line_min0.21244966162779969
deviation-heading_max9.64684705488412
deviation-heading_mean4.374533283215797
deviation-heading_median3.360958681002815
deviation-heading_min1.1293687159734391
driven_any_max14.449942299790944
driven_any_mean6.638518092648182
driven_any_median5.410132634145089
driven_any_min1.2838648025116042
driven_lanedir_consec_max10.843823613409391
driven_lanedir_consec_mean3.472277216994309
driven_lanedir_consec_min0.6340404080338597
driven_lanedir_max10.843823613409391
driven_lanedir_mean3.47538105359606
driven_lanedir_median1.2118300964704938
driven_lanedir_min0.6340404080338597
get_duckie_state_max1.357655838863935e-06
get_duckie_state_mean1.281916687772098e-06
get_duckie_state_median1.2901930589747905e-06
get_duckie_state_min1.189624794274877e-06
get_robot_state_max0.003793273834472007
get_robot_state_mean0.0036788152924882894
get_robot_state_median0.003665812831661293
get_robot_state_min0.003590361672158567
get_state_dump_max0.00484214353223219
get_state_dump_mean0.004690543933435014
get_state_dump_median0.004704140228965294
get_state_dump_min0.004511751743577282
get_ui_image_max0.03689809383884553
get_ui_image_mean0.03107464798199064
get_ui_image_median0.03090197328456341
get_ui_image_min0.025596551519990213
in-drivable-lane_max20.150000000000215
in-drivable-lane_mean14.487499999999985
in-drivable-lane_min2.9499999999999895
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.449942299790944, "get_ui_image": 0.028446179643260947, "step_physics": 0.11424302379852729, "survival_time": 59.99999999999873, "driven_lanedir": 10.843823613409391, "get_state_dump": 0.004669859248533734, "get_robot_state": 0.0036833157249533265, "sim_render-ego0": 0.0037426682534960286, "get_duckie_state": 1.357655838863935e-06, "in-drivable-lane": 16.49999999999946, "deviation-heading": 9.64684705488412, "agent_compute-ego0": 0.012326531565060325, "complete-iteration": 0.1810629214970496, "set_robot_commands": 0.002201244098558513, "deviation-center-line": 2.767576499115981, "driven_lanedir_consec": 10.843823613409391, "sim_compute_sim_state": 0.009658015836386955, "sim_compute_performance-ego0": 0.002007011172177889}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2838648025116042, "get_ui_image": 0.03689809383884553, "step_physics": 0.15422358820515294, "survival_time": 6.149999999999986, "driven_lanedir": 0.6340404080338597, "get_state_dump": 0.0047384212093968545, "get_robot_state": 0.003648309938369259, "sim_render-ego0": 0.0038430921493038056, "get_duckie_state": 1.2766930364793346e-06, "in-drivable-lane": 2.9499999999999895, "deviation-heading": 1.1293687159734391, "agent_compute-ego0": 0.012285184475683397, "complete-iteration": 0.22969843687549715, "set_robot_commands": 0.002210290201248661, "deviation-center-line": 0.21244966162779969, "driven_lanedir_consec": 0.6340404080338597, "sim_compute_sim_state": 0.009730119859018631, "sim_compute_performance-ego0": 0.0020348237406822944}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.558751509253861, "get_ui_image": 0.033357766925865874, "step_physics": 0.14973339121392432, "survival_time": 28.150000000000265, "driven_lanedir": 1.71283317541234, "get_state_dump": 0.00484214353223219, "get_robot_state": 0.003793273834472007, "sim_render-ego0": 0.003918279992773178, "get_duckie_state": 1.303693081470246e-06, "in-drivable-lane": 18.35000000000026, "deviation-heading": 5.007960140798649, "agent_compute-ego0": 0.01254244476345414, "complete-iteration": 0.22310482525656408, "set_robot_commands": 0.0022386384348497324, "deviation-center-line": 0.7839818761365499, "driven_lanedir_consec": 1.700417829005336, "sim_compute_sim_state": 0.010533298161012906, "sim_compute_performance-ego0": 0.002055946816789343}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.261513759036317, "get_ui_image": 0.025596551519990213, "step_physics": 0.10226648293173338, "survival_time": 24.100000000000207, "driven_lanedir": 0.7108270175286475, "get_state_dump": 0.004511751743577282, "get_robot_state": 0.003590361672158567, "sim_render-ego0": 0.003704567133269695, "get_duckie_state": 1.189624794274877e-06, "in-drivable-lane": 20.150000000000215, "deviation-heading": 1.7139572212069811, "agent_compute-ego0": 0.011863203028961244, "complete-iteration": 0.1617019739210235, "set_robot_commands": 0.002135063550487068, "deviation-center-line": 0.27792831441270893, "driven_lanedir_consec": 0.7108270175286475, "sim_compute_sim_state": 0.006028354538153417, "sim_compute_performance-ego0": 0.001923965371173361}}
set_robot_commands_max0.0022386384348497324
set_robot_commands_mean0.0021963090712859936
set_robot_commands_median0.002205767149903587
set_robot_commands_min0.002135063550487068
sim_compute_performance-ego0_max0.002055946816789343
sim_compute_performance-ego0_mean0.002005436775205722
sim_compute_performance-ego0_median0.002020917456430092
sim_compute_performance-ego0_min0.001923965371173361
sim_compute_sim_state_max0.010533298161012906
sim_compute_sim_state_mean0.008987447098642978
sim_compute_sim_state_median0.009694067847702794
sim_compute_sim_state_min0.006028354538153417
sim_render-ego0_max0.003918279992773178
sim_render-ego0_mean0.0038021518822106766
sim_render-ego0_median0.003792880201399917
sim_render-ego0_min0.003704567133269695
simulation-passed1
step_physics_max0.15422358820515294
step_physics_mean0.13011662153733447
step_physics_median0.1319882075062258
step_physics_min0.10226648293173338
survival_time_max59.99999999999873
survival_time_mean29.5999999999998
survival_time_min6.149999999999986
No reset possible
5416911645Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:24:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.726626949941639
survival_time_median41.349999999999454
deviation-center-line_median0.6756056684985615
in-drivable-lane_median28.474999999999632


other stats
agent_compute-ego0_max0.013041708676480504
agent_compute-ego0_mean0.012719234332835266
agent_compute-ego0_median0.0127672470694362
agent_compute-ego0_min0.012300734515988164
complete-iteration_max0.23164721480456651
complete-iteration_mean0.2083372103055996
complete-iteration_median0.21343285075904256
complete-iteration_min0.17483592489974684
deviation-center-line_max1.6754153262592597
deviation-center-line_mean0.790136858545492
deviation-center-line_min0.1339207709255853
deviation-heading_max7.711943973898728
deviation-heading_mean3.5234283224518874
deviation-heading_median2.7793247668451775
deviation-heading_min0.8231197822184669
driven_any_max11.468578074058325
driven_any_mean7.690035266372472
driven_any_median7.7618568904845215
driven_any_min3.76784921046252
driven_lanedir_consec_max3.628232145813658
driven_lanedir_consec_mean1.9343590672816229
driven_lanedir_consec_min0.6559502234295558
driven_lanedir_max4.652177834375115
driven_lanedir_mean2.4059835349109036
driven_lanedir_median2.1579030409194715
driven_lanedir_min0.6559502234295558
get_duckie_state_max1.3985476651034511e-06
get_duckie_state_mean1.3314416928047875e-06
get_duckie_state_median1.3202168679053397e-06
get_duckie_state_min1.2867853703050193e-06
get_robot_state_max0.003835814339773996
get_robot_state_mean0.0037652336073765377
get_robot_state_median0.003766233565458506
get_robot_state_min0.003692652958815143
get_state_dump_max0.004782749974647981
get_state_dump_mean0.004693820134206447
get_state_dump_median0.004708333298862687
get_state_dump_min0.004575863964452434
get_ui_image_max0.03600176511734791
get_ui_image_mean0.030803807091328753
get_ui_image_median0.03048299602460866
get_ui_image_min0.026247471198749785
in-drivable-lane_max57.04999999999873
in-drivable-lane_mean29.574999999999513
in-drivable-lane_min4.300000000000061
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.078430609177625, "get_ui_image": 0.028474026178936476, "step_physics": 0.12952227139850142, "survival_time": 59.99999999999873, "driven_lanedir": 4.652177834375115, "get_state_dump": 0.0047053907634217376, "get_robot_state": 0.003692652958815143, "sim_render-ego0": 0.003795455437119458, "get_duckie_state": 1.330459048408553e-06, "in-drivable-lane": 37.24999999999907, "deviation-heading": 7.711943973898728, "agent_compute-ego0": 0.012549403505857345, "complete-iteration": 0.19775103490418144, "set_robot_commands": 0.0022407606380567464, "deviation-center-line": 1.6754153262592597, "driven_lanedir_consec": 2.7656799638579925, "sim_compute_sim_state": 0.010684850908735211, "sim_compute_performance-ego0": 0.0020024959094121393}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.445283171791417, "get_ui_image": 0.03600176511734791, "step_physics": 0.15438483074672504, "survival_time": 22.400000000000183, "driven_lanedir": 3.628232145813658, "get_state_dump": 0.004782749974647981, "get_robot_state": 0.003803483627421288, "sim_render-ego0": 0.003954433916937269, "get_duckie_state": 1.3099746874021265e-06, "in-drivable-lane": 4.300000000000061, "deviation-heading": 4.69430698611623, "agent_compute-ego0": 0.013041708676480504, "complete-iteration": 0.23164721480456651, "set_robot_commands": 0.002284283627380507, "deviation-center-line": 1.1829202339151286, "driven_lanedir_consec": 3.628232145813658, "sim_compute_sim_state": 0.011193169782846702, "sim_compute_performance-ego0": 0.002113361932121566}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.76784921046252, "get_ui_image": 0.032491965870280845, "step_physics": 0.15580850433517288, "survival_time": 22.700000000000188, "driven_lanedir": 0.687573936025285, "get_state_dump": 0.004711275834303636, "get_robot_state": 0.003835814339773996, "sim_render-ego0": 0.003851039069039481, "get_duckie_state": 1.3985476651034511e-06, "in-drivable-lane": 19.70000000000019, "deviation-heading": 0.8643425475741251, "agent_compute-ego0": 0.012985090633015057, "complete-iteration": 0.22911466661390367, "set_robot_commands": 0.0022892312689141913, "deviation-center-line": 0.16829110308199446, "driven_lanedir_consec": 0.687573936025285, "sim_compute_sim_state": 0.010931160161783408, "sim_compute_performance-ego0": 0.0021250410394354183}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.468578074058325, "get_ui_image": 0.026247471198749785, "step_physics": 0.113554648018995, "survival_time": 59.99999999999873, "driven_lanedir": 0.6559502234295558, "get_state_dump": 0.004575863964452434, "get_robot_state": 0.003728983503495724, "sim_render-ego0": 0.00385071256575636, "get_duckie_state": 1.2867853703050193e-06, "in-drivable-lane": 57.04999999999873, "deviation-heading": 0.8231197822184669, "agent_compute-ego0": 0.012300734515988164, "complete-iteration": 0.17483592489974684, "set_robot_commands": 0.002274339939533523, "deviation-center-line": 0.1339207709255853, "driven_lanedir_consec": 0.6559502234295558, "sim_compute_sim_state": 0.006183381680147932, "sim_compute_performance-ego0": 0.0020385455529358266}}
set_robot_commands_max0.0022892312689141913
set_robot_commands_mean0.002272153868471242
set_robot_commands_median0.002279311783457015
set_robot_commands_min0.0022407606380567464
sim_compute_performance-ego0_max0.0021250410394354183
sim_compute_performance-ego0_mean0.0020698611084762376
sim_compute_performance-ego0_median0.0020759537425286963
sim_compute_performance-ego0_min0.0020024959094121393
sim_compute_sim_state_max0.011193169782846702
sim_compute_sim_state_mean0.009748140633378314
sim_compute_sim_state_median0.01080800553525931
sim_compute_sim_state_min0.006183381680147932
sim_render-ego0_max0.003954433916937269
sim_render-ego0_mean0.003862910247213142
sim_render-ego0_median0.00385087581739792
sim_render-ego0_min0.003795455437119458
simulation-passed1
step_physics_max0.15580850433517288
step_physics_mean0.13831756362484857
step_physics_median0.14195355107261323
step_physics_min0.113554648018995
survival_time_max59.99999999999873
survival_time_mean41.27499999999945
survival_time_min22.400000000000183
No reset possible
5414911649Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:06:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7446442092363329
survival_time_median8.699999999999992
deviation-center-line_median0.2659116668412772
in-drivable-lane_median4.300000000000028


other stats
agent_compute-ego0_max0.0138299579489721
agent_compute-ego0_mean0.01297447724202291
agent_compute-ego0_median0.012989357220883829
agent_compute-ego0_min0.012089236577351888
complete-iteration_max0.2397167451920048
complete-iteration_mean0.2035501505530549
complete-iteration_median0.2028981576759915
complete-iteration_min0.16868754166823166
deviation-center-line_max0.3995582240042808
deviation-center-line_mean0.2816465795720398
deviation-center-line_min0.195204760601324
deviation-heading_max1.7513107919184436
deviation-heading_mean1.5526803980982304
deviation-heading_median1.542501525609635
deviation-heading_min1.3744077492552076
driven_any_max2.9244615013818103
driven_any_mean1.9275765418557385
driven_any_median1.690854697770232
driven_any_min1.4041352705006795
driven_lanedir_consec_max1.9635366513753305
driven_lanedir_consec_mean1.0109427105798572
driven_lanedir_consec_min0.5909457724714327
driven_lanedir_max1.9635366513753305
driven_lanedir_mean1.0370006412890889
driven_lanedir_median0.7455968466547352
driven_lanedir_min0.6932722204715547
get_duckie_state_max2.9394071396083047e-06
get_duckie_state_mean2.5632955659535494e-06
get_duckie_state_median2.4717164963109857e-06
get_duckie_state_min2.3703421315839213e-06
get_robot_state_max0.004027671002327127
get_robot_state_mean0.0038748112111173343
get_robot_state_median0.003880118976193727
get_robot_state_min0.003711335889754757
get_state_dump_max0.005241797394948463
get_state_dump_mean0.005057178101244189
get_state_dump_median0.005062667034521691
get_state_dump_min0.0048615809409849105
get_ui_image_max0.03565537766234515
get_ui_image_mean0.03163397016066055
get_ui_image_median0.032089732945633546
get_ui_image_min0.026701037089029947
in-drivable-lane_max5.800000000000009
in-drivable-lane_mean4.362500000000013
in-drivable-lane_min3.049999999999989
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.9244615013818103, "get_ui_image": 0.02945571334649485, "step_physics": 0.10859870149734172, "survival_time": 14.050000000000065, "driven_lanedir": 1.9635366513753305, "get_state_dump": 0.005041798801286846, "get_robot_state": 0.004027671002327127, "sim_render-ego0": 0.004050514376755302, "get_duckie_state": 2.515231463926058e-06, "in-drivable-lane": 4.90000000000007, "deviation-heading": 1.551395699523732, "agent_compute-ego0": 0.01299878553295812, "complete-iteration": 0.17936879945984968, "set_robot_commands": 0.0024508804294234472, "deviation-center-line": 0.3995582240042808, "driven_lanedir_consec": 1.9635366513753305, "sim_compute_sim_state": 0.010387115444697387, "sim_compute_performance-ego0": 0.002257441798000471}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.4395506792109536, "get_ui_image": 0.03472375254477224, "step_physics": 0.16486350797837782, "survival_time": 7.699999999999981, "driven_lanedir": 0.6932722204715547, "get_state_dump": 0.0048615809409849105, "get_robot_state": 0.003711335889754757, "sim_render-ego0": 0.003900663314327117, "get_duckie_state": 2.3703421315839213e-06, "in-drivable-lane": 3.699999999999987, "deviation-heading": 1.7513107919184436, "agent_compute-ego0": 0.012979928908809538, "complete-iteration": 0.2397167451920048, "set_robot_commands": 0.0023449297874204573, "deviation-center-line": 0.30797034278400925, "driven_lanedir_consec": 0.5909457724714327, "sim_compute_sim_state": 0.010136747360229492, "sim_compute_performance-ego0": 0.0020985803296489102}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4041352705006795, "get_ui_image": 0.03565537766234515, "step_physics": 0.14939051621580776, "survival_time": 7.249999999999982, "driven_lanedir": 0.7484105651111228, "get_state_dump": 0.005241797394948463, "get_robot_state": 0.004007886533867823, "sim_render-ego0": 0.0041443044192170445, "get_duckie_state": 2.9394071396083047e-06, "in-drivable-lane": 3.049999999999989, "deviation-heading": 1.5336073516955382, "agent_compute-ego0": 0.0138299579489721, "complete-iteration": 0.2264275158921333, "set_robot_commands": 0.002486189750775899, "deviation-center-line": 0.2238529908985452, "driven_lanedir_consec": 0.7465052902743181, "sim_compute_sim_state": 0.009376984753020822, "sim_compute_performance-ego0": 0.0021910226508362655}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.9421587163295104, "get_ui_image": 0.026701037089029947, "step_physics": 0.10742563467759352, "survival_time": 9.700000000000005, "driven_lanedir": 0.7427831281983477, "get_state_dump": 0.005083535267756536, "get_robot_state": 0.0037523514185196314, "sim_render-ego0": 0.003907934824625651, "get_duckie_state": 2.4282015286959133e-06, "in-drivable-lane": 5.800000000000009, "deviation-heading": 1.3744077492552076, "agent_compute-ego0": 0.012089236577351888, "complete-iteration": 0.16868754166823166, "set_robot_commands": 0.002229668543888972, "deviation-center-line": 0.195204760601324, "driven_lanedir_consec": 0.7427831281983477, "sim_compute_sim_state": 0.005356606459006285, "sim_compute_performance-ego0": 0.0020490145071958886}}
set_robot_commands_max0.002486189750775899
set_robot_commands_mean0.0023779171278771943
set_robot_commands_median0.0023979051084219525
set_robot_commands_min0.002229668543888972
sim_compute_performance-ego0_max0.002257441798000471
sim_compute_performance-ego0_mean0.0021490148214203834
sim_compute_performance-ego0_median0.002144801490242588
sim_compute_performance-ego0_min0.0020490145071958886
sim_compute_sim_state_max0.010387115444697387
sim_compute_sim_state_mean0.008814363504238497
sim_compute_sim_state_median0.009756866056625155
sim_compute_sim_state_min0.005356606459006285
sim_render-ego0_max0.0041443044192170445
sim_render-ego0_mean0.004000854233731279
sim_render-ego0_median0.0039792246006904765
sim_render-ego0_min0.003900663314327117
simulation-passed1
step_physics_max0.16486350797837782
step_physics_mean0.1325695900922802
step_physics_median0.12899460885657474
step_physics_min0.10742563467759352
survival_time_max14.050000000000065
survival_time_mean9.675000000000008
survival_time_min7.249999999999982
No reset possible
5412711674Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerroryesnogpu-prod-020:10:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5400811695Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:36:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.137365838211297
survival_time_median59.99999999999873
deviation-center-line_median4.331118304308271
in-drivable-lane_median2.37499999999992


other stats
agent_compute-ego0_max0.01249874243629068
agent_compute-ego0_mean0.011933104815782986
agent_compute-ego0_median0.0118030324298955
agent_compute-ego0_min0.011627611967050266
complete-iteration_max0.24499258907708796
complete-iteration_mean0.21581257871022935
complete-iteration_median0.21424613899183725
complete-iteration_min0.18976544778015492
deviation-center-line_max4.597575472640299
deviation-center-line_mean3.8877282875522217
deviation-center-line_min2.291101068952043
deviation-heading_max15.680038228801264
deviation-heading_mean13.836557267465157
deviation-heading_median14.741442141849788
deviation-heading_min10.18330655735978
driven_any_max19.128553959479436
driven_any_mean14.994445450435364
driven_any_median15.42787651628182
driven_any_min9.99347480969838
driven_lanedir_consec_max18.01922925970912
driven_lanedir_consec_mean12.140785762180425
driven_lanedir_consec_min8.269182112589986
driven_lanedir_max18.01922925970912
driven_lanedir_mean13.541567088558702
driven_lanedir_median13.932575422103303
driven_lanedir_min8.281888250319078
get_duckie_state_max1.3713925487087548e-06
get_duckie_state_mean1.3399479857886569e-06
get_duckie_state_median1.3364145499681256e-06
get_duckie_state_min1.315570294509621e-06
get_robot_state_max0.004096133822108387
get_robot_state_mean0.003840003894512024
get_robot_state_median0.0037699446491555903
get_robot_state_min0.003723992457628528
get_state_dump_max0.005063038483745947
get_state_dump_mean0.004833537902626295
get_state_dump_median0.004805185577781525
get_state_dump_min0.004660741971196184
get_ui_image_max0.035380577068344736
get_ui_image_mean0.030916276325240737
get_ui_image_median0.030812134949194204
get_ui_image_min0.026660258334229796
in-drivable-lane_max6.2999999999997165
in-drivable-lane_mean2.937499999999879
in-drivable-lane_min0.6999999999999602
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 19.128553959479436, "get_ui_image": 0.02803537887300083, "step_physics": 0.12376556388543708, "survival_time": 59.99999999999873, "driven_lanedir": 18.01922925970912, "get_state_dump": 0.0048532996149881, "get_robot_state": 0.003787783758527134, "sim_render-ego0": 0.0038538826792365206, "get_duckie_state": 1.315570294509621e-06, "in-drivable-lane": 0.849999999999973, "deviation-heading": 14.378720718155824, "agent_compute-ego0": 0.011627611967050266, "complete-iteration": 0.18976544778015492, "set_robot_commands": 0.0022854838740517954, "deviation-center-line": 4.597575472640299, "driven_lanedir_consec": 18.01922925970912, "sim_compute_sim_state": 0.009364393529645808, "sim_compute_performance-ego0": 0.002101897002259063}, "LF-norm-zigzag-000-ego0": {"driven_any": 14.856654581832473, "get_ui_image": 0.035380577068344736, "step_physics": 0.1672908912391885, "survival_time": 59.99999999999873, "driven_lanedir": 13.824512833163368, "get_state_dump": 0.004660741971196184, "get_robot_state": 0.0037521055397840464, "sim_render-ego0": 0.0038107765604316144, "get_duckie_state": 1.3250990970049374e-06, "in-drivable-lane": 0.6999999999999602, "deviation-heading": 15.680038228801264, "agent_compute-ego0": 0.01191877584274762, "complete-iteration": 0.24499258907708796, "set_robot_commands": 0.0022905988558245935, "deviation-center-line": 4.231308107450675, "driven_lanedir_consec": 13.824512833163368, "sim_compute_sim_state": 0.013707155788272349, "sim_compute_performance-ego0": 0.0020916007341294364}, "LF-norm-techtrack-000-ego0": {"driven_any": 15.999098450731168, "get_ui_image": 0.03358889102538758, "step_physics": 0.16091292644916824, "survival_time": 59.99999999999873, "driven_lanedir": 14.04063801104324, "get_state_dump": 0.005063038483745947, "get_robot_state": 0.004096133822108387, "sim_render-ego0": 0.004078816017640024, "get_duckie_state": 1.3477300029313138e-06, "in-drivable-lane": 3.899999999999867, "deviation-heading": 15.10416356554375, "agent_compute-ego0": 0.01249874243629068, "complete-iteration": 0.23791535132929845, "set_robot_commands": 0.002459636238790571, "deviation-center-line": 4.430928501165867, "driven_lanedir_consec": 8.45021884325922, "sim_compute_sim_state": 0.012840099279132116, "sim_compute_performance-ego0": 0.0022762044085551064}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.99347480969838, "get_ui_image": 0.026660258334229796, "step_physics": 0.1295021801527776, "survival_time": 42.8999999999997, "driven_lanedir": 8.281888250319078, "get_state_dump": 0.00475707154057495, "get_robot_state": 0.003723992457628528, "sim_render-ego0": 0.003769671403487431, "get_duckie_state": 1.3713925487087548e-06, "in-drivable-lane": 6.2999999999997165, "deviation-heading": 10.18330655735978, "agent_compute-ego0": 0.011687289017043375, "complete-iteration": 0.19057692665437603, "set_robot_commands": 0.002260456540393052, "deviation-center-line": 2.291101068952043, "driven_lanedir_consec": 8.269182112589986, "sim_compute_sim_state": 0.006137276972547538, "sim_compute_performance-ego0": 0.0019896768718715044}}
set_robot_commands_max0.002459636238790571
set_robot_commands_mean0.002324043877265003
set_robot_commands_median0.0022880413649381945
set_robot_commands_min0.002260456540393052
sim_compute_performance-ego0_max0.0022762044085551064
sim_compute_performance-ego0_mean0.002114844754203778
sim_compute_performance-ego0_median0.00209674886819425
sim_compute_performance-ego0_min0.0019896768718715044
sim_compute_sim_state_max0.013707155788272349
sim_compute_sim_state_mean0.010512231392399452
sim_compute_sim_state_median0.01110224640438896
sim_compute_sim_state_min0.006137276972547538
sim_render-ego0_max0.004078816017640024
sim_render-ego0_mean0.0038782866651988976
sim_render-ego0_median0.003832329619834067
sim_render-ego0_min0.003769671403487431
simulation-passed1
step_physics_max0.1672908912391885
step_physics_mean0.14536789043164283
step_physics_median0.1452075533009729
step_physics_min0.12376556388543708
survival_time_max59.99999999999873
survival_time_mean55.72499999999897
survival_time_min42.8999999999997
No reset possible
5390711728Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:36:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.4253230643298624
survival_time_median59.99999999999873
deviation-center-line_median1.606181708822092
in-drivable-lane_median32.24999999999908


other stats
agent_compute-ego0_max0.013257928930849556
agent_compute-ego0_mean0.013033529846117898
agent_compute-ego0_median0.013043927799989426
agent_compute-ego0_min0.012788334853643184
complete-iteration_max0.23135550770533272
complete-iteration_mean0.2056561500342251
complete-iteration_median0.2077093400996864
complete-iteration_min0.1758504122321949
deviation-center-line_max3.627426986229792
deviation-center-line_mean1.8593475496218468
deviation-center-line_min0.5975997946134114
deviation-heading_max14.41396246805705
deviation-heading_mean8.125207821365578
deviation-heading_median6.713644344575366
deviation-heading_min4.659580128254529
driven_any_max10.708362043937294
driven_any_mean9.754408859252308
driven_any_median9.646479760261752
driven_any_min9.01631387254843
driven_lanedir_consec_max9.699065722084054
driven_lanedir_consec_mean4.452843725573148
driven_lanedir_consec_min1.2616630515488148
driven_lanedir_max9.699065722084054
driven_lanedir_mean4.887990030564388
driven_lanedir_median4.295615674312341
driven_lanedir_min1.2616630515488148
get_duckie_state_max1.5355156533938573e-06
get_duckie_state_mean1.4777060331233263e-06
get_duckie_state_median1.4865924476286851e-06
get_duckie_state_min1.4021235838420782e-06
get_robot_state_max0.00417046892404329
get_robot_state_mean0.004047043645236939
get_robot_state_median0.004049280898755635
get_robot_state_min0.003919143859393194
get_state_dump_max0.005244715029155087
get_state_dump_mean0.005172560440014754
get_state_dump_median0.005184467755387792
get_state_dump_min0.005076591220128348
get_ui_image_max0.036926978632969024
get_ui_image_mean0.03224758855944446
get_ui_image_median0.03246677559558151
get_ui_image_min0.027129824413645778
in-drivable-lane_max50.49999999999877
in-drivable-lane_mean29.8499999999992
in-drivable-lane_min4.399999999999846
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.341055265480351, "get_ui_image": 0.030262815713655165, "step_physics": 0.12328745730157348, "survival_time": 52.39999999999916, "driven_lanedir": 6.186432790823307, "get_state_dump": 0.005220426844914148, "get_robot_state": 0.00417046892404329, "sim_render-ego0": 0.0042286569215321795, "get_duckie_state": 1.5355156533938573e-06, "in-drivable-lane": 21.599999999999547, "deviation-heading": 7.167097243079365, "agent_compute-ego0": 0.01308944023030502, "complete-iteration": 0.19664579578759672, "set_robot_commands": 0.002486664187464973, "deviation-center-line": 1.988372353259797, "driven_lanedir_consec": 4.44584757085835, "sim_compute_sim_state": 0.011427769101836549, "sim_compute_performance-ego0": 0.0023697729447094795}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.708362043937294, "get_ui_image": 0.036926978632969024, "step_physics": 0.14973358349637325, "survival_time": 59.99999999999873, "driven_lanedir": 9.699065722084054, "get_state_dump": 0.005076591220128348, "get_robot_state": 0.003960652911196541, "sim_render-ego0": 0.004140528512934066, "get_duckie_state": 1.4021235838420782e-06, "in-drivable-lane": 4.399999999999846, "deviation-heading": 14.41396246805705, "agent_compute-ego0": 0.012788334853643184, "complete-iteration": 0.23135550770533272, "set_robot_commands": 0.0023729926243511268, "deviation-center-line": 3.627426986229792, "driven_lanedir_consec": 9.699065722084054, "sim_compute_sim_state": 0.014017285554236316, "sim_compute_performance-ego0": 0.0022367406745040347}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.01631387254843, "get_ui_image": 0.03467073547750786, "step_physics": 0.14102637122612413, "survival_time": 59.99999999999873, "driven_lanedir": 1.2616630515488148, "get_state_dump": 0.005244715029155087, "get_robot_state": 0.004137908886314729, "sim_render-ego0": 0.004176725455862993, "get_duckie_state": 1.5184543809723994e-06, "in-drivable-lane": 50.49999999999877, "deviation-heading": 4.659580128254529, "agent_compute-ego0": 0.013257928930849556, "complete-iteration": 0.2187728844117761, "set_robot_commands": 0.0024526728678503995, "deviation-center-line": 0.5975997946134114, "driven_lanedir_consec": 1.2616630515488148, "sim_compute_sim_state": 0.01140979148267608, "sim_compute_performance-ego0": 0.00229026058333601}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.95190425504315, "get_ui_image": 0.027129824413645778, "step_physics": 0.11146707121875264, "survival_time": 59.99999999999873, "driven_lanedir": 2.4047985578013753, "get_state_dump": 0.005148508665861436, "get_robot_state": 0.003919143859393194, "sim_render-ego0": 0.003998797700168886, "get_duckie_state": 1.4547305142849709e-06, "in-drivable-lane": 42.89999999999862, "deviation-heading": 6.260191446071367, "agent_compute-ego0": 0.01299841536967383, "complete-iteration": 0.1758504122321949, "set_robot_commands": 0.002340286994953139, "deviation-center-line": 1.223991064384387, "driven_lanedir_consec": 2.4047985578013753, "sim_compute_sim_state": 0.006616599156794997, "sim_compute_performance-ego0": 0.0021320505007220544}}
set_robot_commands_max0.002486664187464973
set_robot_commands_mean0.0024131541686549097
set_robot_commands_median0.002412832746100763
set_robot_commands_min0.002340286994953139
sim_compute_performance-ego0_max0.0023697729447094795
sim_compute_performance-ego0_mean0.0022572061758178944
sim_compute_performance-ego0_median0.0022635006289200223
sim_compute_performance-ego0_min0.0021320505007220544
sim_compute_sim_state_max0.014017285554236316
sim_compute_sim_state_mean0.010867861323885983
sim_compute_sim_state_median0.011418780292256313
sim_compute_sim_state_min0.006616599156794997
sim_render-ego0_max0.0042286569215321795
sim_render-ego0_mean0.004136177147624531
sim_render-ego0_median0.00415862698439853
sim_render-ego0_min0.003998797700168886
simulation-passed1
step_physics_max0.14973358349637325
step_physics_mean0.1313786208107059
step_physics_median0.13215691426384882
step_physics_min0.11146707121875264
survival_time_max59.99999999999873
survival_time_mean58.09999999999883
survival_time_min52.39999999999916
No reset possible