Duckietown Challenges Home Challenges Submissions

Evaluator 4897

ID4897
evaluatornogpu-prod-07
ownerI don't have one 😀
machinenogpu-prod_2b539ef57384
processnogpu-prod-07_2b539ef57384
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success22 53952
# timeout1 57563
# failed2 54905
# error1 54250
# aborted1 57332
# host-error42 53938
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5756311313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simtimeoutyesnogpu-prod-07----No reset possible
5749110912Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:23:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1223850926988455
survival_time_median28.100000000000264
deviation-center-line_median0.9573343861341412
in-drivable-lane_median2.7750000000000377


other stats
agent_compute-ego0_max0.013140877416311217
agent_compute-ego0_mean0.012762576288175308
agent_compute-ego0_median0.012970492994193167
agent_compute-ego0_min0.011968441748003678
complete-iteration_max0.2067294027194504
complete-iteration_mean0.18226126493540337
complete-iteration_median0.18400771106334987
complete-iteration_min0.15430023489546318
deviation-center-line_max1.8608474495315033
deviation-center-line_mean1.0829030119620096
deviation-center-line_min0.5560958260482521
deviation-heading_max9.024849054340654
deviation-heading_mean5.2588186511519766
deviation-heading_median5.0487641049478995
deviation-heading_min1.912897340371456
driven_any_max9.277688686117006
driven_any_mean4.962696019171977
driven_any_median4.068392750954551
driven_any_min2.4363098886617984
driven_lanedir_consec_max9.12998798296876
driven_lanedir_consec_mean4.3412732562369065
driven_lanedir_consec_min1.9903348565811787
driven_lanedir_max9.12998798296876
driven_lanedir_mean4.347458241870845
driven_lanedir_median3.1347550639667205
driven_lanedir_min1.9903348565811787
get_duckie_state_max2.122364161204707e-06
get_duckie_state_mean1.972954764739824e-06
get_duckie_state_median1.978796403306952e-06
get_duckie_state_min1.8118620911406837e-06
get_robot_state_max0.00375200155352758
get_robot_state_mean0.0036571129720336017
get_robot_state_median0.003667394496740999
get_robot_state_min0.003541661341124828
get_state_dump_max0.004744638694575959
get_state_dump_mean0.0046549468176105184
get_state_dump_median0.004714132248411549
get_state_dump_min0.004446884079043018
get_ui_image_max0.03527752624070349
get_ui_image_mean0.030226325989699016
get_ui_image_median0.030225242468987376
get_ui_image_min0.025177292780117825
in-drivable-lane_max9.95000000000014
in-drivable-lane_mean3.875000000000054
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4363098886617984, "get_ui_image": 0.0282423181767844, "step_physics": 0.10036449125208008, "survival_time": 16.250000000000096, "driven_lanedir": 2.1912391128237063, "get_state_dump": 0.004744638694575959, "get_robot_state": 0.003624774195665231, "sim_render-ego0": 0.003977595662778141, "get_duckie_state": 2.122364161204707e-06, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 1.912897340371456, "agent_compute-ego0": 0.012921266760562829, "complete-iteration": 0.1683253371642411, "set_robot_commands": 0.002218531684641458, "deviation-center-line": 0.7470168778200689, "driven_lanedir_consec": 2.1912391128237063, "sim_compute_sim_state": 0.010120898668020049, "sim_compute_performance-ego0": 0.0020226079262107427}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.4362841659318804, "get_ui_image": 0.03527752624070349, "step_physics": 0.12967051257771894, "survival_time": 24.150000000000208, "driven_lanedir": 1.9903348565811787, "get_state_dump": 0.00474039483661494, "get_robot_state": 0.00375200155352758, "sim_render-ego0": 0.003988611796670709, "get_duckie_state": 1.9945388983103855e-06, "in-drivable-lane": 9.95000000000014, "deviation-heading": 3.2508108054450817, "agent_compute-ego0": 0.013140877416311217, "complete-iteration": 0.2067294027194504, "set_robot_commands": 0.002220130163775988, "deviation-center-line": 0.5560958260482521, "driven_lanedir_consec": 1.9903348565811787, "sim_compute_sim_state": 0.011816195220001472, "sim_compute_performance-ego0": 0.002033553832818654}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.700501335977223, "get_ui_image": 0.03220816676119035, "step_physics": 0.12594656335230556, "survival_time": 32.05000000000032, "driven_lanedir": 4.078271015109735, "get_state_dump": 0.004687869660208158, "get_robot_state": 0.003710014797816767, "sim_render-ego0": 0.003946800098240932, "get_duckie_state": 1.963053908303519e-06, "in-drivable-lane": 3.350000000000044, "deviation-heading": 6.846717404450717, "agent_compute-ego0": 0.013019719227823513, "complete-iteration": 0.19969008496245863, "set_robot_commands": 0.0022313093470635813, "deviation-center-line": 1.1676518944482135, "driven_lanedir_consec": 4.053531072573985, "sim_compute_sim_state": 0.011821857122617348, "sim_compute_performance-ego0": 0.0020266749034418123}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.277688686117006, "get_ui_image": 0.025177292780117825, "step_physics": 0.09541280283518971, "survival_time": 59.99999999999873, "driven_lanedir": 9.12998798296876, "get_state_dump": 0.004446884079043018, "get_robot_state": 0.003541661341124828, "sim_render-ego0": 0.0037197897972214926, "get_duckie_state": 1.8118620911406837e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.024849054340654, "agent_compute-ego0": 0.011968441748003678, "complete-iteration": 0.15430023489546318, "set_robot_commands": 0.0021340322931243617, "deviation-center-line": 1.8608474495315033, "driven_lanedir_consec": 9.12998798296876, "sim_compute_sim_state": 0.005917143960678012, "sim_compute_performance-ego0": 0.0018983766697130036}}
set_robot_commands_max0.0022313093470635813
set_robot_commands_mean0.0022010008721513475
set_robot_commands_median0.002219330924208723
set_robot_commands_min0.0021340322931243617
sim_compute_performance-ego0_max0.002033553832818654
sim_compute_performance-ego0_mean0.001995303333046053
sim_compute_performance-ego0_median0.0020246414148262773
sim_compute_performance-ego0_min0.0018983766697130036
sim_compute_sim_state_max0.011821857122617348
sim_compute_sim_state_mean0.00991902374282922
sim_compute_sim_state_median0.01096854694401076
sim_compute_sim_state_min0.005917143960678012
sim_render-ego0_max0.003988611796670709
sim_render-ego0_mean0.003908199338727819
sim_render-ego0_median0.003962197880509537
sim_render-ego0_min0.0037197897972214926
simulation-passed1
step_physics_max0.12967051257771894
step_physics_mean0.11284859250432357
step_physics_median0.1131555273021928
step_physics_min0.09541280283518971
survival_time_max59.99999999999873
survival_time_mean33.112499999999834
survival_time_min16.250000000000096
No reset possible
5735610959Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:24:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.3702010496974277
survival_time_median33.92500000000021
deviation-center-line_median1.728840377797431
in-drivable-lane_median7.424999999999967


other stats
agent_compute-ego0_max0.03527425041905156
agent_compute-ego0_mean0.028204709246360732
agent_compute-ego0_median0.032320651941556304
agent_compute-ego0_min0.012903282683278767
complete-iteration_max0.2353577251885927
complete-iteration_mean0.20120589144816745
complete-iteration_median0.19121323883067304
complete-iteration_min0.18703936294273096
deviation-center-line_max2.0153369046828327
deviation-center-line_mean1.4402362787195395
deviation-center-line_min0.2879274546004635
deviation-heading_max9.810512045351205
deviation-heading_mean6.564885709327446
deviation-heading_median7.756794342948893
deviation-heading_min0.9354421060607936
driven_any_max8.329673561958007
driven_any_mean4.751306566438373
driven_any_median4.529461159262945
driven_any_min1.6166303852695934
driven_lanedir_consec_max7.466378231716881
driven_lanedir_consec_mean3.725488652970663
driven_lanedir_consec_min0.6951742807709163
driven_lanedir_max7.466378231716881
driven_lanedir_mean3.725488652970663
driven_lanedir_median3.3702010496974277
driven_lanedir_min0.6951742807709163
get_duckie_state_max1.942883125451284e-06
get_duckie_state_mean1.5006486327319763e-06
get_duckie_state_median1.371997030772888e-06
get_duckie_state_min1.3157173439308448e-06
get_robot_state_max0.004033434103172487
get_robot_state_mean0.003769184045590738
get_robot_state_median0.003750199695053109
get_robot_state_min0.003542902689084248
get_state_dump_max0.005201112420036831
get_state_dump_mean0.0049115690653139385
get_state_dump_median0.004907805134019504
get_state_dump_min0.004629553573179915
get_ui_image_max0.036487786882767104
get_ui_image_mean0.03056317461429241
get_ui_image_median0.029720425673133342
get_ui_image_min0.02632406022813585
in-drivable-lane_max7.850000000000068
in-drivable-lane_mean6.737499999999985
in-drivable-lane_min4.249999999999936
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.329673561958007, "get_ui_image": 0.028769133192216426, "step_physics": 0.10655154633978622, "survival_time": 59.99999999999873, "driven_lanedir": 7.466378231716881, "get_state_dump": 0.005201112420036831, "get_robot_state": 0.004033434103172487, "sim_render-ego0": 0.004196181483907962, "get_duckie_state": 1.942883125451284e-06, "in-drivable-lane": 4.249999999999936, "deviation-heading": 9.810512045351205, "agent_compute-ego0": 0.029452283614680337, "complete-iteration": 0.19319194381580465, "set_robot_commands": 0.0023939613497922264, "deviation-center-line": 2.0153369046828327, "driven_lanedir_consec": 7.466378231716881, "sim_compute_sim_state": 0.01023979945345584, "sim_compute_performance-ego0": 0.00224326889679692}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.797718224098764, "get_ui_image": 0.036487786882767104, "step_physics": 0.1344808947741155, "survival_time": 35.8500000000001, "driven_lanedir": 3.753621130249082, "get_state_dump": 0.005103562867741066, "get_robot_state": 0.003823683786525036, "sim_render-ego0": 0.004136516855287685, "get_duckie_state": 1.4139085094908818e-06, "in-drivable-lane": 7.099999999999827, "deviation-heading": 7.131430099340522, "agent_compute-ego0": 0.03518902026843228, "complete-iteration": 0.2353577251885927, "set_robot_commands": 0.0024005563146224595, "deviation-center-line": 1.6806221037651807, "driven_lanedir_consec": 3.753621130249082, "sim_compute_sim_state": 0.011496649147076194, "sim_compute_performance-ego0": 0.0021385346282491446}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.261204094427125, "get_ui_image": 0.03067171815405026, "step_physics": 0.11898739847489712, "survival_time": 32.00000000000032, "driven_lanedir": 2.9867809691457734, "get_state_dump": 0.004629553573179915, "get_robot_state": 0.003542902689084248, "sim_render-ego0": 0.003873104238286963, "get_duckie_state": 1.3300855520548946e-06, "in-drivable-lane": 7.750000000000106, "deviation-heading": 8.382158586557264, "agent_compute-ego0": 0.012903282683278767, "complete-iteration": 0.18923453384554145, "set_robot_commands": 0.0021350766864842072, "deviation-center-line": 1.7770586518296816, "driven_lanedir_consec": 2.9867809691457734, "sim_compute_sim_state": 0.01042525184321887, "sim_compute_performance-ego0": 0.0019744495147847904}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6166303852695934, "get_ui_image": 0.02632406022813585, "step_physics": 0.10328335673720748, "survival_time": 13.450000000000056, "driven_lanedir": 0.6951742807709163, "get_state_dump": 0.004712047400297942, "get_robot_state": 0.003676715603581181, "sim_render-ego0": 0.0040283538677074295, "get_duckie_state": 1.3157173439308448e-06, "in-drivable-lane": 7.850000000000068, "deviation-heading": 0.9354421060607936, "agent_compute-ego0": 0.03527425041905156, "complete-iteration": 0.18703936294273096, "set_robot_commands": 0.00235663166752568, "deviation-center-line": 0.2879274546004635, "driven_lanedir_consec": 0.6951742807709163, "sim_compute_sim_state": 0.005318312291745786, "sim_compute_performance-ego0": 0.001974304517110189}}
set_robot_commands_max0.0024005563146224595
set_robot_commands_mean0.0023215565046061436
set_robot_commands_median0.0023752965086589533
set_robot_commands_min0.0021350766864842072
sim_compute_performance-ego0_max0.00224326889679692
sim_compute_performance-ego0_mean0.002082639389235261
sim_compute_performance-ego0_median0.0020564920715169677
sim_compute_performance-ego0_min0.001974304517110189
sim_compute_sim_state_max0.011496649147076194
sim_compute_sim_state_mean0.009370003183874173
sim_compute_sim_state_median0.010332525648337356
sim_compute_sim_state_min0.005318312291745786
sim_render-ego0_max0.004196181483907962
sim_render-ego0_mean0.004058539111297509
sim_render-ego0_median0.004082435361497557
sim_render-ego0_min0.003873104238286963
simulation-passed1
step_physics_max0.1344808947741155
step_physics_mean0.1158257990815016
step_physics_median0.11276947240734168
step_physics_min0.10328335673720748
survival_time_max59.99999999999873
survival_time_mean35.3249999999998
survival_time_min13.450000000000056
No reset possible
5733211010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-070:01:57
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5731011312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-070:05:22
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5712811014Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:44:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.014438563242840033
agent_compute-ego0_mean0.012687308653308192
agent_compute-ego0_median0.012204638230215004
agent_compute-ego0_min0.011901394909962726
complete-iteration_max0.3694212039642588
complete-iteration_mean0.2840975406366423
complete-iteration_median0.27652771864008846
complete-iteration_min0.21391352130213348
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max2.500913621583251e-06
get_duckie_state_mean1.9442231133021877e-06
get_duckie_state_median1.8414410822198948e-06
get_duckie_state_min1.593096667185711e-06
get_robot_state_max0.004143996600008924
get_robot_state_mean0.003705875462636066
get_robot_state_median0.0036080909906874886
get_robot_state_min0.0034633232691603636
get_state_dump_max0.004978089209500201
get_state_dump_mean0.004682371360276958
get_state_dump_median0.004640497633261446
get_state_dump_min0.00447040096508474
get_ui_image_max0.0368169771443795
get_ui_image_mean0.029545591931656737
get_ui_image_median0.028653009150248585
get_ui_image_min0.024059372281750275
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.026488730155061823, "step_physics": 0.1951963548160016, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.00447040096508474, "get_robot_state": 0.003615696166179063, "sim_render-ego0": 0.003729136162852367, "get_duckie_state": 1.8678438058006671e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.011901394909962726, "complete-iteration": 0.2575971758633629, "set_robot_commands": 0.002137594278607142, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008040816261806059, "sim_compute_performance-ego0": 0.0019381016517658217}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.0368169771443795, "step_physics": 0.28739314611309474, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004978089209500201, "get_robot_state": 0.004143996600008924, "sim_render-ego0": 0.004317983600321062, "get_duckie_state": 2.500913621583251e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.014438563242840033, "complete-iteration": 0.3694212039642588, "set_robot_commands": 0.0024576018394578208, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.012425198344564957, "sim_compute_performance-ego0": 0.0023453741843853268}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.030817288145435343, "step_physics": 0.22792292097823805, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004551492265420194, "get_robot_state": 0.0036004858151959143, "sim_render-ego0": 0.003821317004125184, "get_duckie_state": 1.8150383586391224e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012059469207141123, "complete-iteration": 0.295458261416814, "set_robot_commands": 0.0021659966610949005, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008523741332220098, "sim_compute_performance-ego0": 0.0019155005233472432}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.024059372281750275, "step_physics": 0.15624232038073893, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004729503001102698, "get_robot_state": 0.0034633232691603636, "sim_render-ego0": 0.0035474677566286923, "get_duckie_state": 1.593096667185711e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.012349807253288884, "complete-iteration": 0.21391352130213348, "set_robot_commands": 0.001998178964848324, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.005638684757940974, "sim_compute_performance-ego0": 0.0018113082294956432}}
set_robot_commands_max0.0024576018394578208
set_robot_commands_mean0.002189842936002047
set_robot_commands_median0.0021517954698510216
set_robot_commands_min0.001998178964848324
sim_compute_performance-ego0_max0.0023453741843853268
sim_compute_performance-ego0_mean0.002002571147248509
sim_compute_performance-ego0_median0.0019268010875565325
sim_compute_performance-ego0_min0.0018113082294956432
sim_compute_sim_state_max0.012425198344564957
sim_compute_sim_state_mean0.008657110174133021
sim_compute_sim_state_median0.008282278797013078
sim_compute_sim_state_min0.005638684757940974
sim_render-ego0_max0.004317983600321062
sim_render-ego0_mean0.0038539761309818264
sim_render-ego0_median0.003775226583488775
sim_render-ego0_min0.0035474677566286923
simulation-passed1
step_physics_max0.28739314611309474
step_physics_mean0.2166886855720183
step_physics_median0.21155963789711985
step_physics_min0.15624232038073893
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5710611425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-070:00:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5696011049Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:26:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.381157471276697
survival_time_median45.82499999999952
deviation-center-line_median1.5896444814096409
in-drivable-lane_median8.225000000000023


other stats
agent_compute-ego0_max0.013428329599314722
agent_compute-ego0_mean0.013057465305849005
agent_compute-ego0_median0.013172859214099598
agent_compute-ego0_min0.012455813195882091
complete-iteration_max0.21103585074088857
complete-iteration_mean0.18667855317582657
complete-iteration_median0.18584137014608296
complete-iteration_min0.1639956216702516
deviation-center-line_max2.748266384395304
deviation-center-line_mean1.5638487474174871
deviation-center-line_min0.32783964245536257
deviation-heading_max13.10814099247895
deviation-heading_mean7.936715170300672
deviation-heading_median7.662388379280076
deviation-heading_min3.313942930163587
driven_any_max7.73326538024463
driven_any_mean5.331369361305071
driven_any_median5.543406833334114
driven_any_min2.5053983983074226
driven_lanedir_consec_max7.586725152879582
driven_lanedir_consec_mean4.252365214583663
driven_lanedir_consec_min0.6604207629016774
driven_lanedir_max7.586725152879582
driven_lanedir_mean4.255566643478365
driven_lanedir_median4.381157471276697
driven_lanedir_min0.6732264784804844
get_duckie_state_max1.6384696358761954e-06
get_duckie_state_mean1.4901362645596298e-06
get_duckie_state_median1.4701002719113962e-06
get_duckie_state_min1.381874878539531e-06
get_robot_state_max0.004000282814074014
get_robot_state_mean0.003769837320708531
get_robot_state_median0.0037376303299807272
get_robot_state_min0.0036038058087986577
get_state_dump_max0.004878347980487234
get_state_dump_mean0.004687891051263143
get_state_dump_median0.0046782040030806105
get_state_dump_min0.0045168082184041175
get_ui_image_max0.03565927449114416
get_ui_image_mean0.03073824745600815
get_ui_image_median0.03009554491292032
get_ui_image_min0.027102625507047808
in-drivable-lane_max14.35000000000019
in-drivable-lane_mean7.700000000000059
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.73326538024463, "get_ui_image": 0.027529030219402836, "step_physics": 0.10289767640119388, "survival_time": 59.99999999999873, "driven_lanedir": 7.586725152879582, "get_state_dump": 0.0045168082184041175, "get_robot_state": 0.0036038058087986577, "sim_render-ego0": 0.0038121141660818945, "get_duckie_state": 1.381874878539531e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.118195872664216, "agent_compute-ego0": 0.012455813195882091, "complete-iteration": 0.16841276261729066, "set_robot_commands": 0.0021314845295571767, "deviation-center-line": 2.0298325605554774, "driven_lanedir_consec": 7.586725152879582, "sim_compute_sim_state": 0.00938809126441822, "sim_compute_performance-ego0": 0.0019863449862160157}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.332116345376601, "get_ui_image": 0.03565927449114416, "step_physics": 0.1336596645383811, "survival_time": 59.99999999999873, "driven_lanedir": 6.578985412110802, "get_state_dump": 0.004587243339799028, "get_robot_state": 0.0037314570218101328, "sim_render-ego0": 0.003914809643874855, "get_duckie_state": 1.52996835065424e-06, "in-drivable-lane": 3.899999999999867, "deviation-heading": 13.10814099247895, "agent_compute-ego0": 0.013026509257180805, "complete-iteration": 0.21103585074088857, "set_robot_commands": 0.002235199192183699, "deviation-center-line": 2.748266384395304, "driven_lanedir_consec": 6.578985412110802, "sim_compute_sim_state": 0.012053547056390284, "sim_compute_performance-ego0": 0.0020755256443198374}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.7546973212916273, "get_ui_image": 0.0326620596064378, "step_physics": 0.128291724232093, "survival_time": 31.650000000000315, "driven_lanedir": 2.183329530442592, "get_state_dump": 0.004878347980487234, "get_robot_state": 0.004000282814074014, "sim_render-ego0": 0.004104338233779281, "get_duckie_state": 1.6384696358761954e-06, "in-drivable-lane": 12.550000000000178, "deviation-heading": 5.206580885895935, "agent_compute-ego0": 0.01331920917101839, "complete-iteration": 0.20326997767487537, "set_robot_commands": 0.002335683028404645, "deviation-center-line": 1.1494564022638043, "driven_lanedir_consec": 2.183329530442592, "sim_compute_sim_state": 0.01135916852800628, "sim_compute_performance-ego0": 0.002208128712530768}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.5053983983074226, "get_ui_image": 0.027102625507047808, "step_physics": 0.1013868671724166, "survival_time": 21.700000000000173, "driven_lanedir": 0.6732264784804844, "get_state_dump": 0.004769164666362192, "get_robot_state": 0.003743803638151322, "sim_render-ego0": 0.003983592438971859, "get_duckie_state": 1.4102321931685524e-06, "in-drivable-lane": 14.35000000000019, "deviation-heading": 3.313942930163587, "agent_compute-ego0": 0.013428329599314722, "complete-iteration": 0.1639956216702516, "set_robot_commands": 0.0022573668381263468, "deviation-center-line": 0.32783964245536257, "driven_lanedir_consec": 0.6604207629016774, "sim_compute_sim_state": 0.005203440545619219, "sim_compute_performance-ego0": 0.002025934197436804}}
set_robot_commands_max0.002335683028404645
set_robot_commands_mean0.002239933397067967
set_robot_commands_median0.002246283015155023
set_robot_commands_min0.0021314845295571767
sim_compute_performance-ego0_max0.002208128712530768
sim_compute_performance-ego0_mean0.0020739833851258563
sim_compute_performance-ego0_median0.002050729920878321
sim_compute_performance-ego0_min0.0019863449862160157
sim_compute_sim_state_max0.012053547056390284
sim_compute_sim_state_mean0.0095010618486085
sim_compute_sim_state_median0.01037362989621225
sim_compute_sim_state_min0.005203440545619219
sim_render-ego0_max0.004104338233779281
sim_render-ego0_mean0.003953713620676973
sim_render-ego0_median0.003949201041423357
sim_render-ego0_min0.0038121141660818945
simulation-passed1
step_physics_max0.1336596645383811
step_physics_mean0.11655898308602115
step_physics_median0.11559470031664346
step_physics_min0.1013868671724166
survival_time_max59.99999999999873
survival_time_mean43.33749999999948
survival_time_min21.700000000000173
No reset possible
5693011427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-070:05:34
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5682611075Fernanda Custodio Pereira do Carmo 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:18:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.974637481526261
survival_time_median26.949999999999967
deviation-center-line_median1.460656626642476
in-drivable-lane_median5.1000000000000085


other stats
agent_compute-ego0_max0.01413726806640625
agent_compute-ego0_mean0.013209578675637944
agent_compute-ego0_median0.01314797181215457
agent_compute-ego0_min0.012405103011836383
complete-iteration_max0.24374302657874855
complete-iteration_mean0.19083275010929063
complete-iteration_median0.18032238102719503
complete-iteration_min0.15894321180402388
deviation-center-line_max2.787417108078256
deviation-center-line_mean1.464774902340205
deviation-center-line_min0.15036924799761245
deviation-heading_max7.401194599401272
deviation-heading_mean4.238478672744466
deviation-heading_median4.300474472949931
deviation-heading_min0.9517711456767292
driven_any_max10.88398168377621
driven_any_mean5.027825262666994
driven_any_median4.249528426547367
driven_any_min0.7282625137970306
driven_lanedir_consec_max9.565720700342991
driven_lanedir_consec_mean3.942641907375215
driven_lanedir_consec_min0.2555719661053466
driven_lanedir_max9.565720700342991
driven_lanedir_mean3.964233104975592
driven_lanedir_median3.017819876727015
driven_lanedir_min0.2555719661053466
get_duckie_state_max1.7634383193007462e-06
get_duckie_state_mean1.450734248692192e-06
get_duckie_state_median1.3957678810252222e-06
get_duckie_state_min1.247962913417577e-06
get_robot_state_max0.004213822854531778
get_robot_state_mean0.0038871400155585326
get_robot_state_median0.003868910635944808
get_robot_state_min0.003596915935812737
get_state_dump_max0.005116370347169068
get_state_dump_mean0.004792546203784275
get_state_dump_median0.004808814939420092
get_state_dump_min0.004436184589127849
get_ui_image_max0.03852548255576744
get_ui_image_mean0.03145984188997196
get_ui_image_median0.03046555022128466
get_ui_image_min0.026382784561551083
in-drivable-lane_max14.899999999999654
in-drivable-lane_mean6.912499999999927
in-drivable-lane_min2.550000000000036
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.407127450301493, "get_ui_image": 0.02992394799036337, "step_physics": 0.10507705194730284, "survival_time": 14.050000000000065, "driven_lanedir": 2.120622618809238, "get_state_dump": 0.004903905780602854, "get_robot_state": 0.003946416766930979, "sim_render-ego0": 0.004143111249233814, "get_duckie_state": 1.4989934069045047e-06, "in-drivable-lane": 2.550000000000036, "deviation-heading": 1.381315264631244, "agent_compute-ego0": 0.013717938822211949, "complete-iteration": 0.1766744260246872, "set_robot_commands": 0.002394310971523853, "deviation-center-line": 0.5432211838093643, "driven_lanedir_consec": 2.120622618809238, "sim_compute_sim_state": 0.010286686268258604, "sim_compute_performance-ego0": 0.0021769138092690324}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.7282625137970306, "get_ui_image": 0.03852548255576744, "step_physics": 0.16095535604803413, "survival_time": 5.4999999999999885, "driven_lanedir": 0.2555719661053466, "get_state_dump": 0.005116370347169068, "get_robot_state": 0.004213822854531778, "sim_render-ego0": 0.0043205312780431795, "get_duckie_state": 1.7634383193007462e-06, "in-drivable-lane": 3.399999999999988, "deviation-heading": 0.9517711456767292, "agent_compute-ego0": 0.01413726806640625, "complete-iteration": 0.24374302657874855, "set_robot_commands": 0.0024176567524403065, "deviation-center-line": 0.15036924799761245, "driven_lanedir_consec": 0.2555719661053466, "sim_compute_sim_state": 0.011517874829403987, "sim_compute_performance-ego0": 0.002433497626502235}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.091929402793241, "get_ui_image": 0.031007152452205953, "step_physics": 0.11191941592328827, "survival_time": 39.84999999999987, "driven_lanedir": 3.915017134644791, "get_state_dump": 0.004436184589127849, "get_robot_state": 0.003596915935812737, "sim_render-ego0": 0.0038210019133144753, "get_duckie_state": 1.247962913417577e-06, "in-drivable-lane": 14.899999999999654, "deviation-heading": 7.401194599401272, "agent_compute-ego0": 0.012405103011836383, "complete-iteration": 0.1839703360297029, "set_robot_commands": 0.002144573326397659, "deviation-center-line": 2.378092069475587, "driven_lanedir_consec": 3.828652344243285, "sim_compute_sim_state": 0.012578367290640236, "sim_compute_performance-ego0": 0.00198265454524143}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.88398168377621, "get_ui_image": 0.026382784561551083, "step_physics": 0.0968668971033914, "survival_time": 59.99999999999873, "driven_lanedir": 9.565720700342991, "get_state_dump": 0.004713724098237329, "get_robot_state": 0.003791404504958637, "sim_render-ego0": 0.003987487607157101, "get_duckie_state": 1.2925423551459397e-06, "in-drivable-lane": 6.80000000000003, "deviation-heading": 7.219633681268619, "agent_compute-ego0": 0.012578004802097193, "complete-iteration": 0.15894321180402388, "set_robot_commands": 0.002252296841611076, "deviation-center-line": 2.787417108078256, "driven_lanedir_consec": 9.565720700342991, "sim_compute_sim_state": 0.006208705663879547, "sim_compute_performance-ego0": 0.0020799132608354935}}
set_robot_commands_max0.0024176567524403065
set_robot_commands_mean0.002302209472993224
set_robot_commands_median0.0023233039065674644
set_robot_commands_min0.002144573326397659
sim_compute_performance-ego0_max0.002433497626502235
sim_compute_performance-ego0_mean0.0021682448104620475
sim_compute_performance-ego0_median0.002128413535052263
sim_compute_performance-ego0_min0.00198265454524143
sim_compute_sim_state_max0.012578367290640236
sim_compute_sim_state_mean0.010147908513045593
sim_compute_sim_state_median0.010902280548831297
sim_compute_sim_state_min0.006208705663879547
sim_render-ego0_max0.0043205312780431795
sim_render-ego0_mean0.004068033011937143
sim_render-ego0_median0.004065299428195458
sim_render-ego0_min0.0038210019133144753
simulation-passed1
step_physics_max0.16095535604803413
step_physics_mean0.11870468025550417
step_physics_median0.10849823393529556
step_physics_min0.0968668971033914
survival_time_max59.99999999999873
survival_time_mean29.84999999999966
survival_time_min5.4999999999999885
No reset possible
5660911102Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:36:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.3753086319111265
survival_time_median59.99999999999873
deviation-center-line_median2.6611282315632065
in-drivable-lane_median2.499999999999858


other stats
agent_compute-ego0_max0.035261472499338094
agent_compute-ego0_mean0.029428823629236857
agent_compute-ego0_median0.03380253362615936
agent_compute-ego0_min0.014848754765290602
complete-iteration_max0.2348931507020512
complete-iteration_mean0.19898901549287984
complete-iteration_median0.19154819947893076
complete-iteration_min0.17796651231160668
deviation-center-line_max3.1081060092717805
deviation-center-line_mean2.714677324599806
deviation-center-line_min2.428346826001031
deviation-heading_max13.777991935279948
deviation-heading_mean12.350648586667685
deviation-heading_median12.20922530516012
deviation-heading_min11.206151801070542
driven_any_max9.57854710357881
driven_any_mean9.002655148541704
driven_any_median9.236920255406917
driven_any_min7.958232979774177
driven_lanedir_consec_max8.064199363187171
driven_lanedir_consec_mean6.560874683428095
driven_lanedir_consec_min5.428682106702951
driven_lanedir_max9.196582016436832
driven_lanedir_mean8.054160625844027
driven_lanedir_median8.508796781186698
driven_lanedir_min6.00246692456588
get_duckie_state_max1.5013819431682908e-06
get_duckie_state_mean1.3930560487359468e-06
get_duckie_state_median1.3927232492505218e-06
get_duckie_state_min1.2853957532744522e-06
get_robot_state_max0.00378761065194847
get_robot_state_mean0.0037061859700102183
get_robot_state_median0.0037300591215297433
get_robot_state_min0.0035770149850329193
get_state_dump_max0.005045576159106405
get_state_dump_mean0.004756305422409871
get_state_dump_median0.004730832436194299
get_state_dump_min0.004517980658144479
get_ui_image_max0.03588641155426552
get_ui_image_mean0.0303403783773984
get_ui_image_median0.02992031218904341
get_ui_image_min0.025634477577241237
in-drivable-lane_max10.699999999999594
in-drivable-lane_mean4.062499999999827
in-drivable-lane_min0.549999999999998
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.53954530634224, "get_ui_image": 0.02789243115275031, "step_physics": 0.10400549358968236, "survival_time": 59.99999999999873, "driven_lanedir": 8.921205599586823, "get_state_dump": 0.004766612525387271, "get_robot_state": 0.0036857219461001126, "sim_render-ego0": 0.003850833660954738, "get_duckie_state": 1.2853957532744522e-06, "in-drivable-lane": 1.6999999999999034, "deviation-heading": 12.372828194054565, "agent_compute-ego0": 0.0339017555576677, "complete-iteration": 0.1924522292306282, "set_robot_commands": 0.0022654958212008384, "deviation-center-line": 3.1081060092717805, "driven_lanedir_consec": 6.22687349777281, "sim_compute_sim_state": 0.01001426024202701, "sim_compute_performance-ego0": 0.0019741824624143374}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.958232979774177, "get_ui_image": 0.03588641155426552, "step_physics": 0.13540373467836023, "survival_time": 54.99999999999901, "driven_lanedir": 6.00246692456588, "get_state_dump": 0.004695052347001328, "get_robot_state": 0.003774396296959374, "sim_render-ego0": 0.003959860182371495, "get_duckie_state": 1.3739926288823015e-06, "in-drivable-lane": 10.699999999999594, "deviation-heading": 13.777991935279948, "agent_compute-ego0": 0.035261472499338094, "complete-iteration": 0.2348931507020512, "set_robot_commands": 0.0022274975772341417, "deviation-center-line": 2.53184494942641, "driven_lanedir_consec": 5.428682106702951, "sim_compute_sim_state": 0.01156704605546028, "sim_compute_performance-ego0": 0.002023422533982889}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.57854710357881, "get_ui_image": 0.03194819322533651, "step_physics": 0.11381752941630266, "survival_time": 59.99999999999873, "driven_lanedir": 9.196582016436832, "get_state_dump": 0.005045576159106405, "get_robot_state": 0.00378761065194847, "sim_render-ego0": 0.004073838409436533, "get_duckie_state": 1.5013819431682908e-06, "in-drivable-lane": 0.549999999999998, "deviation-heading": 11.206151801070542, "agent_compute-ego0": 0.014848754765290602, "complete-iteration": 0.19064416972723333, "set_robot_commands": 0.002262411863976573, "deviation-center-line": 2.428346826001031, "driven_lanedir_consec": 8.064199363187171, "sim_compute_sim_state": 0.012602194262781708, "sim_compute_performance-ego0": 0.0021583627006791215}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.934295204471592, "get_ui_image": 0.025634477577241237, "step_physics": 0.09636307060470392, "survival_time": 59.99999999999873, "driven_lanedir": 8.096387962786572, "get_state_dump": 0.004517980658144479, "get_robot_state": 0.0035770149850329193, "sim_render-ego0": 0.003785156985305926, "get_duckie_state": 1.411453869618742e-06, "in-drivable-lane": 3.2999999999998124, "deviation-heading": 12.045622416265678, "agent_compute-ego0": 0.033703311694651024, "complete-iteration": 0.17796651231160668, "set_robot_commands": 0.0021638651870867294, "deviation-center-line": 2.7904115137000027, "driven_lanedir_consec": 6.523743766049444, "sim_compute_sim_state": 0.006219074986161637, "sim_compute_performance-ego0": 0.0019153381366713855}}
set_robot_commands_max0.0022654958212008384
set_robot_commands_mean0.0022298176123745706
set_robot_commands_median0.0022449547206053575
set_robot_commands_min0.0021638651870867294
sim_compute_performance-ego0_max0.0021583627006791215
sim_compute_performance-ego0_mean0.0020178264584369333
sim_compute_performance-ego0_median0.0019988024981986135
sim_compute_performance-ego0_min0.0019153381366713855
sim_compute_sim_state_max0.012602194262781708
sim_compute_sim_state_mean0.010100643886607658
sim_compute_sim_state_median0.010790653148743643
sim_compute_sim_state_min0.006219074986161637
sim_render-ego0_max0.004073838409436533
sim_render-ego0_mean0.003917422309517173
sim_render-ego0_median0.003905346921663116
sim_render-ego0_min0.003785156985305926
simulation-passed1
step_physics_max0.13540373467836023
step_physics_mean0.11239745707226229
step_physics_median0.1089115115029925
step_physics_min0.09636307060470392
survival_time_max59.99999999999873
survival_time_mean58.7499999999988
survival_time_min54.99999999999901
No reset possible
5657911112Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:03:11
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5657611278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5652211116Melisande Tengreal-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:03:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5650311429Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-070:00:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5648311281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5645611286Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5640911286Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:01:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5635711287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5629111285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:01:57
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5625211290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:53
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5623511290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:49
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5619711303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5614211450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-070:02:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5612011450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-070:01:54
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5576811419Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV-sim-testingLFVv-simsuccessyesnogpu-prod-070:32:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1253887402315756
survival_time_median11.575000000000053
deviation-center-line_median0.5267204178062265
in-drivable-lane_median0.7750000000000012


other stats
agent_compute-ego0_max0.04713990432875497
agent_compute-ego0_mean0.04192387150832179
agent_compute-ego0_median0.04139478982778814
agent_compute-ego0_min0.0377660020489559
agent_compute-npc0_max0.023087386574063985
agent_compute-npc0_mean0.02061446081012313
agent_compute-npc0_median0.01987180378195221
agent_compute-npc0_min0.01962684910252409
agent_compute-npc1_max0.029141397096326016
agent_compute-npc1_mean0.02587362421013049
agent_compute-npc1_median0.02605174283468014
agent_compute-npc1_min0.022427732699385312
agent_compute-npc2_max0.03020934563762737
agent_compute-npc2_mean0.028541095753121193
agent_compute-npc2_median0.029956815398742107
agent_compute-npc2_min0.025457126222994102
agent_compute-npc3_max0.04055631494967737
agent_compute-npc3_mean0.03948278584108749
agent_compute-npc3_median0.03948278584108749
agent_compute-npc3_min0.03840925673249761
complete-iteration_max1.2261848537509907
complete-iteration_mean0.859561510387918
complete-iteration_median0.9123699897980696
complete-iteration_min0.3873212082045419
deviation-center-line_max1.9105102008993984
deviation-center-line_mean0.8065198207992316
deviation-center-line_min0.2621282466850749
deviation-heading_max6.290265571629366
deviation-heading_mean3.4034043590419496
deviation-heading_median2.90307150625943
deviation-heading_min1.517208852019572
driven_any_max11.398827339954666
driven_any_mean4.39832955407711
driven_any_median2.5763477020302243
driven_any_min1.041795472293323
driven_lanedir_consec_max11.089455557538962
driven_lanedir_consec_mean4.029473772368228
driven_lanedir_consec_min0.7776620514707999
driven_lanedir_max11.089455557538962
driven_lanedir_mean4.029473772368228
driven_lanedir_median2.1253887402315756
driven_lanedir_min0.7776620514707999
get_duckie_state_max2.2671052387782505e-06
get_duckie_state_mean2.040244775779371e-06
get_duckie_state_median2.080162845529357e-06
get_duckie_state_min1.73354817328052e-06
get_robot_state_max0.01658566139912808
get_robot_state_mean0.01335287207045062
get_robot_state_median0.014780473342642809
get_robot_state_min0.0072648801973887855
get_state_dump_max0.010376364921375308
get_state_dump_mean0.008884906179592355
get_state_dump_median0.009406413836768714
get_state_dump_min0.006350432123456683
get_ui_image_max0.047194489808840175
get_ui_image_mean0.04120137228427899
get_ui_image_median0.0435032449788041
get_ui_image_min0.030604509370667592
in-drivable-lane_max2.3000000000000096
in-drivable-lane_mean0.962500000000003
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 11.398827339954666, "get_ui_image": 0.04029674375082212, "step_physics": 0.5549610540801874, "survival_time": 47.64999999999943, "driven_lanedir": 11.089455557538962, "get_state_dump": 0.008967049466738911, "get_robot_state": 0.013631392574910098, "sim_render-ego0": 0.003733936345802163, "sim_render-npc0": 0.003694982148816251, "sim_render-npc1": 0.003695425747325585, "sim_render-npc2": 0.0037277934436278273, "get_duckie_state": 2.0712926452764676e-06, "in-drivable-lane": 0.4500000000000064, "deviation-heading": 6.290265571629366, "agent_compute-ego0": 0.04273716233811289, "agent_compute-npc0": 0.01962684910252409, "agent_compute-npc1": 0.029141397096326016, "agent_compute-npc2": 0.03020934563762737, "complete-iteration": 0.80219862596044, "set_robot_commands": 0.002088555000113241, "deviation-center-line": 1.9105102008993984, "driven_lanedir_consec": 11.089455557538962, "sim_compute_sim_state": 0.03170471171413078, "sim_compute_performance-ego0": 0.001956549580492064, "sim_compute_performance-npc0": 0.0018624837043650245, "sim_compute_performance-npc1": 0.001836529817721129, "sim_compute_performance-npc2": 0.0018534590363252588}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.041795472293323, "get_ui_image": 0.047194489808840175, "step_physics": 0.7121543260378258, "survival_time": 5.299999999999989, "driven_lanedir": 0.9676818382990876, "get_state_dump": 0.009845778206798515, "get_robot_state": 0.01592955411037552, "sim_render-ego0": 0.0035378576439117717, "sim_render-npc0": 0.00334254157877414, "sim_render-npc1": 0.003387333076690959, "sim_render-npc2": 0.003436803817749023, "sim_render-npc3": 0.0034523210792898017, "get_duckie_state": 1.73354817328052e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.039777560201971, "agent_compute-ego0": 0.0377660020489559, "agent_compute-npc0": 0.019915152932995943, "agent_compute-npc1": 0.022427732699385312, "agent_compute-npc2": 0.029956815398742107, "agent_compute-npc3": 0.04055631494967737, "complete-iteration": 1.0225413536356989, "set_robot_commands": 0.0019154013874374816, "deviation-center-line": 0.3565211169349438, "driven_lanedir_consec": 0.9676818382990876, "sim_compute_sim_state": 0.051280538612437025, "sim_compute_performance-ego0": 0.0018148645062312904, "sim_compute_performance-npc0": 0.0016699015537155009, "sim_compute_performance-npc1": 0.0016664366855799594, "sim_compute_performance-npc2": 0.0017016513325343622, "sim_compute_performance-npc3": 0.0016941489460312318}, "LFV-norm-techtrack-000-ego0": {"driven_any": 4.049784571756448, "get_ui_image": 0.04670974620678607, "step_physics": 0.9174160356224428, "survival_time": 17.600000000000115, "driven_lanedir": 3.283095642164064, "get_state_dump": 0.010376364921375308, "get_robot_state": 0.01658566139912808, "sim_render-ego0": 0.0035839567103399432, "sim_render-npc0": 0.0036252341932345384, "sim_render-npc1": 0.0035515365114293083, "sim_render-npc2": 0.003604283076170146, "sim_render-npc3": 0.003668579771565986, "get_duckie_state": 2.089033045782246e-06, "in-drivable-lane": 2.3000000000000096, "deviation-heading": 3.7663654523168897, "agent_compute-ego0": 0.04005241731746339, "agent_compute-npc0": 0.01982845463090848, "agent_compute-npc1": 0.02605174283468014, "agent_compute-npc2": 0.025457126222994102, "agent_compute-npc3": 0.03840925673249761, "complete-iteration": 1.2261848537509907, "set_robot_commands": 0.002025115928974098, "deviation-center-line": 0.6969197186775091, "driven_lanedir_consec": 3.283095642164064, "sim_compute_sim_state": 0.04781302176521453, "sim_compute_performance-ego0": 0.00186390782213076, "sim_compute_performance-npc0": 0.0017929191967583245, "sim_compute_performance-npc1": 0.0017632668146668343, "sim_compute_performance-npc2": 0.0018201252556387492, "sim_compute_performance-npc3": 0.0017792982690395106}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.1029108323040009, "get_ui_image": 0.030604509370667592, "step_physics": 0.2464234169040407, "survival_time": 5.549999999999988, "driven_lanedir": 0.7776620514707999, "get_state_dump": 0.006350432123456683, "get_robot_state": 0.0072648801973887855, "sim_render-ego0": 0.003874914986746652, "sim_render-npc0": 0.003830554229872567, "get_duckie_state": 2.2671052387782505e-06, "in-drivable-lane": 1.099999999999996, "deviation-heading": 1.517208852019572, "agent_compute-ego0": 0.04713990432875497, "agent_compute-npc0": 0.023087386574063985, "complete-iteration": 0.3873212082045419, "set_robot_commands": 0.002245215432984488, "deviation-center-line": 0.2621282466850749, "driven_lanedir_consec": 0.7776620514707999, "sim_compute_sim_state": 0.010058307221957616, "sim_compute_performance-ego0": 0.002027209315981184, "sim_compute_performance-npc0": 0.001985060317175729}}
set_robot_commands_max0.002245215432984488
set_robot_commands_mean0.002068571937377327
set_robot_commands_median0.002056835464543669
set_robot_commands_min0.0019154013874374816
sim_compute_performance-ego0_max0.002027209315981184
sim_compute_performance-ego0_mean0.0019156328062088243
sim_compute_performance-ego0_median0.001910228701311412
sim_compute_performance-ego0_min0.0018148645062312904
sim_compute_performance-npc0_max0.001985060317175729
sim_compute_performance-npc0_mean0.001827591193003645
sim_compute_performance-npc0_median0.0018277014505616745
sim_compute_performance-npc0_min0.0016699015537155009
sim_compute_performance-npc1_max0.001836529817721129
sim_compute_performance-npc1_mean0.0017554111059893075
sim_compute_performance-npc1_median0.0017632668146668343
sim_compute_performance-npc1_min0.0016664366855799594
sim_compute_performance-npc2_max0.0018534590363252588
sim_compute_performance-npc2_mean0.0017917452081661234
sim_compute_performance-npc2_median0.0018201252556387492
sim_compute_performance-npc2_min0.0017016513325343622
sim_compute_performance-npc3_max0.0017792982690395106
sim_compute_performance-npc3_mean0.001736723607535371
sim_compute_performance-npc3_median0.001736723607535371
sim_compute_performance-npc3_min0.0016941489460312318
sim_compute_sim_state_max0.051280538612437025
sim_compute_sim_state_mean0.03521414482843499
sim_compute_sim_state_median0.03975886673967265
sim_compute_sim_state_min0.010058307221957616
sim_render-ego0_max0.003874914986746652
sim_render-ego0_mean0.003682666421700132
sim_render-ego0_median0.003658946528071053
sim_render-ego0_min0.0035378576439117717
sim_render-npc0_max0.003830554229872567
sim_render-npc0_mean0.0036233280376743743
sim_render-npc0_median0.003660108171025395
sim_render-npc0_min0.00334254157877414
sim_render-npc1_max0.003695425747325585
sim_render-npc1_mean0.003544765111815284
sim_render-npc1_median0.0035515365114293083
sim_render-npc1_min0.003387333076690959
sim_render-npc2_max0.0037277934436278273
sim_render-npc2_mean0.003589626779182332
sim_render-npc2_median0.003604283076170146
sim_render-npc2_min0.003436803817749023
sim_render-npc3_max0.003668579771565986
sim_render-npc3_mean0.003560450425427894
sim_render-npc3_median0.003560450425427894
sim_render-npc3_min0.0034523210792898017
simulation-passed1
step_physics_max0.9174160356224428
step_physics_mean0.6077387081611242
step_physics_median0.6335576900590065
step_physics_min0.2464234169040407
survival_time_max47.64999999999943
survival_time_mean19.02499999999988
survival_time_min5.299999999999989
No reset possible
5573511296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:01:55
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5571111284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:34
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5567711284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:33
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5561011280Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:10
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5559411309Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5558111305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5553611283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:01:19
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5549911301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5547511301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5544611299Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5538511282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:04
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5536811302Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:34
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5532211289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:59
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5510811413Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFP-sim-validationLFP-simsuccessnonogpu-prod-070:13:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.025
in-drivable-lane_median0.5250000000000075
driven_lanedir_consec_median1.5425060846496597
deviation-center-line_median0.3402907324174555


other stats
agent_compute-ego0_max0.04784151590787447
agent_compute-ego0_mean0.04348252789590297
agent_compute-ego0_median0.043235215848704246
agent_compute-ego0_min0.03961816397832891
complete-iteration_max0.28096058185283956
complete-iteration_mean0.23536356730059227
complete-iteration_median0.2388470150156563
complete-iteration_min0.18279965731821687
deviation-center-line_max3.9835052701742866
deviation-center-line_mean1.232380015952493
deviation-center-line_min0.265433328800774
deviation-heading_max15.44160972654172
deviation-heading_mean4.81423298637512
deviation-heading_median1.4821508391014078
deviation-heading_min0.851020540755943
driven_any_max14.5898100863319
driven_any_mean4.633620218633366
driven_any_median1.7082199312507167
driven_any_min0.5282309257001329
driven_lanedir_consec_max11.088425839240465
driven_lanedir_consec_mean3.667016300141861
driven_lanedir_consec_min0.4946271920276578
driven_lanedir_max11.088425839240465
driven_lanedir_mean3.667016300141861
driven_lanedir_median1.5425060846496597
driven_lanedir_min0.4946271920276578
get_duckie_state_max0.023135264332477864
get_duckie_state_mean0.01723614148140487
get_duckie_state_median0.020825110151616227
get_duckie_state_min0.0041590812899091655
get_robot_state_max0.003539941621863324
get_robot_state_mean0.0034363124074013214
get_robot_state_median0.0034545523347795366
get_robot_state_min0.0032962033381828894
get_state_dump_max0.007563093533882728
get_state_dump_mean0.0067418073752841265
get_state_dump_median0.007303976294986381
get_state_dump_min0.004796183377281017
get_ui_image_max0.03261468099511188
get_ui_image_mean0.029347896130084664
get_ui_image_median0.030417581361073715
get_ui_image_min0.023941740803079346
in-drivable-lane_max11.099999999999756
in-drivable-lane_mean3.037499999999943
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.276806063496427, "get_ui_image": 0.028248338745190543, "step_physics": 0.10578965911498436, "survival_time": 10.350000000000012, "driven_lanedir": 1.9665277864594513, "get_state_dump": 0.007563093533882728, "get_robot_state": 0.0032962033381828894, "sim_render-ego0": 0.003470969887880178, "get_duckie_state": 0.023135264332477864, "in-drivable-lane": 1.050000000000015, "deviation-heading": 1.747008755262681, "agent_compute-ego0": 0.04295443227657905, "complete-iteration": 0.2254587045082679, "set_robot_commands": 0.0020751139292350183, "deviation-center-line": 0.3724996356547582, "driven_lanedir_consec": 1.9665277864594513, "sim_compute_sim_state": 0.0070787576528695915, "sim_compute_performance-ego0": 0.0017593090350811298}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5282309257001329, "get_ui_image": 0.032586823976956884, "step_physics": 0.15289087295532228, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4946271920276578, "get_state_dump": 0.007201777971707858, "get_robot_state": 0.003492226967444787, "sim_render-ego0": 0.0035439197833721453, "get_duckie_state": 0.020961207609910232, "in-drivable-lane": 0.0, "deviation-heading": 1.2172929229401348, "agent_compute-ego0": 0.04784151590787447, "complete-iteration": 0.28096058185283956, "set_robot_commands": 0.002099748758169321, "deviation-center-line": 0.265433328800774, "driven_lanedir_consec": 0.4946271920276578, "sim_compute_sim_state": 0.008344518221341647, "sim_compute_performance-ego0": 0.0019072092496431792}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.1396337990050067, "get_ui_image": 0.03261468099511188, "step_physics": 0.12457123010054878, "survival_time": 5.699999999999988, "driven_lanedir": 1.118484382839868, "get_state_dump": 0.007406174618264903, "get_robot_state": 0.003539941621863324, "sim_render-ego0": 0.003639009724492612, "get_duckie_state": 0.020689012693322226, "in-drivable-lane": 0.0, "deviation-heading": 0.851020540755943, "agent_compute-ego0": 0.04351599942082944, "complete-iteration": 0.25223532552304473, "set_robot_commands": 0.0022172243698783544, "deviation-center-line": 0.3080818291801528, "driven_lanedir_consec": 1.118484382839868, "sim_compute_sim_state": 0.012049046806667164, "sim_compute_performance-ego0": 0.001905586408532184}, "LFP-norm-small_loop-000-ego0": {"driven_any": 14.5898100863319, "get_ui_image": 0.023941740803079346, "step_physics": 0.09375918199378784, "survival_time": 59.99999999999873, "driven_lanedir": 11.088425839240465, "get_state_dump": 0.004796183377281017, "get_robot_state": 0.0034168777021142864, "sim_render-ego0": 0.0034437284779290575, "get_duckie_state": 0.0041590812899091655, "in-drivable-lane": 11.099999999999756, "deviation-heading": 15.44160972654172, "agent_compute-ego0": 0.03961816397832891, "complete-iteration": 0.18279965731821687, "set_robot_commands": 0.0020359136182799328, "deviation-center-line": 3.9835052701742866, "driven_lanedir_consec": 11.088425839240465, "sim_compute_sim_state": 0.005723115705034318, "sim_compute_performance-ego0": 0.0018253121943795413}}
set_robot_commands_max0.0022172243698783544
set_robot_commands_mean0.0021070001688906566
set_robot_commands_median0.00208743134370217
set_robot_commands_min0.0020359136182799328
sim_compute_performance-ego0_max0.0019072092496431792
sim_compute_performance-ego0_mean0.0018493542219090088
sim_compute_performance-ego0_median0.0018654493014558628
sim_compute_performance-ego0_min0.0017593090350811298
sim_compute_sim_state_max0.012049046806667164
sim_compute_sim_state_mean0.00829885959647818
sim_compute_sim_state_median0.007711637937105619
sim_compute_sim_state_min0.005723115705034318
sim_render-ego0_max0.003639009724492612
sim_render-ego0_mean0.0035244069684184985
sim_render-ego0_median0.003507444835626162
sim_render-ego0_min0.0034437284779290575
simulation-passed1
step_physics_max0.15289087295532228
step_physics_mean0.1192527360411608
step_physics_median0.11518044460776658
step_physics_min0.09375918199378784
survival_time_max59.99999999999873
survival_time_mean19.81249999999968
survival_time_min3.1999999999999966
No reset possible
5508911291Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5505511311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:58
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5502611418Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV-sim-validationLFVv-simhost-erroryesnogpu-prod-070:01:53
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5500011308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:31
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5497611307Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5494711307Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5493511310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:16
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5490511319Fernanda Custodio Pereira do Carmo 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-070:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5488511436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:05
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5487311436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5484811355Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:05:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47469644768734554
survival_time_median5.799999999999987
deviation-center-line_median0.1652944732306097
in-drivable-lane_median3.424999999999989


other stats
agent_compute-ego0_max0.013176349324917574
agent_compute-ego0_mean0.012882205070001028
agent_compute-ego0_median0.012909918996147109
agent_compute-ego0_min0.01253263296279232
complete-iteration_max0.1988012600789028
complete-iteration_mean0.18061070149031583
complete-iteration_median0.18205021874542948
complete-iteration_min0.15954110839150168
deviation-center-line_max0.207379547721231
deviation-center-line_mean0.1575691113149522
deviation-center-line_min0.09230795107735856
deviation-heading_max1.6028043324994483
deviation-heading_mean0.9725201313494434
deviation-heading_median0.9222809147569432
deviation-heading_min0.4427143633844387
driven_any_max2.742138185962727
driven_any_mean1.6170509091491772
driven_any_median1.3305380001207268
driven_any_min1.064989450392528
driven_lanedir_consec_max0.6308086958038511
driven_lanedir_consec_mean0.476292081256212
driven_lanedir_consec_min0.3249667338463058
driven_lanedir_max0.6308086958038511
driven_lanedir_mean0.476292081256212
driven_lanedir_median0.47469644768734554
driven_lanedir_min0.3249667338463058
get_duckie_state_max1.7002375438959912e-06
get_duckie_state_mean1.570916275635931e-06
get_duckie_state_median1.5409908153759714e-06
get_duckie_state_min1.5014459278957905e-06
get_robot_state_max0.003933145542337437
get_robot_state_mean0.0038447804288896928
get_robot_state_median0.0038277725534153818
get_robot_state_min0.0037904310663905713
get_state_dump_max0.005072752634684245
get_state_dump_mean0.004860437950609461
get_state_dump_median0.004877247133453994
get_state_dump_min0.004614504900845614
get_ui_image_max0.03620907479682855
get_ui_image_mean0.03146873659761138
get_ui_image_median0.031206511062551016
get_ui_image_min0.027252849468514934
in-drivable-lane_max8.850000000000005
in-drivable-lane_mean4.462499999999994
in-drivable-lane_min2.1499999999999924
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.742138185962727, "get_ui_image": 0.029349538164401272, "step_physics": 0.09767570626845054, "survival_time": 10.85000000000002, "driven_lanedir": 0.3249667338463058, "get_state_dump": 0.004901887079991332, "get_robot_state": 0.0037904310663905713, "sim_render-ego0": 0.004017086204038848, "get_duckie_state": 1.5333158160568378e-06, "in-drivable-lane": 8.850000000000005, "deviation-heading": 1.3647347330347204, "agent_compute-ego0": 0.013176349324917574, "complete-iteration": 0.1676906653500478, "set_robot_commands": 0.002366222372842491, "deviation-center-line": 0.207379547721231, "driven_lanedir_consec": 0.3249667338463058, "sim_compute_sim_state": 0.010146541332979814, "sim_compute_performance-ego0": 0.00217119706880062}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2746330422663896, "get_ui_image": 0.03620907479682855, "step_physics": 0.1228221918629334, "survival_time": 5.599999999999988, "driven_lanedir": 0.3485414367201807, "get_state_dump": 0.004852607186916655, "get_robot_state": 0.003848841760010846, "sim_render-ego0": 0.0039168838906077155, "get_duckie_state": 1.548665814695105e-06, "in-drivable-lane": 3.3999999999999906, "deviation-heading": 1.6028043324994483, "agent_compute-ego0": 0.01253263296279232, "complete-iteration": 0.1988012600789028, "set_robot_commands": 0.002410416054514657, "deviation-center-line": 0.17269441294522414, "driven_lanedir_consec": 0.3485414367201807, "sim_compute_sim_state": 0.010048505479255608, "sim_compute_performance-ego0": 0.0020656332505487765}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.064989450392528, "get_ui_image": 0.03306348396070076, "step_physics": 0.12381361951731672, "survival_time": 4.899999999999991, "driven_lanedir": 0.6308086958038511, "get_state_dump": 0.005072752634684245, "get_robot_state": 0.003933145542337437, "sim_render-ego0": 0.004044349747474747, "get_duckie_state": 1.7002375438959912e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 0.4798270964791663, "agent_compute-ego0": 0.013057212636928366, "complete-iteration": 0.1964097721408112, "set_robot_commands": 0.0024546324604689473, "deviation-center-line": 0.09230795107735856, "driven_lanedir_consec": 0.6308086958038511, "sim_compute_sim_state": 0.008628397276907257, "sim_compute_performance-ego0": 0.0022400822302307746}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3864429579750637, "get_ui_image": 0.027252849468514934, "step_physics": 0.0973960840997617, "survival_time": 5.999999999999987, "driven_lanedir": 0.6008514586545104, "get_state_dump": 0.004614504900845614, "get_robot_state": 0.003806703346819917, "sim_render-ego0": 0.003880248582067568, "get_duckie_state": 1.5014459278957905e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 0.4427143633844387, "agent_compute-ego0": 0.012762625355365848, "complete-iteration": 0.15954110839150168, "set_robot_commands": 0.002345307799410229, "deviation-center-line": 0.15789453351599525, "driven_lanedir_consec": 0.6008514586545104, "sim_compute_sim_state": 0.005382049182229791, "sim_compute_performance-ego0": 0.002012540486233294}}
set_robot_commands_max0.0024546324604689473
set_robot_commands_mean0.002394144671809081
set_robot_commands_median0.002388319213678574
set_robot_commands_min0.002345307799410229
sim_compute_performance-ego0_max0.0022400822302307746
sim_compute_performance-ego0_mean0.002122363258953366
sim_compute_performance-ego0_median0.002118415159674698
sim_compute_performance-ego0_min0.002012540486233294
sim_compute_sim_state_max0.010146541332979814
sim_compute_sim_state_mean0.008551373317843117
sim_compute_sim_state_median0.009338451378081432
sim_compute_sim_state_min0.005382049182229791
sim_render-ego0_max0.004044349747474747
sim_render-ego0_mean0.00396464210604722
sim_render-ego0_median0.003966985047323282
sim_render-ego0_min0.003880248582067568
simulation-passed1
step_physics_max0.12381361951731672
step_physics_mean0.1104269004371156
step_physics_median0.11024894906569196
step_physics_min0.0973960840997617
survival_time_max10.85000000000002
survival_time_mean6.837499999999996
survival_time_min4.899999999999991
No reset possible
5484011439Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5483511424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:00:57
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5476011370Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:12:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.61233957457828
survival_time_median21.700000000000173
deviation-center-line_median0.4044829317321621
in-drivable-lane_median14.900000000000158


other stats
agent_compute-ego0_max0.012674250856501049
agent_compute-ego0_mean0.012250053901668244
agent_compute-ego0_median0.01224048786247018
agent_compute-ego0_min0.011844989025231564
complete-iteration_max0.2118016110748804
complete-iteration_mean0.18192390311866685
complete-iteration_median0.17795317924512286
complete-iteration_min0.15998764290954126
deviation-center-line_max0.5824799703697519
deviation-center-line_mean0.3831618437903449
deviation-center-line_min0.14120154132730336
deviation-heading_max2.3050742108914606
deviation-heading_mean1.5985808455223625
deviation-heading_median1.7728208073813052
deviation-heading_min0.5436075564353794
driven_any_max7.433093341539184
driven_any_mean4.714372576495109
driven_any_median4.900232224833777
driven_any_min1.6239325147736998
driven_lanedir_consec_max2.005270286010119
driven_lanedir_consec_mean1.48307692414811
driven_lanedir_consec_min0.7023582614257617
driven_lanedir_max2.005270286010119
driven_lanedir_mean1.48307692414811
driven_lanedir_median1.61233957457828
driven_lanedir_min0.7023582614257617
get_duckie_state_max1.3871626420454546e-06
get_duckie_state_mean1.3596089522244751e-06
get_duckie_state_median1.3582504633680478e-06
get_duckie_state_min1.33477224011635e-06
get_robot_state_max0.003644558561950171
get_robot_state_mean0.0035657181524792296
get_robot_state_median0.0035491781660759916
get_robot_state_min0.003519957715814764
get_state_dump_max0.004619870036321235
get_state_dump_mean0.0045465448594378954
get_state_dump_median0.004541509805277181
get_state_dump_min0.004483289790875984
get_ui_image_max0.03497007714600122
get_ui_image_mean0.02958865938490083
get_ui_image_median0.02894589103173193
get_ui_image_min0.025492778330138237
in-drivable-lane_max20.800000000000292
in-drivable-lane_mean13.625000000000147
in-drivable-lane_min3.899999999999986
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.433093341539184, "get_ui_image": 0.027403131594641285, "step_physics": 0.10535225677157944, "survival_time": 28.650000000000272, "driven_lanedir": 2.005270286010119, "get_state_dump": 0.004619870036321235, "get_robot_state": 0.0035635885045918855, "sim_render-ego0": 0.0036952375119571486, "get_duckie_state": 1.366130150984389e-06, "in-drivable-lane": 20.800000000000292, "deviation-heading": 1.89452800963042, "agent_compute-ego0": 0.0124509658547644, "complete-iteration": 0.17024845944049052, "set_robot_commands": 0.0021559693672100425, "deviation-center-line": 0.49317550166713425, "driven_lanedir_consec": 2.005270286010119, "sim_compute_sim_state": 0.009004262266258745, "sim_compute_performance-ego0": 0.0019200408915609432}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.4414771818404697, "get_ui_image": 0.03497007714600122, "step_physics": 0.13732261550860578, "survival_time": 17.800000000000118, "driven_lanedir": 1.560342570382136, "get_state_dump": 0.004593885913282549, "get_robot_state": 0.003644558561950171, "sim_render-ego0": 0.003770957807866799, "get_duckie_state": 1.350370775751707e-06, "in-drivable-lane": 10.100000000000136, "deviation-heading": 2.3050742108914606, "agent_compute-ego0": 0.012674250856501049, "complete-iteration": 0.2118016110748804, "set_robot_commands": 0.002210174288068499, "deviation-center-line": 0.5824799703697519, "driven_lanedir_consec": 1.560342570382136, "sim_compute_sim_state": 0.010535855253203576, "sim_compute_performance-ego0": 0.0019938231182365525}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.358987267827085, "get_ui_image": 0.030488650468822577, "step_physics": 0.11528194113316824, "survival_time": 25.60000000000023, "driven_lanedir": 1.6643365787744242, "get_state_dump": 0.004489133697271812, "get_robot_state": 0.0035347678275600976, "sim_render-ego0": 0.003702944017525537, "get_duckie_state": 1.33477224011635e-06, "in-drivable-lane": 19.70000000000018, "deviation-heading": 1.6511136051321904, "agent_compute-ego0": 0.012030009870175962, "complete-iteration": 0.1856578990497552, "set_robot_commands": 0.002114218810380783, "deviation-center-line": 0.31579036179719, "driven_lanedir_consec": 1.6643365787744242, "sim_compute_sim_state": 0.012016839218883257, "sim_compute_performance-ego0": 0.0019173919573629576}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6239325147736998, "get_ui_image": 0.025492778330138237, "step_physics": 0.10198075662959706, "survival_time": 6.549999999999985, "driven_lanedir": 0.7023582614257617, "get_state_dump": 0.004483289790875984, "get_robot_state": 0.003519957715814764, "sim_render-ego0": 0.0036871072017785273, "get_duckie_state": 1.3871626420454546e-06, "in-drivable-lane": 3.899999999999986, "deviation-heading": 0.5436075564353794, "agent_compute-ego0": 0.011844989025231564, "complete-iteration": 0.15998764290954126, "set_robot_commands": 0.0020931417291814632, "deviation-center-line": 0.14120154132730336, "driven_lanedir_consec": 0.7023582614257617, "sim_compute_sim_state": 0.004920038309964267, "sim_compute_performance-ego0": 0.0018833713098005817}}
set_robot_commands_max0.002210174288068499
set_robot_commands_mean0.0021433760487101967
set_robot_commands_median0.002135094088795413
set_robot_commands_min0.0020931417291814632
sim_compute_performance-ego0_max0.0019938231182365525
sim_compute_performance-ego0_mean0.0019286568192402585
sim_compute_performance-ego0_median0.0019187164244619504
sim_compute_performance-ego0_min0.0018833713098005817
sim_compute_sim_state_max0.012016839218883257
sim_compute_sim_state_mean0.00911924876207746
sim_compute_sim_state_median0.009770058759731162
sim_compute_sim_state_min0.004920038309964267
sim_render-ego0_max0.003770957807866799
sim_render-ego0_mean0.0037140616347820033
sim_render-ego0_median0.0036990907647413422
sim_render-ego0_min0.0036871072017785273
simulation-passed1
step_physics_max0.13732261550860578
step_physics_mean0.11498439251073762
step_physics_median0.11031709895237383
step_physics_min0.10198075662959706
survival_time_max28.650000000000272
survival_time_mean19.650000000000148
survival_time_min6.549999999999985
No reset possible
5468711390Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:10:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7147062117695963
survival_time_median9.625000000000002
deviation-center-line_median0.22264832069869372
in-drivable-lane_median4.5500000000000345


other stats
agent_compute-ego0_max0.0125359921228318
agent_compute-ego0_mean0.012087555065341447
agent_compute-ego0_median0.01214218930107533
agent_compute-ego0_min0.01152984953638333
complete-iteration_max0.21773219916780115
complete-iteration_mean0.1866471571897272
complete-iteration_median0.17820271849632263
complete-iteration_min0.17245099259846247
deviation-center-line_max0.8253831801473112
deviation-center-line_mean0.3449445198721801
deviation-center-line_min0.10909825794402184
deviation-heading_max3.674114576940361
deviation-heading_mean1.6319515702923058
deviation-heading_median1.1660728402543643
deviation-heading_min0.5215460237201334
driven_any_max4.894248282176067
driven_any_mean2.4200141819958914
driven_any_median1.6706985086817117
driven_any_min1.444411428444075
driven_lanedir_consec_max3.842371602951171
driven_lanedir_consec_mean1.4857484484637735
driven_lanedir_consec_min0.6712097673647299
driven_lanedir_max3.842371602951171
driven_lanedir_mean1.4857484484637735
driven_lanedir_median0.7147062117695963
driven_lanedir_min0.6712097673647299
get_duckie_state_max1.433917454310826e-06
get_duckie_state_mean1.3188741394934192e-06
get_duckie_state_median1.330970455024202e-06
get_duckie_state_min1.1796381936144473e-06
get_robot_state_max0.0037059386571248374
get_robot_state_mean0.00360947472334345
get_robot_state_median0.0036896430752732462
get_robot_state_min0.003352674085702469
get_state_dump_max0.004735399427868071
get_state_dump_mean0.004530468645785286
get_state_dump_median0.0045807706800990765
get_state_dump_min0.004224933795074918
get_ui_image_max0.03519498022262659
get_ui_image_mean0.029177741835124997
get_ui_image_median0.027411919817932125
get_ui_image_min0.02669214748200916
in-drivable-lane_max7.650000000000016
in-drivable-lane_mean5.137500000000018
in-drivable-lane_min3.7999999999999865
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.894248282176067, "get_ui_image": 0.02678270105804716, "step_physics": 0.11293108016252518, "survival_time": 22.350000000000183, "driven_lanedir": 3.842371602951171, "get_state_dump": 0.004492428685937609, "get_robot_state": 0.0036858442638601574, "sim_render-ego0": 0.003771349787712097, "get_duckie_state": 1.300126314163208e-06, "in-drivable-lane": 5.000000000000071, "deviation-heading": 3.674114576940361, "agent_compute-ego0": 0.01198903684105192, "complete-iteration": 0.17801813568387712, "set_robot_commands": 0.0022320960249219623, "deviation-center-line": 0.8253831801473112, "driven_lanedir_consec": 3.842371602951171, "sim_compute_sim_state": 0.01002845647079604, "sim_compute_performance-ego0": 0.0020245819219521116}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.4496692448077544, "get_ui_image": 0.03519498022262659, "step_physics": 0.1438808414222157, "survival_time": 8.79999999999999, "driven_lanedir": 0.7369957563721847, "get_state_dump": 0.004669112674260544, "get_robot_state": 0.003693441886686336, "sim_render-ego0": 0.003786989524539581, "get_duckie_state": 1.361814595885196e-06, "in-drivable-lane": 4.099999999999999, "deviation-heading": 1.772302334754969, "agent_compute-ego0": 0.012295341761098744, "complete-iteration": 0.21773219916780115, "set_robot_commands": 0.002264534686244814, "deviation-center-line": 0.31649932776861256, "driven_lanedir_consec": 0.7369957563721847, "sim_compute_sim_state": 0.009877934967730678, "sim_compute_performance-ego0": 0.0019859311270848507}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.444411428444075, "get_ui_image": 0.028041138577817093, "step_physics": 0.11063727869916318, "survival_time": 6.649999999999984, "driven_lanedir": 0.6924166671670078, "get_state_dump": 0.004224933795074918, "get_robot_state": 0.003352674085702469, "sim_render-ego0": 0.0034441058315447907, "get_duckie_state": 1.1796381936144473e-06, "in-drivable-lane": 3.7999999999999865, "deviation-heading": 0.5215460237201334, "agent_compute-ego0": 0.01152984953638333, "complete-iteration": 0.17245099259846247, "set_robot_commands": 0.0020102778477455252, "deviation-center-line": 0.12879731362877486, "driven_lanedir_consec": 0.6924166671670078, "sim_compute_sim_state": 0.007371706749076274, "sim_compute_performance-ego0": 0.0017601269394604128}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8917277725556687, "get_ui_image": 0.02669214748200916, "step_physics": 0.11749958878471738, "survival_time": 10.450000000000014, "driven_lanedir": 0.6712097673647299, "get_state_dump": 0.004735399427868071, "get_robot_state": 0.0037059386571248374, "sim_render-ego0": 0.0037897212164742606, "get_duckie_state": 1.433917454310826e-06, "in-drivable-lane": 7.650000000000016, "deviation-heading": 0.5598433457537599, "agent_compute-ego0": 0.0125359921228318, "complete-iteration": 0.17838730130876815, "set_robot_commands": 0.0022334064756120956, "deviation-center-line": 0.10909825794402184, "driven_lanedir_consec": 0.6712097673647299, "sim_compute_sim_state": 0.005136655625842867, "sim_compute_performance-ego0": 0.0019750470206851053}}
set_robot_commands_max0.002264534686244814
set_robot_commands_mean0.0021850787586310994
set_robot_commands_median0.002232751250267029
set_robot_commands_min0.0020102778477455252
sim_compute_performance-ego0_max0.0020245819219521116
sim_compute_performance-ego0_mean0.00193642175229562
sim_compute_performance-ego0_median0.001980489073884978
sim_compute_performance-ego0_min0.0017601269394604128
sim_compute_sim_state_max0.01002845647079604
sim_compute_sim_state_mean0.008103688453361464
sim_compute_sim_state_median0.008624820858403475
sim_compute_sim_state_min0.005136655625842867
sim_render-ego0_max0.0037897212164742606
sim_render-ego0_mean0.0036980415900676822
sim_render-ego0_median0.003779169656125839
sim_render-ego0_min0.0034441058315447907
simulation-passed1
step_physics_max0.1438808414222157
step_physics_mean0.12123719726715536
step_physics_median0.11521533447362128
step_physics_min0.11063727869916318
survival_time_max22.350000000000183
survival_time_mean12.062500000000044
survival_time_min6.649999999999984
No reset possible
5456911446Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:16:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7069998347981528
survival_time_median21.05000000000009
deviation-center-line_median0.28411876047128864
in-drivable-lane_median17.12500000000008


other stats
agent_compute-ego0_max0.04959939732963657
agent_compute-ego0_mean0.03460386644234593
agent_compute-ego0_median0.03776031228184941
agent_compute-ego0_min0.013295443876048337
complete-iteration_max0.23013390132359096
complete-iteration_mean0.21226306955452592
complete-iteration_median0.21211638676451336
complete-iteration_min0.19468560336548604
deviation-center-line_max0.4414533966890112
deviation-center-line_mean0.2838605879532198
deviation-center-line_min0.12575143418129062
deviation-heading_max2.903239203947457
deviation-heading_mean1.4722705442679018
deviation-heading_median1.208320594835718
deviation-heading_min0.5692017834527137
driven_any_max12.836625560867416
driven_any_mean5.3672249768240174
driven_any_median3.682495000957548
driven_any_min1.2672843445135538
driven_lanedir_consec_max2.0324040420043468
driven_lanedir_consec_mean1.034208768566658
driven_lanedir_consec_min0.6904313626659802
driven_lanedir_max2.0324040420043468
driven_lanedir_mean1.0441251167284424
driven_lanedir_median0.7268325311217214
driven_lanedir_min0.6904313626659802
get_duckie_state_max1.4472916678599248e-06
get_duckie_state_mean1.356982851098718e-06
get_duckie_state_median1.4027883697671952e-06
get_duckie_state_min1.175062997000558e-06
get_robot_state_max0.004158889093706685
get_robot_state_mean0.003858252833213124
get_robot_state_median0.003848782982638353
get_robot_state_min0.0035765562738691056
get_state_dump_max0.005170415779831606
get_state_dump_mean0.005002857694394109
get_state_dump_median0.005060331310267245
get_state_dump_min0.004720352377210344
get_ui_image_max0.035172030722990064
get_ui_image_mean0.03097856113904472
get_ui_image_median0.031649424144370074
get_ui_image_min0.025443365544448662
in-drivable-lane_max51.64999999999874
in-drivable-lane_mean22.28749999999972
in-drivable-lane_min3.2499999999999885
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.836625560867416, "get_ui_image": 0.029737690108503332, "step_physics": 0.11933273697375854, "survival_time": 59.99999999999873, "driven_lanedir": 2.0324040420043468, "get_state_dump": 0.005170415779831606, "get_robot_state": 0.0040323144688792865, "sim_render-ego0": 0.004123291703286913, "get_duckie_state": 1.429518891016113e-06, "in-drivable-lane": 51.64999999999874, "deviation-heading": 1.5110723934614056, "agent_compute-ego0": 0.033204909863817404, "complete-iteration": 0.21003831038367837, "set_robot_commands": 0.0024458963011424807, "deviation-center-line": 0.4414533966890112, "driven_lanedir_consec": 2.0324040420043468, "sim_compute_sim_state": 0.009591839295640576, "sim_compute_performance-ego0": 0.002298270335900198}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2672843445135538, "get_ui_image": 0.03356115818023682, "step_physics": 0.12835870470319474, "survival_time": 6.949999999999983, "driven_lanedir": 0.7165789601414221, "get_state_dump": 0.004720352377210344, "get_robot_state": 0.0035765562738691056, "sim_render-ego0": 0.003724912234715053, "get_duckie_state": 1.175062997000558e-06, "in-drivable-lane": 3.2499999999999885, "deviation-heading": 0.9055687962100304, "agent_compute-ego0": 0.042315714699881414, "complete-iteration": 0.23013390132359096, "set_robot_commands": 0.0022261006491524835, "deviation-center-line": 0.19514649105128337, "driven_lanedir_consec": 0.7165789601414221, "sim_compute_sim_state": 0.009582105704716274, "sim_compute_performance-ego0": 0.0019735251154218403}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.723021759951302, "get_ui_image": 0.035172030722990064, "step_physics": 0.13594505129671516, "survival_time": 34.0500000000002, "driven_lanedir": 0.7370861021020207, "get_state_dump": 0.0051382573818531205, "get_robot_state": 0.004158889093706685, "sim_render-ego0": 0.0042796680305011115, "get_duckie_state": 1.4472916678599248e-06, "in-drivable-lane": 29.100000000000183, "deviation-heading": 2.903239203947457, "agent_compute-ego0": 0.013295443876048337, "complete-iteration": 0.21419446314534837, "set_robot_commands": 0.0025430400350576273, "deviation-center-line": 0.3730910298912939, "driven_lanedir_consec": 0.6974207094548834, "sim_compute_sim_state": 0.011192725201156484, "sim_compute_performance-ego0": 0.0023616419509708705}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6419682419637949, "get_ui_image": 0.025443365544448662, "step_physics": 0.09760636311990244, "survival_time": 8.04999999999998, "driven_lanedir": 0.6904313626659802, "get_state_dump": 0.0049824052386813695, "get_robot_state": 0.003665251496397419, "sim_render-ego0": 0.0038510884767697182, "get_duckie_state": 1.3760578485182777e-06, "in-drivable-lane": 5.149999999999982, "deviation-heading": 0.5692017834527137, "agent_compute-ego0": 0.04959939732963657, "complete-iteration": 0.19468560336548604, "set_robot_commands": 0.0022725323100148895, "deviation-center-line": 0.12575143418129062, "driven_lanedir_consec": 0.6904313626659802, "sim_compute_sim_state": 0.005159670923963005, "sim_compute_performance-ego0": 0.002006886917867778}}
set_robot_commands_max0.0025430400350576273
set_robot_commands_mean0.0023718923238418704
set_robot_commands_median0.002359214305578685
set_robot_commands_min0.0022261006491524835
sim_compute_performance-ego0_max0.0023616419509708705
sim_compute_performance-ego0_mean0.002160081080040172
sim_compute_performance-ego0_median0.002152578626883988
sim_compute_performance-ego0_min0.0019735251154218403
sim_compute_sim_state_max0.011192725201156484
sim_compute_sim_state_mean0.008881585281369085
sim_compute_sim_state_median0.009586972500178426
sim_compute_sim_state_min0.005159670923963005
sim_render-ego0_max0.0042796680305011115
sim_render-ego0_mean0.0039947401113181995
sim_render-ego0_median0.003987190090028316
sim_render-ego0_min0.003724912234715053
simulation-passed1
step_physics_max0.13594505129671516
step_physics_mean0.12031071402339272
step_physics_median0.12384572083847664
step_physics_min0.09760636311990244
survival_time_max59.99999999999873
survival_time_mean27.26249999999973
survival_time_min6.949999999999983
No reset possible
5453611464Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:13:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1340960463766647
survival_time_median18.325000000000134
deviation-center-line_median0.3199811699706291
in-drivable-lane_median12.550000000000136


other stats
agent_compute-ego0_max0.013125357052958603
agent_compute-ego0_mean0.012388420604134772
agent_compute-ego0_median0.01232706201977994
agent_compute-ego0_min0.011774201324020609
complete-iteration_max0.23720318882177907
complete-iteration_mean0.20544699720327084
complete-iteration_median0.21138247662877377
complete-iteration_min0.16181984673375668
deviation-center-line_max0.6934895592254168
deviation-center-line_mean0.3661482487113683
deviation-center-line_min0.13114109567879828
deviation-heading_max4.29672413388984
deviation-heading_mean1.7824924230489931
deviation-heading_median1.160098047045556
deviation-heading_min0.5130494642150212
driven_any_max9.91721770944774
driven_any_mean4.684628189758836
driven_any_median3.6844436545768104
driven_any_min1.452407740433987
driven_lanedir_consec_max2.0034034512829715
driven_lanedir_consec_mean1.2359427257566091
driven_lanedir_consec_min0.6721753589901355
driven_lanedir_max2.0034034512829715
driven_lanedir_mean1.2385179172246137
driven_lanedir_median1.1392464293126738
driven_lanedir_min0.6721753589901355
get_duckie_state_max1.8380212445631096e-06
get_duckie_state_mean1.5069009429284906e-06
get_duckie_state_median1.4339571584569651e-06
get_duckie_state_min1.3216682102369226e-06
get_robot_state_max0.004291284168865664
get_robot_state_mean0.004005363625999817
get_robot_state_median0.004013104930573483
get_robot_state_min0.003703960473986639
get_state_dump_max0.005302278708058892
get_state_dump_mean0.0049784624432112875
get_state_dump_median0.005006858570798394
get_state_dump_min0.004597853923189467
get_ui_image_max0.0376262118920734
get_ui_image_mean0.03237708270174469
get_ui_image_median0.03302257420988214
get_ui_image_min0.02583697049514107
in-drivable-lane_max33.5499999999998
in-drivable-lane_mean15.700000000000014
in-drivable-lane_min4.149999999999985
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.91721770944774, "get_ui_image": 0.029392333162360403, "step_physics": 0.12444384930943814, "survival_time": 41.599999999999774, "driven_lanedir": 2.0034034512829715, "get_state_dump": 0.005047112953763048, "get_robot_state": 0.004066432080492109, "sim_render-ego0": 0.0040945299819451705, "get_duckie_state": 1.4582745024279243e-06, "in-drivable-lane": 33.5499999999998, "deviation-heading": 1.8022918942159325, "agent_compute-ego0": 0.012252055153268585, "complete-iteration": 0.19322408662409055, "set_robot_commands": 0.002385095674164441, "deviation-center-line": 0.4912917481625173, "driven_lanedir_consec": 2.0034034512829715, "sim_compute_sim_state": 0.009184250596906245, "sim_compute_performance-ego0": 0.0022613896327574}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.780150890715404, "get_ui_image": 0.0376262118920734, "step_physics": 0.1496499275117611, "survival_time": 29.650000000000286, "driven_lanedir": 1.5945439952476403, "get_state_dump": 0.004966604187833741, "get_robot_state": 0.003959777780654856, "sim_render-ego0": 0.0040635805740099566, "get_duckie_state": 1.409639814486006e-06, "in-drivable-lane": 20.85000000000029, "deviation-heading": 4.29672413388984, "agent_compute-ego0": 0.012402068886291298, "complete-iteration": 0.22954086663345696, "set_robot_commands": 0.0024000819684680463, "deviation-center-line": 0.6934895592254168, "driven_lanedir_consec": 1.584243229375622, "sim_compute_sim_state": 0.01216596063941416, "sim_compute_performance-ego0": 0.002219778921467688}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.452407740433987, "get_ui_image": 0.03665281525740387, "step_physics": 0.1589419148492475, "survival_time": 6.999999999999983, "driven_lanedir": 0.6721753589901355, "get_state_dump": 0.005302278708058892, "get_robot_state": 0.004291284168865664, "sim_render-ego0": 0.004417355178941226, "get_duckie_state": 1.8380212445631096e-06, "in-drivable-lane": 4.249999999999985, "deviation-heading": 0.5179041998751794, "agent_compute-ego0": 0.013125357052958603, "complete-iteration": 0.23720318882177907, "set_robot_commands": 0.0024650384348334996, "deviation-center-line": 0.14867059177874092, "driven_lanedir_consec": 0.6721753589901355, "sim_compute_sim_state": 0.009566484613621489, "sim_compute_performance-ego0": 0.002334535544645702}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.588736418438216, "get_ui_image": 0.02583697049514107, "step_physics": 0.10295497507288837, "survival_time": 6.849999999999984, "driven_lanedir": 0.6839488633777073, "get_state_dump": 0.004597853923189467, "get_robot_state": 0.003703960473986639, "sim_render-ego0": 0.003662463547526926, "get_duckie_state": 1.3216682102369226e-06, "in-drivable-lane": 4.149999999999985, "deviation-heading": 0.5130494642150212, "agent_compute-ego0": 0.011774201324020609, "complete-iteration": 0.16181984673375668, "set_robot_commands": 0.0021793755932130675, "deviation-center-line": 0.13114109567879828, "driven_lanedir_consec": 0.6839488633777073, "sim_compute_sim_state": 0.005097969718601393, "sim_compute_performance-ego0": 0.0019337163455244424}}
set_robot_commands_max0.0024650384348334996
set_robot_commands_mean0.002357397917669764
set_robot_commands_median0.0023925888213162435
set_robot_commands_min0.0021793755932130675
sim_compute_performance-ego0_max0.002334535544645702
sim_compute_performance-ego0_mean0.002187355111098808
sim_compute_performance-ego0_median0.002240584277112544
sim_compute_performance-ego0_min0.0019337163455244424
sim_compute_sim_state_max0.01216596063941416
sim_compute_sim_state_mean0.00900366639213582
sim_compute_sim_state_median0.009375367605263866
sim_compute_sim_state_min0.005097969718601393
sim_render-ego0_max0.004417355178941226
sim_render-ego0_mean0.004059482320605819
sim_render-ego0_median0.0040790552779775635
sim_render-ego0_min0.003662463547526926
simulation-passed1
step_physics_max0.1589419148492475
step_physics_mean0.1339976666858338
step_physics_median0.13704688841059962
step_physics_min0.10295497507288837
survival_time_max41.599999999999774
survival_time_mean21.27500000000001
survival_time_min6.849999999999984
No reset possible
5443811542Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:37:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.62499639242082
survival_time_median59.99999999999873
deviation-center-line_median3.7372149940105825
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012808925801768688
agent_compute-ego0_mean0.012546528834883715
agent_compute-ego0_median0.012604263104765144
agent_compute-ego0_min0.01216866332823589
complete-iteration_max0.2175429274299361
complete-iteration_mean0.20041863035897628
complete-iteration_median0.20536166454334245
complete-iteration_min0.17340826491928418
deviation-center-line_max4.065978407432651
deviation-center-line_mean3.7428202535995063
deviation-center-line_min3.4308726189442105
deviation-heading_max13.84311363255026
deviation-heading_mean12.4971292063384
deviation-heading_median12.485423708221049
deviation-heading_min11.174555776361242
driven_any_max11.984197036277283
driven_any_mean11.209057949989136
driven_any_median11.037080590795128
driven_any_min10.777873582089006
driven_lanedir_consec_max11.517767352811648
driven_lanedir_consec_mean10.264566170527608
driven_lanedir_consec_min8.290504544457146
driven_lanedir_max11.517767352811648
driven_lanedir_mean10.264566170527608
driven_lanedir_median10.62499639242082
driven_lanedir_min8.290504544457146
get_duckie_state_max1.429121857578808e-06
get_duckie_state_mean1.356812142809662e-06
get_duckie_state_median1.3635120820641815e-06
get_duckie_state_min1.2711025495314776e-06
get_robot_state_max0.003908936328236805
get_robot_state_mean0.003824925392890949
get_robot_state_median0.0038738648758442776
get_robot_state_min0.0036430354916384376
get_state_dump_max0.005082536795851988
get_state_dump_mean0.004831134131508604
get_state_dump_median0.004804391646563858
get_state_dump_min0.004633216437054713
get_ui_image_max0.035469809737828845
get_ui_image_mean0.031800277177539096
get_ui_image_median0.03243161160979641
get_ui_image_min0.02686807575273474
in-drivable-lane_max11.349999999999357
in-drivable-lane_mean2.8374999999998387
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.984197036277283, "get_ui_image": 0.030258612469967756, "step_physics": 0.1251943105464176, "survival_time": 59.99999999999873, "driven_lanedir": 11.517767352811648, "get_state_dump": 0.004833497373785802, "get_robot_state": 0.003908936328236805, "sim_render-ego0": 0.003996450239970821, "get_duckie_state": 1.4033146841539928e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.84311363255026, "agent_compute-ego0": 0.01268519489691716, "complete-iteration": 0.19541722273052384, "set_robot_commands": 0.002434131604844982, "deviation-center-line": 3.5659302590778843, "driven_lanedir_consec": 11.517767352811648, "sim_compute_sim_state": 0.00982745561274164, "sim_compute_performance-ego0": 0.0021830986778900883}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.887877937237194, "get_ui_image": 0.035469809737828845, "step_physics": 0.1393845851574214, "survival_time": 59.99999999999873, "driven_lanedir": 8.290504544457146, "get_state_dump": 0.004633216437054713, "get_robot_state": 0.0036430354916384376, "sim_render-ego0": 0.003813254644630553, "get_duckie_state": 1.3237094799743705e-06, "in-drivable-lane": 11.349999999999357, "deviation-heading": 11.174555776361242, "agent_compute-ego0": 0.012808925801768688, "complete-iteration": 0.2175429274299361, "set_robot_commands": 0.002176696712230266, "deviation-center-line": 3.4308726189442105, "driven_lanedir_consec": 8.290504544457146, "sim_compute_sim_state": 0.013477433631064791, "sim_compute_performance-ego0": 0.0020451948704270895}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.18628324435306, "get_ui_image": 0.03460461074962505, "step_physics": 0.13715776813516609, "survival_time": 59.99999999999873, "driven_lanedir": 10.811018769293195, "get_state_dump": 0.005082536795851988, "get_robot_state": 0.0038682610466517975, "sim_render-ego0": 0.00395178040497309, "get_duckie_state": 1.2711025495314776e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.641697252902462, "agent_compute-ego0": 0.012523331312613128, "complete-iteration": 0.215306106356161, "set_robot_commands": 0.0023050548432768632, "deviation-center-line": 3.908499728943281, "driven_lanedir_consec": 10.811018769293195, "sim_compute_sim_state": 0.013588258368486568, "sim_compute_performance-ego0": 0.0021328548904660342}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.777873582089006, "get_ui_image": 0.02686807575273474, "step_physics": 0.11095042034152346, "survival_time": 59.99999999999873, "driven_lanedir": 10.438974015548444, "get_state_dump": 0.004775285919341914, "get_robot_state": 0.0038794687050367578, "sim_render-ego0": 0.003907963596315408, "get_duckie_state": 1.429121857578808e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.329150163539635, "agent_compute-ego0": 0.01216866332823589, "complete-iteration": 0.17340826491928418, "set_robot_commands": 0.0023576887719934927, "deviation-center-line": 4.065978407432651, "driven_lanedir_consec": 10.438974015548444, "sim_compute_sim_state": 0.006339672701642674, "sim_compute_performance-ego0": 0.0020694899420059293}}
set_robot_commands_max0.002434131604844982
set_robot_commands_mean0.002318392983086401
set_robot_commands_median0.002331371807635178
set_robot_commands_min0.002176696712230266
sim_compute_performance-ego0_max0.0021830986778900883
sim_compute_performance-ego0_mean0.002107659595197285
sim_compute_performance-ego0_median0.0021011724162359816
sim_compute_performance-ego0_min0.0020451948704270895
sim_compute_sim_state_max0.013588258368486568
sim_compute_sim_state_mean0.010808205078483917
sim_compute_sim_state_median0.011652444621903216
sim_compute_sim_state_min0.006339672701642674
sim_render-ego0_max0.003996450239970821
sim_render-ego0_mean0.003917362221472468
sim_render-ego0_median0.0039298720006442495
sim_render-ego0_min0.003813254644630553
simulation-passed1
step_physics_max0.1393845851574214
step_physics_mean0.12817177104513214
step_physics_median0.13117603934079186
step_physics_min0.11095042034152346
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5432711581Yishu Malhotra 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:31:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.99540561994232
survival_time_median59.149999999998776
deviation-center-line_median2.972755436630369
in-drivable-lane_median1.3749999999999964


other stats
agent_compute-ego0_max0.012073168717803564
agent_compute-ego0_mean0.01169509186019579
agent_compute-ego0_median0.011653805102787691
agent_compute-ego0_min0.01139958851740422
complete-iteration_max0.23633166753084436
complete-iteration_mean0.21079013431092816
complete-iteration_median0.2077659828935995
complete-iteration_min0.19129690392566936
deviation-center-line_max4.0727831390749865
deviation-center-line_mean2.952805811178507
deviation-center-line_min1.7929292323783028
deviation-heading_max18.091417768197765
deviation-heading_mean13.627924265801294
deviation-heading_median14.929766101478329
deviation-heading_min6.560747092050752
driven_any_max12.471958062728058
driven_any_mean10.212965704867315
driven_any_median11.67072649579348
driven_any_min5.038451765154249
driven_lanedir_consec_max11.731084339398564
driven_lanedir_consec_mean7.782084434028794
driven_lanedir_consec_min3.406442156831968
driven_lanedir_max11.731084339398564
driven_lanedir_mean8.460935294687015
driven_lanedir_median8.7483644220473
driven_lanedir_min4.615927995254896
get_duckie_state_max1.4560490259270231e-06
get_duckie_state_mean1.359715877046229e-06
get_duckie_state_median1.3363152916087991e-06
get_duckie_state_min1.3101838990402937e-06
get_robot_state_max0.003882232648037189
get_robot_state_mean0.003684228273704694
get_robot_state_median0.0036258923818824887
get_robot_state_min0.003602895683016607
get_state_dump_max0.004752401214638835
get_state_dump_mean0.004598179808937678
get_state_dump_median0.0045500793226751855
get_state_dump_min0.004540159375761508
get_ui_image_max0.035002344752430026
get_ui_image_mean0.030545964388877037
get_ui_image_median0.030101425452760892
get_ui_image_min0.026978661897556336
in-drivable-lane_max23.59999999999873
in-drivable-lane_mean6.58749999999968
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.471958062728058, "get_ui_image": 0.028012549053322365, "step_physics": 0.1279246159933886, "survival_time": 59.99999999999873, "driven_lanedir": 11.731084339398564, "get_state_dump": 0.0045436844043588755, "get_robot_state": 0.00364445528321024, "sim_render-ego0": 0.0037177383254509383, "get_duckie_state": 1.323510963255718e-06, "in-drivable-lane": 0.0, "deviation-heading": 17.472630111149545, "agent_compute-ego0": 0.01139958851740422, "complete-iteration": 0.19288973327878112, "set_robot_commands": 0.0021737934052199746, "deviation-center-line": 3.758951908828988, "driven_lanedir_consec": 11.731084339398564, "sim_compute_sim_state": 0.00942579673589219, "sim_compute_performance-ego0": 0.0019604161220426663}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.3374526254896, "get_ui_image": 0.035002344752430026, "step_physics": 0.15978239140443062, "survival_time": 59.99999999999873, "driven_lanedir": 11.374883244629745, "get_state_dump": 0.0045564742409914955, "get_robot_state": 0.0036073294805547378, "sim_render-ego0": 0.003721416244697412, "get_duckie_state": 1.3491196199618807e-06, "in-drivable-lane": 0.649999999999963, "deviation-heading": 18.091417768197765, "agent_compute-ego0": 0.01164067039680322, "complete-iteration": 0.23633166753084436, "set_robot_commands": 0.0021578850694540437, "deviation-center-line": 4.0727831390749865, "driven_lanedir_consec": 11.374883244629745, "sim_compute_sim_state": 0.013799091461397626, "sim_compute_performance-ego0": 0.00197517643562463}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.038451765154249, "get_ui_image": 0.03219030185219942, "step_physics": 0.15085450614370952, "survival_time": 26.600000000000243, "driven_lanedir": 4.615927995254896, "get_state_dump": 0.004540159375761508, "get_robot_state": 0.003602895683016607, "sim_render-ego0": 0.003761990209010484, "get_duckie_state": 1.3101838990402937e-06, "in-drivable-lane": 2.10000000000003, "deviation-heading": 6.560747092050752, "agent_compute-ego0": 0.01166693980877216, "complete-iteration": 0.2226422325084178, "set_robot_commands": 0.002226613475949858, "deviation-center-line": 1.7929292323783028, "driven_lanedir_consec": 4.615927995254896, "sim_compute_sim_state": 0.01174965629434496, "sim_compute_performance-ego0": 0.0019639813206656564}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.004000366097362, "get_ui_image": 0.026978661897556336, "step_physics": 0.1288791379054183, "survival_time": 58.299999999998825, "driven_lanedir": 6.121845599464859, "get_state_dump": 0.004752401214638835, "get_robot_state": 0.003882232648037189, "sim_render-ego0": 0.003937330425756041, "get_duckie_state": 1.4560490259270231e-06, "in-drivable-lane": 23.59999999999873, "deviation-heading": 12.386902091807114, "agent_compute-ego0": 0.012073168717803564, "complete-iteration": 0.19129690392566936, "set_robot_commands": 0.0023595253013604304, "deviation-center-line": 2.18655896443175, "driven_lanedir_consec": 3.406442156831968, "sim_compute_sim_state": 0.006234763520542331, "sim_compute_performance-ego0": 0.002106804672018932}}
set_robot_commands_max0.0023595253013604304
set_robot_commands_mean0.0022294543129960766
set_robot_commands_median0.002200203440584916
set_robot_commands_min0.0021578850694540437
sim_compute_performance-ego0_max0.002106804672018932
sim_compute_performance-ego0_mean0.0020015946375879713
sim_compute_performance-ego0_median0.001969578878145143
sim_compute_performance-ego0_min0.0019604161220426663
sim_compute_sim_state_max0.013799091461397626
sim_compute_sim_state_mean0.010302327003044277
sim_compute_sim_state_median0.010587726515118577
sim_compute_sim_state_min0.006234763520542331
sim_render-ego0_max0.003937330425756041
sim_render-ego0_mean0.003784618801228719
sim_render-ego0_median0.003741703226853948
sim_render-ego0_min0.0037177383254509383
simulation-passed1
step_physics_max0.15978239140443062
step_physics_mean0.14186016286173675
step_physics_median0.1398668220245639
step_physics_min0.1279246159933886
survival_time_max59.99999999999873
survival_time_mean51.22499999999913
survival_time_min26.600000000000243
No reset possible
5430511586Yishu Malhotra 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:05:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6748453790958406
survival_time_median7.749999999999986
deviation-center-line_median0.11580769216766344
in-drivable-lane_median2.7499999999999956


other stats
agent_compute-ego0_max0.012665170362626
agent_compute-ego0_mean0.012120478809217754
agent_compute-ego0_median0.012220765929669142
agent_compute-ego0_min0.01137521301490673
complete-iteration_max0.2608262432946099
complete-iteration_mean0.1931659517129137
complete-iteration_median0.1788301510607888
complete-iteration_min0.15417726143546726
deviation-center-line_max0.7648922855384865
deviation-center-line_mean0.2650096872175177
deviation-center-line_min0.06353107899625769
deviation-heading_max1.243903673557967
deviation-heading_mean0.8060511302651728
deviation-heading_median0.7702444018218242
deviation-heading_min0.4398120438590761
driven_any_max3.719905198412826
driven_any_mean2.030495819683055
driven_any_median2.045349286130854
driven_any_min0.3113795080576849
driven_lanedir_consec_max2.100792188891026
driven_lanedir_consec_mean0.9031156341126374
driven_lanedir_consec_min0.16197958936784174
driven_lanedir_max2.100792188891026
driven_lanedir_mean0.9036209326518924
driven_lanedir_median0.6758559761743508
driven_lanedir_min0.16197958936784174
get_duckie_state_max1.367481275536548e-06
get_duckie_state_mean1.1841366345234438e-06
get_duckie_state_median1.1593206889099543e-06
get_duckie_state_min1.0504238847373188e-06
get_robot_state_max0.0038469646168851302
get_robot_state_mean0.003684692797624165
get_robot_state_median0.0036811911604470674
get_robot_state_min0.0035294242527173915
get_state_dump_max0.004736861963381712
get_state_dump_mean0.004565572923957847
get_state_dump_median0.004571572970598936
get_state_dump_min0.004382283791251804
get_ui_image_max0.033862569597032335
get_ui_image_mean0.029915202033909093
get_ui_image_median0.03028893861491447
get_ui_image_min0.02522036130877509
in-drivable-lane_max10.300000000000049
in-drivable-lane_mean4.225000000000009
in-drivable-lane_min1.1
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4029269265186652, "get_ui_image": 0.02831955476738941, "step_physics": 0.11036644036742464, "survival_time": 8.649999999999988, "driven_lanedir": 2.100792188891026, "get_state_dump": 0.004736861963381712, "get_robot_state": 0.0038469646168851302, "sim_render-ego0": 0.0037662229318728394, "get_duckie_state": 1.367481275536548e-06, "in-drivable-lane": 1.5500000000000052, "deviation-heading": 1.243903673557967, "agent_compute-ego0": 0.012665170362626, "complete-iteration": 0.1774303830903152, "set_robot_commands": 0.002246486729589002, "deviation-center-line": 0.7648922855384865, "driven_lanedir_consec": 2.100792188891026, "sim_compute_sim_state": 0.009365348980344575, "sim_compute_performance-ego0": 0.0020307384688278726}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3113795080576849, "get_ui_image": 0.033862569597032335, "step_physics": 0.18964077101813423, "survival_time": 2.2, "driven_lanedir": 0.16197958936784174, "get_state_dump": 0.00458674430847168, "get_robot_state": 0.0035488976372612846, "sim_render-ego0": 0.0038025538126627606, "get_duckie_state": 1.1814965142144098e-06, "in-drivable-lane": 1.1, "deviation-heading": 0.6497611286001603, "agent_compute-ego0": 0.012114286422729492, "complete-iteration": 0.2608262432946099, "set_robot_commands": 0.0022317674424913196, "deviation-center-line": 0.06353107899625769, "driven_lanedir_consec": 0.16197958936784174, "sim_compute_sim_state": 0.008915609783596463, "sim_compute_performance-ego0": 0.0020398669772677953}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.719905198412826, "get_ui_image": 0.03225832246243954, "step_physics": 0.10883995424956085, "survival_time": 12.750000000000046, "driven_lanedir": 0.6572017406572644, "get_state_dump": 0.0045564016327261925, "get_robot_state": 0.00381348468363285, "sim_render-ego0": 0.0038611991330981255, "get_duckie_state": 1.1371448636054993e-06, "in-drivable-lane": 10.300000000000049, "deviation-heading": 0.4398120438590761, "agent_compute-ego0": 0.012327245436608791, "complete-iteration": 0.1802299190312624, "set_robot_commands": 0.002318629063665867, "deviation-center-line": 0.08289931381207898, "driven_lanedir_consec": 0.6572017406572644, "sim_compute_sim_state": 0.010102641768753529, "sim_compute_performance-ego0": 0.0020670993253588676}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6877716457430425, "get_ui_image": 0.02522036130877509, "step_physics": 0.0970628589823626, "survival_time": 6.849999999999984, "driven_lanedir": 0.6945102116914372, "get_state_dump": 0.004382283791251804, "get_robot_state": 0.0035294242527173915, "sim_render-ego0": 0.003604831902877144, "get_duckie_state": 1.0504238847373188e-06, "in-drivable-lane": 3.949999999999986, "deviation-heading": 0.8907276750434882, "agent_compute-ego0": 0.01137521301490673, "complete-iteration": 0.15417726143546726, "set_robot_commands": 0.0021436421767525053, "deviation-center-line": 0.14871607052324787, "driven_lanedir_consec": 0.6924890175344169, "sim_compute_sim_state": 0.004889647165934245, "sim_compute_performance-ego0": 0.0018917512202608416}}
set_robot_commands_max0.002318629063665867
set_robot_commands_mean0.002235131353124673
set_robot_commands_median0.0022391270860401607
set_robot_commands_min0.0021436421767525053
sim_compute_performance-ego0_max0.0020670993253588676
sim_compute_performance-ego0_mean0.0020073639979288444
sim_compute_performance-ego0_median0.002035302723047834
sim_compute_performance-ego0_min0.0018917512202608416
sim_compute_sim_state_max0.010102641768753529
sim_compute_sim_state_mean0.008318311924657203
sim_compute_sim_state_median0.00914047938197052
sim_compute_sim_state_min0.004889647165934245
sim_render-ego0_max0.0038611991330981255
sim_render-ego0_mean0.003758701945127717
sim_render-ego0_median0.0037843883722678
sim_render-ego0_min0.003604831902877144
simulation-passed1
step_physics_max0.18964077101813423
step_physics_mean0.1264775061543706
step_physics_median0.10960319730849272
step_physics_min0.0970628589823626
survival_time_max12.750000000000046
survival_time_mean7.612500000000004
survival_time_min2.2
No reset possible
5425011618Francois Hebertsim-exercise-2aido5-LF-sim-validationLFv-simerroryesnogpu-prod-070:18:10
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5420511633Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:13:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.097747615120645
survival_time_median17.450000000000113
deviation-center-line_median0.31462889644562286
in-drivable-lane_median11.699999999999823


other stats
agent_compute-ego0_max0.013088435126065697
agent_compute-ego0_mean0.012314197817499309
agent_compute-ego0_median0.012178249030442996
agent_compute-ego0_min0.011811858083045534
complete-iteration_max0.21151411078358423
complete-iteration_mean0.19310972476716257
complete-iteration_median0.1952549215991849
complete-iteration_min0.1704149450866961
deviation-center-line_max1.8909636472368516
deviation-center-line_mean0.6693415807071663
deviation-center-line_min0.15714488270056734
deviation-heading_max8.352401438865778
deviation-heading_mean3.007862930515003
deviation-heading_median1.5686364954472003
deviation-heading_min0.5417772922998343
driven_any_max9.239058237363292
driven_any_mean4.470165293717094
driven_any_median3.6874800024850303
driven_any_min1.2666429325350237
driven_lanedir_consec_max6.106474709564622
driven_lanedir_consec_mean2.2389250107642744
driven_lanedir_consec_min0.6537301032511873
driven_lanedir_max6.106474709564622
driven_lanedir_mean2.2389250107642744
driven_lanedir_median1.097747615120645
driven_lanedir_min0.6537301032511873
get_duckie_state_max1.411380882034759e-06
get_duckie_state_mean1.386289057194709e-06
get_duckie_state_median1.406231610670762e-06
get_duckie_state_min1.3213121254025524e-06
get_robot_state_max0.003799412439415746
get_robot_state_mean0.0036772887732163815
get_robot_state_median0.00366787675664069
get_robot_state_min0.0035739891401684013
get_state_dump_max0.004795803020952086
get_state_dump_mean0.004712952952732277
get_state_dump_median0.004749753802633002
get_state_dump_min0.004556501184711019
get_ui_image_max0.034946485330130304
get_ui_image_mean0.03111956460445361
get_ui_image_median0.03152225991655443
get_ui_image_min0.02648725325457528
in-drivable-lane_max17.050000000000146
in-drivable-lane_mean10.924999999999944
in-drivable-lane_min3.2499999999999885
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.239058237363292, "get_ui_image": 0.029053226916375987, "step_physics": 0.11589436873704372, "survival_time": 41.69999999999977, "driven_lanedir": 6.106474709564622, "get_state_dump": 0.00474868506014704, "get_robot_state": 0.003714737064110305, "sim_render-ego0": 0.003846359823992152, "get_duckie_state": 1.411380882034759e-06, "in-drivable-lane": 14.799999999999612, "deviation-heading": 8.352401438865778, "agent_compute-ego0": 0.012339815836466716, "complete-iteration": 0.1834525545200188, "set_robot_commands": 0.0022293896018388028, "deviation-center-line": 1.8909636472368516, "driven_lanedir_consec": 6.106474709564622, "sim_compute_sim_state": 0.00948368489385365, "sim_compute_performance-ego0": 0.002047978760953435}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2666429325350237, "get_ui_image": 0.034946485330130304, "step_physics": 0.1388451161275383, "survival_time": 6.499999999999985, "driven_lanedir": 0.655615249420852, "get_state_dump": 0.004556501184711019, "get_robot_state": 0.0035739891401684013, "sim_render-ego0": 0.00373498720067148, "get_duckie_state": 1.3213121254025524e-06, "in-drivable-lane": 3.2499999999999885, "deviation-heading": 0.9232687975793896, "agent_compute-ego0": 0.01201668222441928, "complete-iteration": 0.21151411078358423, "set_robot_commands": 0.0021083682547998793, "deviation-center-line": 0.17058984297256408, "driven_lanedir_consec": 0.655615249420852, "sim_compute_sim_state": 0.009705896595962176, "sim_compute_performance-ego0": 0.0019308810925665705}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.194652623693013, "get_ui_image": 0.03399129291673288, "step_physics": 0.13088428642305625, "survival_time": 23.300000000000196, "driven_lanedir": 1.5398799808204373, "get_state_dump": 0.004750822545118965, "get_robot_state": 0.003799412439415746, "sim_render-ego0": 0.0040195238411554176, "get_duckie_state": 1.40957965074821e-06, "in-drivable-lane": 17.050000000000146, "deviation-heading": 2.214004193315011, "agent_compute-ego0": 0.013088435126065697, "complete-iteration": 0.207057288678351, "set_robot_commands": 0.0023904296009137236, "deviation-center-line": 0.4586679499186817, "driven_lanedir_consec": 1.5398799808204373, "sim_compute_sim_state": 0.011936298019115114, "sim_compute_performance-ego0": 0.002097637801405194}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.1803073812770473, "get_ui_image": 0.02648725325457528, "step_physics": 0.11051411587792916, "survival_time": 11.60000000000003, "driven_lanedir": 0.6537301032511873, "get_state_dump": 0.004795803020952086, "get_robot_state": 0.0036210164491710744, "sim_render-ego0": 0.003805234196871647, "get_duckie_state": 1.402883570593314e-06, "in-drivable-lane": 8.600000000000033, "deviation-heading": 0.5417772922998343, "agent_compute-ego0": 0.011811858083045534, "complete-iteration": 0.1704149450866961, "set_robot_commands": 0.002203099205770206, "deviation-center-line": 0.15714488270056734, "driven_lanedir_consec": 0.6537301032511873, "sim_compute_sim_state": 0.005108888568796314, "sim_compute_performance-ego0": 0.0019771449044027043}}
set_robot_commands_max0.0023904296009137236
set_robot_commands_mean0.002232821665830653
set_robot_commands_median0.0022162444038045046
set_robot_commands_min0.0021083682547998793
sim_compute_performance-ego0_max0.002097637801405194
sim_compute_performance-ego0_mean0.002013410639831976
sim_compute_performance-ego0_median0.0020125618326780697
sim_compute_performance-ego0_min0.0019308810925665705
sim_compute_sim_state_max0.011936298019115114
sim_compute_sim_state_mean0.009058692019431814
sim_compute_sim_state_median0.009594790744907912
sim_compute_sim_state_min0.005108888568796314
sim_render-ego0_max0.0040195238411554176
sim_render-ego0_mean0.003851526265672674
sim_render-ego0_median0.0038257970104319
sim_render-ego0_min0.00373498720067148
simulation-passed1
step_physics_max0.1388451161275383
step_physics_mean0.12403447179139183
step_physics_median0.12338932758005
step_physics_min0.11051411587792916
survival_time_max41.69999999999977
survival_time_mean20.775
survival_time_min6.499999999999985
No reset possible
5413511653Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:29:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.171729554683241
survival_time_median59.99999999999873
deviation-center-line_median2.420787393867646
in-drivable-lane_median8.774999999999718


other stats
agent_compute-ego0_max0.012459057951648467
agent_compute-ego0_mean0.011974316366625366
agent_compute-ego0_median0.011903366677270742
agent_compute-ego0_min0.011631474160311517
complete-iteration_max0.2591398598855002
complete-iteration_mean0.23698180851409817
complete-iteration_median0.24094376129274264
complete-iteration_min0.20689985158540725
deviation-center-line_max4.344682446225002
deviation-center-line_mean2.3374727013317207
deviation-center-line_min0.16363357136658968
deviation-heading_max18.67667858278351
deviation-heading_mean10.188117192004484
deviation-heading_median10.300499578846711
deviation-heading_min1.4747910275409923
driven_any_max11.690864523034334
driven_any_mean8.33112756374558
driven_any_median10.366770671831636
driven_any_min0.9001043882847176
driven_lanedir_consec_max8.677218508736907
driven_lanedir_consec_mean4.383827779616815
driven_lanedir_consec_min0.5146335003638707
driven_lanedir_max9.2468096259661
driven_lanedir_mean5.153250570008679
driven_lanedir_median5.425779576852372
driven_lanedir_min0.5146335003638707
get_duckie_state_max1.4455987452269593e-06
get_duckie_state_mean1.4083812139164425e-06
get_duckie_state_median1.4058954014964745e-06
get_duckie_state_min1.376135307445861e-06
get_robot_state_max0.0038929944431454217
get_robot_state_mean0.0037845098773977978
get_robot_state_median0.003800404359657103
get_robot_state_min0.0036442363471315617
get_state_dump_max0.004817955102849067
get_state_dump_mean0.004720726435919722
get_state_dump_median0.004713998944634304
get_state_dump_min0.004636952751561215
get_ui_image_max0.03514046208900318
get_ui_image_mean0.0311112950595991
get_ui_image_median0.031213102193795868
get_ui_image_min0.02687851376180149
in-drivable-lane_max45.94999999999861
in-drivable-lane_mean16.41249999999951
in-drivable-lane_min2.1499999999999924
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.690864523034334, "get_ui_image": 0.028800819438264135, "step_physics": 0.13976923770253405, "survival_time": 59.99999999999873, "driven_lanedir": 9.2468096259661, "get_state_dump": 0.00465469812969681, "get_robot_state": 0.003754819461844744, "sim_render-ego0": 0.003829277326026427, "get_duckie_state": 1.3765149271359157e-06, "in-drivable-lane": 9.69999999999962, "deviation-heading": 14.85653334401626, "agent_compute-ego0": 0.011767701840619064, "complete-iteration": 0.20689985158540725, "set_robot_commands": 0.0022790445872488663, "deviation-center-line": 3.395368155194975, "driven_lanedir_consec": 6.169118464398641, "sim_compute_sim_state": 0.009897069470471486, "sim_compute_performance-ego0": 0.002056202423959648}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.9001043882847176, "get_ui_image": 0.03514046208900318, "step_physics": 0.1860757501501786, "survival_time": 5.649999999999988, "driven_lanedir": 0.5146335003638707, "get_state_dump": 0.004636952751561215, "get_robot_state": 0.0036442363471315617, "sim_render-ego0": 0.003695270471405565, "get_duckie_state": 1.376135307445861e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 1.4747910275409923, "agent_compute-ego0": 0.011631474160311517, "complete-iteration": 0.2591398598855002, "set_robot_commands": 0.002232743982683148, "deviation-center-line": 0.16363357136658968, "driven_lanedir_consec": 0.5146335003638707, "sim_compute_sim_state": 0.010036173619722066, "sim_compute_performance-ego0": 0.0019556534917731035}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.063174720485131, "get_ui_image": 0.033625384949327604, "step_physics": 0.1793822710162694, "survival_time": 59.99999999999873, "driven_lanedir": 8.677218508736907, "get_state_dump": 0.004817955102849067, "get_robot_state": 0.0038929944431454217, "sim_render-ego0": 0.003971669795014876, "get_duckie_state": 1.4455987452269593e-06, "in-drivable-lane": 7.849999999999817, "deviation-heading": 18.67667858278351, "agent_compute-ego0": 0.012459057951648467, "complete-iteration": 0.25633583656457143, "set_robot_commands": 0.0023702544832507537, "deviation-center-line": 4.344682446225002, "driven_lanedir_consec": 8.677218508736907, "sim_compute_sim_state": 0.013585067410750948, "sim_compute_performance-ego0": 0.0021344049090052724}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.67036662317814, "get_ui_image": 0.02687851376180149, "step_physics": 0.16323506306053498, "survival_time": 59.99999999999873, "driven_lanedir": 2.174340644967839, "get_state_dump": 0.004773299759571796, "get_robot_state": 0.003845989257469463, "sim_render-ego0": 0.003909338126075357, "get_duckie_state": 1.4352758758570331e-06, "in-drivable-lane": 45.94999999999861, "deviation-heading": 5.744465813677165, "agent_compute-ego0": 0.01203903151392242, "complete-iteration": 0.22555168602091383, "set_robot_commands": 0.002320205639244416, "deviation-center-line": 1.4462066325403171, "driven_lanedir_consec": 2.174340644967839, "sim_compute_sim_state": 0.006382915796983451, "sim_compute_performance-ego0": 0.0020725613926769197}}
set_robot_commands_max0.0023702544832507537
set_robot_commands_mean0.002300562173106796
set_robot_commands_median0.0022996251132466413
set_robot_commands_min0.002232743982683148
sim_compute_performance-ego0_max0.0021344049090052724
sim_compute_performance-ego0_mean0.0020547055543537356
sim_compute_performance-ego0_median0.002064381908318284
sim_compute_performance-ego0_min0.0019556534917731035
sim_compute_sim_state_max0.013585067410750948
sim_compute_sim_state_mean0.00997530657448199
sim_compute_sim_state_median0.009966621545096775
sim_compute_sim_state_min0.006382915796983451
sim_render-ego0_max0.003971669795014876
sim_render-ego0_mean0.003851388929630556
sim_render-ego0_median0.003869307726050892
sim_render-ego0_min0.003695270471405565
simulation-passed1
step_physics_max0.1860757501501786
step_physics_mean0.1671155804823793
step_physics_median0.1713086670384022
step_physics_min0.13976923770253405
survival_time_max59.99999999999873
survival_time_mean46.41249999999904
survival_time_min5.649999999999988
No reset possible
5411611659Bhavya Patwa 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:06:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5947041908916109
survival_time_median6.8999999999999835
deviation-center-line_median0.10758083999525164
in-drivable-lane_median4.424999999999985


other stats
agent_compute-ego0_max0.013399598210356956
agent_compute-ego0_mean0.013017942306416523
agent_compute-ego0_median0.012975934916926968
agent_compute-ego0_min0.0127203011814552
complete-iteration_max0.2269706606864929
complete-iteration_mean0.2019415181835287
complete-iteration_median0.20430659278239807
complete-iteration_min0.17218222648282594
deviation-center-line_max0.17622539165075146
deviation-center-line_mean0.11681967269485648
deviation-center-line_min0.07589161913817119
deviation-heading_max1.3028686127086373
deviation-heading_mean0.7029260276916234
deviation-heading_median0.5715156736426281
deviation-heading_min0.3658041507726006
driven_any_max3.774268132554616
driven_any_mean1.9785683348232812
driven_any_median1.5376634489022607
driven_any_min1.064678308933987
driven_lanedir_consec_max0.664465795453598
driven_lanedir_consec_mean0.5270237442848184
driven_lanedir_consec_min0.2542207999024536
driven_lanedir_max0.664465795453598
driven_lanedir_mean0.5270237442848184
driven_lanedir_median0.5947041908916109
driven_lanedir_min0.2542207999024536
get_duckie_state_max1.4970468920330668e-06
get_duckie_state_mean1.3896128927637137e-06
get_duckie_state_median1.3720710147428272e-06
get_duckie_state_min1.317262649536133e-06
get_robot_state_max0.003845935644105423
get_robot_state_mean0.0038113951807613447
get_robot_state_median0.003800242699148283
get_robot_state_min0.003799159680643389
get_state_dump_max0.005142048347828
get_state_dump_mean0.004894996626753856
get_state_dump_median0.004842206707564733
get_state_dump_min0.004753524744057957
get_ui_image_max0.03700392047564189
get_ui_image_mean0.03238193334206166
get_ui_image_median0.03252014914999368
get_ui_image_min0.027483514592617372
in-drivable-lane_max16.800000000000118
in-drivable-lane_mean6.912500000000019
in-drivable-lane_min1.999999999999993
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.774268132554616, "get_ui_image": 0.029594511114140992, "step_physics": 0.12507342138598043, "survival_time": 18.55000000000013, "driven_lanedir": 0.2542207999024536, "get_state_dump": 0.004810817780033234, "get_robot_state": 0.003799159680643389, "sim_render-ego0": 0.003887382245832874, "get_duckie_state": 1.3875704939647388e-06, "in-drivable-lane": 16.800000000000118, "deviation-heading": 1.3028686127086373, "agent_compute-ego0": 0.01298440848627398, "complete-iteration": 0.19343150495201028, "set_robot_commands": 0.002267199818805982, "deviation-center-line": 0.17622539165075146, "driven_lanedir_consec": 0.2542207999024536, "sim_compute_sim_state": 0.008909511309798045, "sim_compute_performance-ego0": 0.0020160380230155044}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.280073118172269, "get_ui_image": 0.03700392047564189, "step_physics": 0.14974052707354227, "survival_time": 5.949999999999987, "driven_lanedir": 0.5601980645939806, "get_state_dump": 0.004873595635096232, "get_robot_state": 0.0038004418214162192, "sim_render-ego0": 0.003884655237197876, "get_duckie_state": 1.317262649536133e-06, "in-drivable-lane": 3.349999999999988, "deviation-heading": 0.7582930187385377, "agent_compute-ego0": 0.012967461347579956, "complete-iteration": 0.2269706606864929, "set_robot_commands": 0.0022989173730214437, "deviation-center-line": 0.09989380909988084, "driven_lanedir_consec": 0.5601980645939806, "sim_compute_sim_state": 0.010232688983281451, "sim_compute_performance-ego0": 0.0020783722400665285}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.064678308933987, "get_ui_image": 0.03544578718584637, "step_physics": 0.13998678395914477, "survival_time": 4.249999999999993, "driven_lanedir": 0.6292103171892413, "get_state_dump": 0.005142048347828, "get_robot_state": 0.003845935644105423, "sim_render-ego0": 0.00409139588821766, "get_duckie_state": 1.4970468920330668e-06, "in-drivable-lane": 1.999999999999993, "deviation-heading": 0.3847383285467184, "agent_compute-ego0": 0.013399598210356956, "complete-iteration": 0.21518168061278584, "set_robot_commands": 0.00242492210033328, "deviation-center-line": 0.07589161913817119, "driven_lanedir_consec": 0.6292103171892413, "sim_compute_sim_state": 0.00858160506847293, "sim_compute_performance-ego0": 0.002161982447602028}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7952537796322523, "get_ui_image": 0.027483514592617372, "step_physics": 0.11018302018129372, "survival_time": 7.84999999999998, "driven_lanedir": 0.664465795453598, "get_state_dump": 0.004753524744057957, "get_robot_state": 0.0038000435768803464, "sim_render-ego0": 0.003875337069547629, "get_duckie_state": 1.3565715355209158e-06, "in-drivable-lane": 5.4999999999999805, "deviation-heading": 0.3658041507726006, "agent_compute-ego0": 0.0127203011814552, "complete-iteration": 0.17218222648282594, "set_robot_commands": 0.002294409124157097, "deviation-center-line": 0.1152678708906224, "driven_lanedir_consec": 0.664465795453598, "sim_compute_sim_state": 0.005024446716791467, "sim_compute_performance-ego0": 0.001960353006290484}}
set_robot_commands_max0.00242492210033328
set_robot_commands_mean0.0023213621040794503
set_robot_commands_median0.0022966632485892703
set_robot_commands_min0.002267199818805982
sim_compute_performance-ego0_max0.002161982447602028
sim_compute_performance-ego0_mean0.002054186429243636
sim_compute_performance-ego0_median0.0020472051315410167
sim_compute_performance-ego0_min0.001960353006290484
sim_compute_sim_state_max0.010232688983281451
sim_compute_sim_state_mean0.008187063019585973
sim_compute_sim_state_median0.008745558189135487
sim_compute_sim_state_min0.005024446716791467
sim_render-ego0_max0.00409139588821766
sim_render-ego0_mean0.003934692610199009
sim_render-ego0_median0.003886018741515375
sim_render-ego0_min0.003875337069547629
simulation-passed1
step_physics_max0.14974052707354227
step_physics_mean0.1312459381499903
step_physics_median0.1325301026725626
step_physics_min0.11018302018129372
survival_time_max18.55000000000013
survival_time_mean9.150000000000022
survival_time_min4.249999999999993
No reset possible
5407711673Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:11:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7282263912851112
survival_time_median15.250000000000082
deviation-center-line_median0.6914447661680001
in-drivable-lane_median5.875000000000007


other stats
agent_compute-ego0_max0.01332592859602811
agent_compute-ego0_mean0.012885167646495818
agent_compute-ego0_median0.012913320243392711
agent_compute-ego0_min0.012388101503169735
complete-iteration_max0.3115569792295757
complete-iteration_mean0.26099800336618917
complete-iteration_median0.2617286062081189
complete-iteration_min0.20897782181894312
deviation-center-line_max1.4864547309024665
deviation-center-line_mean0.788163983406617
deviation-center-line_min0.28331167038800154
deviation-heading_max5.510721008842559
deviation-heading_mean3.6655824595918234
deviation-heading_median3.744797315161213
deviation-heading_min1.662014199202309
driven_any_max8.243546890000477
driven_any_mean5.635158076080539
driven_any_median5.6039046162915245
driven_any_min3.0892761817386294
driven_lanedir_consec_max6.246120175937779
driven_lanedir_consec_mean2.674494824412549
driven_lanedir_consec_min0.995406339142192
driven_lanedir_max6.246120175937779
driven_lanedir_mean3.141660079758722
driven_lanedir_median2.6448984976147005
driven_lanedir_min1.030723147867708
get_duckie_state_max1.648016143263432e-06
get_duckie_state_mean1.448415273932244e-06
get_duckie_state_median1.418723587994501e-06
get_duckie_state_min1.3081977764765422e-06
get_robot_state_max0.004038876608798378
get_robot_state_mean0.003929732760768414
get_robot_state_median0.0039777656687490365
get_robot_state_min0.0037245230967772073
get_state_dump_max0.005276973833117569
get_state_dump_mean0.0051192511261413136
get_state_dump_median0.005158750272144987
get_state_dump_min0.004882530127157712
get_ui_image_max0.038932344369721
get_ui_image_mean0.03262809340099503
get_ui_image_median0.032417851750270774
get_ui_image_min0.026744325733717593
in-drivable-lane_max7.450000000000082
in-drivable-lane_mean5.962500000000039
in-drivable-lane_min4.650000000000066
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.243546890000477, "get_ui_image": 0.03051672429187347, "step_physics": 0.16761148712454998, "survival_time": 21.800000000000175, "driven_lanedir": 6.246120175937779, "get_state_dump": 0.005159914357165723, "get_robot_state": 0.004007554981746717, "sim_render-ego0": 0.004166210270582675, "get_duckie_state": 1.4588816487816431e-06, "in-drivable-lane": 4.650000000000066, "deviation-heading": 5.091618070934365, "agent_compute-ego0": 0.01290126523382331, "complete-iteration": 0.239719327581829, "set_robot_commands": 0.0023654893006558276, "deviation-center-line": 1.4864547309024665, "driven_lanedir_consec": 6.246120175937779, "sim_compute_sim_state": 0.010626126208621797, "sim_compute_performance-ego0": 0.0022681272275387834}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.07003719949474, "get_ui_image": 0.038932344369721, "step_physics": 0.22788787620109424, "survival_time": 11.350000000000026, "driven_lanedir": 1.5533972824960918, "get_state_dump": 0.005276973833117569, "get_robot_state": 0.004038876608798378, "sim_render-ego0": 0.004192863640032317, "get_duckie_state": 1.648016143263432e-06, "in-drivable-lane": 6.400000000000018, "deviation-heading": 2.3979765593880606, "agent_compute-ego0": 0.01332592859602811, "complete-iteration": 0.3115569792295757, "set_robot_commands": 0.002491499248303865, "deviation-center-line": 0.4490317535814017, "driven_lanedir_consec": 0.995406339142192, "sim_compute_sim_state": 0.013002140480175351, "sim_compute_performance-ego0": 0.002308579913356848}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.13777203308831, "get_ui_image": 0.034318979208668075, "step_physics": 0.20707606772581735, "survival_time": 19.150000000000137, "driven_lanedir": 3.7363997127333097, "get_state_dump": 0.005157586187124252, "get_robot_state": 0.003947976355751355, "sim_render-ego0": 0.004110002890229225, "get_duckie_state": 1.3081977764765422e-06, "in-drivable-lane": 7.450000000000082, "deviation-heading": 5.510721008842559, "agent_compute-ego0": 0.012925375252962112, "complete-iteration": 0.28373788483440876, "set_robot_commands": 0.0023081724842389426, "deviation-center-line": 0.9338577787545984, "driven_lanedir_consec": 2.4311556873872417, "sim_compute_sim_state": 0.0116102397441864, "sim_compute_performance-ego0": 0.00218957227965196}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.0892761817386294, "get_ui_image": 0.026744325733717593, "step_physics": 0.14696234564541438, "survival_time": 8.899999999999991, "driven_lanedir": 1.030723147867708, "get_state_dump": 0.004882530127157712, "get_robot_state": 0.0037245230967772073, "sim_render-ego0": 0.0038003375410367657, "get_duckie_state": 1.3785655272073586e-06, "in-drivable-lane": 5.349999999999996, "deviation-heading": 1.662014199202309, "agent_compute-ego0": 0.012388101503169735, "complete-iteration": 0.20897782181894312, "set_robot_commands": 0.0022153974245380423, "deviation-center-line": 0.28331167038800154, "driven_lanedir_consec": 1.0252970951829807, "sim_compute_sim_state": 0.00616627698504059, "sim_compute_performance-ego0": 0.00200480455792816}}
set_robot_commands_max0.002491499248303865
set_robot_commands_mean0.0023451396144341693
set_robot_commands_median0.002336830892447385
set_robot_commands_min0.0022153974245380423
sim_compute_performance-ego0_max0.002308579913356848
sim_compute_performance-ego0_mean0.0021927709946189377
sim_compute_performance-ego0_median0.0022288497535953716
sim_compute_performance-ego0_min0.00200480455792816
sim_compute_sim_state_max0.013002140480175351
sim_compute_sim_state_mean0.010351195854506034
sim_compute_sim_state_median0.011118182976404095
sim_compute_sim_state_min0.00616627698504059
sim_render-ego0_max0.004192863640032317
sim_render-ego0_mean0.004067353585470245
sim_render-ego0_median0.00413810658040595
sim_render-ego0_min0.0038003375410367657
simulation-passed1
step_physics_max0.22788787620109424
step_physics_mean0.18738444417421896
step_physics_median0.18734377742518368
step_physics_min0.14696234564541438
survival_time_max21.800000000000175
survival_time_mean15.300000000000082
survival_time_min8.899999999999991
No reset possible
5406711705brian wongbaseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5404011684Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:09:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4007548985345026
survival_time_median12.800000000000049
deviation-center-line_median0.4329993339194177
in-drivable-lane_median6.650000000000057


other stats
agent_compute-ego0_max0.01346590833843879
agent_compute-ego0_mean0.012872180920906385
agent_compute-ego0_median0.012739153714638756
agent_compute-ego0_min0.012544507915909223
complete-iteration_max0.29510024208692637
complete-iteration_mean0.2530701365912283
complete-iteration_median0.25329174309060154
complete-iteration_min0.21059681809678368
deviation-center-line_max0.5445511885859892
deviation-center-line_mean0.4218059058905095
deviation-center-line_min0.27667376713721353
deviation-heading_max2.931525359567218
deviation-heading_mean1.5872930842826778
deviation-heading_median1.1764718836177042
deviation-heading_min1.064703210328085
driven_any_max6.344560633233745
driven_any_mean4.5267481117071275
driven_any_median4.6351633181324505
driven_any_min2.4921051773298655
driven_lanedir_consec_max2.5596194635745935
driven_lanedir_consec_mean1.6237628381947955
driven_lanedir_consec_min1.1339220921355826
driven_lanedir_max2.5596194635745935
driven_lanedir_mean1.6237628381947955
driven_lanedir_median1.4007548985345026
driven_lanedir_min1.1339220921355826
get_duckie_state_max1.4339869641006511e-06
get_duckie_state_mean1.3570109567816374e-06
get_duckie_state_median1.3494320207100566e-06
get_duckie_state_min1.2951928216057857e-06
get_robot_state_max0.004048291992091533
get_robot_state_mean0.003850687080614805
get_robot_state_median0.003803745918395662
get_robot_state_min0.0037469644935763614
get_state_dump_max0.0051060262716041424
get_state_dump_mean0.004865211242451745
get_state_dump_median0.004864971128707518
get_state_dump_min0.004624876440787802
get_ui_image_max0.03661853719402004
get_ui_image_mean0.0322474627694237
get_ui_image_median0.032491038338606476
get_ui_image_min0.027389237206461827
in-drivable-lane_max13.200000000000111
in-drivable-lane_mean7.625000000000053
in-drivable-lane_min3.999999999999986
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.4529412931237276, "get_ui_image": 0.029057977150897592, "step_physics": 0.14218092086363812, "survival_time": 9.750000000000004, "driven_lanedir": 1.5434478278043606, "get_state_dump": 0.004624876440787802, "get_robot_state": 0.0037469644935763614, "sim_render-ego0": 0.0038567416521967674, "get_duckie_state": 1.3283320835658482e-06, "in-drivable-lane": 5.350000000000013, "deviation-heading": 1.064703210328085, "agent_compute-ego0": 0.012583085468837194, "complete-iteration": 0.21059681809678368, "set_robot_commands": 0.0022567194335314693, "deviation-center-line": 0.5445511885859892, "driven_lanedir_consec": 1.5434478278043606, "sim_compute_sim_state": 0.010148842724002138, "sim_compute_performance-ego0": 0.002051855836595808}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.4921051773298655, "get_ui_image": 0.03661853719402004, "step_physics": 0.21462635736207705, "survival_time": 7.349999999999982, "driven_lanedir": 1.1339220921355826, "get_state_dump": 0.00472159160150064, "get_robot_state": 0.003774291760212666, "sim_render-ego0": 0.0037985637381270127, "get_duckie_state": 1.2951928216057857e-06, "in-drivable-lane": 3.999999999999986, "deviation-heading": 1.0696307437330723, "agent_compute-ego0": 0.012544507915909223, "complete-iteration": 0.2905344093168104, "set_robot_commands": 0.0022021612605533083, "deviation-center-line": 0.27667376713721353, "driven_lanedir_consec": 1.1339220921355826, "sim_compute_sim_state": 0.010114898552765718, "sim_compute_performance-ego0": 0.002048131581899282}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.817385343141174, "get_ui_image": 0.03592409952631537, "step_physics": 0.2150300703708481, "survival_time": 15.85000000000009, "driven_lanedir": 2.5596194635745935, "get_state_dump": 0.0051060262716041424, "get_robot_state": 0.004048291992091533, "sim_render-ego0": 0.004204094035070647, "get_duckie_state": 1.370531957854265e-06, "in-drivable-lane": 7.9500000000001005, "deviation-heading": 2.931525359567218, "agent_compute-ego0": 0.01346590833843879, "complete-iteration": 0.29510024208692637, "set_robot_commands": 0.0024708426973354893, "deviation-center-line": 0.5139275019631946, "driven_lanedir_consec": 2.5596194635745935, "sim_compute_sim_state": 0.012491664796505332, "sim_compute_performance-ego0": 0.002262414626355441}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.344560633233745, "get_ui_image": 0.027389237206461827, "step_physics": 0.15265994377803524, "survival_time": 17.100000000000108, "driven_lanedir": 1.2580619692646446, "get_state_dump": 0.005008350655914396, "get_robot_state": 0.0038332000765786576, "sim_render-ego0": 0.00395357226491322, "get_duckie_state": 1.4339869641006511e-06, "in-drivable-lane": 13.200000000000111, "deviation-heading": 1.2833130235023358, "agent_compute-ego0": 0.01289522196044032, "complete-iteration": 0.2160490768643927, "set_robot_commands": 0.002424383302471728, "deviation-center-line": 0.3520711658756408, "driven_lanedir_consec": 1.2580619692646446, "sim_compute_sim_state": 0.005680285111808221, "sim_compute_performance-ego0": 0.002116974171674634}}
set_robot_commands_max0.0024708426973354893
set_robot_commands_mean0.0023385266734729988
set_robot_commands_median0.0023405513680015986
set_robot_commands_min0.0022021612605533083
sim_compute_performance-ego0_max0.002262414626355441
sim_compute_performance-ego0_mean0.002119844054131291
sim_compute_performance-ego0_median0.002084415004135221
sim_compute_performance-ego0_min0.002048131581899282
sim_compute_sim_state_max0.012491664796505332
sim_compute_sim_state_mean0.009608922796270352
sim_compute_sim_state_median0.010131870638383928
sim_compute_sim_state_min0.005680285111808221
sim_render-ego0_max0.004204094035070647
sim_render-ego0_mean0.003953242922576912
sim_render-ego0_median0.0039051569585549935
sim_render-ego0_min0.0037985637381270127
simulation-passed1
step_physics_max0.2150300703708481
step_physics_mean0.1811243230936496
step_physics_median0.18364315057005615
step_physics_min0.14218092086363812
survival_time_max17.100000000000108
survival_time_mean12.512500000000044
survival_time_min7.349999999999982
No reset possible
5395211701Yishu Malhotra 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-070:41:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.953866111566352
survival_time_median59.99999999999873
deviation-center-line_median3.5751955038466185
in-drivable-lane_median1.1249999999999662


other stats
agent_compute-ego0_max0.013237876360065038
agent_compute-ego0_mean0.012941119027673751
agent_compute-ego0_median0.01288147314105006
agent_compute-ego0_min0.012763653468529848
complete-iteration_max0.25953710525855733
complete-iteration_mean0.23206583263475036
complete-iteration_median0.236881963914876
complete-iteration_min0.19496229745069213
deviation-center-line_max3.890078329783319
deviation-center-line_mean3.5034521329355828
deviation-center-line_min2.973339194265777
deviation-heading_max19.064864413688102
deviation-heading_mean18.38839204383128
deviation-heading_median18.890663517648164
deviation-heading_min16.707376726340698
driven_any_max11.646172315979967
driven_any_mean11.011778982654086
driven_any_median11.008189266762791
driven_any_min10.384565081110791
driven_lanedir_consec_max10.804361064633682
driven_lanedir_consec_mean8.790537106862601
driven_lanedir_consec_min4.4500551396840216
driven_lanedir_max10.804361064633682
driven_lanedir_mean9.418845114439744
driven_lanedir_median9.953866111566352
driven_lanedir_min6.9632871699925865
get_duckie_state_max1.5516066729873545e-06
get_duckie_state_mean1.472150356346721e-06
get_duckie_state_median1.4564179063935164e-06
get_duckie_state_min1.4241589396124974e-06
get_robot_state_max0.004070259748549386
get_robot_state_mean0.003833898944124195
get_robot_state_median0.0037741350393112657
get_robot_state_min0.003717065949324863
get_state_dump_max0.005129982688643355
get_state_dump_mean0.004807327460686829
get_state_dump_median0.004726299139780367
get_state_dump_min0.004646728874543227
get_ui_image_max0.03647862008767362
get_ui_image_mean0.03176630590480134
get_ui_image_median0.03205340103146238
get_ui_image_min0.02647980146860699
in-drivable-lane_max16.300000000000036
in-drivable-lane_mean4.637499999999992
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.227310662176505, "get_ui_image": 0.029725630019328476, "step_physics": 0.14884993634950508, "survival_time": 59.99999999999873, "driven_lanedir": 9.930862200080655, "get_state_dump": 0.00474437110926289, "get_robot_state": 0.003800077501879842, "sim_render-ego0": 0.003847743946745632, "get_duckie_state": 1.48331692177092e-06, "in-drivable-lane": 2.2499999999999325, "deviation-heading": 19.064864413688102, "agent_compute-ego0": 0.012931678614747416, "complete-iteration": 0.21809231470665463, "set_robot_commands": 0.002302996423421156, "deviation-center-line": 3.5172518473077172, "driven_lanedir_consec": 9.930862200080655, "sim_compute_sim_state": 0.009720872383530591, "sim_compute_performance-ego0": 0.0020766812101391135}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.646172315979967, "get_ui_image": 0.03647862008767362, "step_physics": 0.17561493388421331, "survival_time": 59.99999999999873, "driven_lanedir": 10.804361064633682, "get_state_dump": 0.004646728874543227, "get_robot_state": 0.003717065949324863, "sim_render-ego0": 0.0038376997948486938, "get_duckie_state": 1.4241589396124974e-06, "in-drivable-lane": 0.0, "deviation-heading": 18.758066330267702, "agent_compute-ego0": 0.012831267667352706, "complete-iteration": 0.2556716131230973, "set_robot_commands": 0.0022293530733361036, "deviation-center-line": 3.890078329783319, "driven_lanedir_consec": 10.804361064633682, "sim_compute_sim_state": 0.01416438981754198, "sim_compute_performance-ego0": 0.002061234227227331}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.78906787134908, "get_ui_image": 0.03438117204359628, "step_physics": 0.17955330170560738, "survival_time": 59.99999999999873, "driven_lanedir": 9.97687002305205, "get_state_dump": 0.005129982688643355, "get_robot_state": 0.004070259748549386, "sim_render-ego0": 0.004148917233914162, "get_duckie_state": 1.5516066729873545e-06, "in-drivable-lane": 0.0, "deviation-heading": 19.02326070502863, "agent_compute-ego0": 0.013237876360065038, "complete-iteration": 0.25953710525855733, "set_robot_commands": 0.002496432900726547, "deviation-center-line": 3.63313916038552, "driven_lanedir_consec": 9.97687002305205, "sim_compute_sim_state": 0.014080807529420876, "sim_compute_performance-ego0": 0.0023317140504581346}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.384565081110791, "get_ui_image": 0.02647980146860699, "step_physics": 0.13278739676685952, "survival_time": 59.99999999999873, "driven_lanedir": 6.9632871699925865, "get_state_dump": 0.004708227170297843, "get_robot_state": 0.003748192576742688, "sim_render-ego0": 0.003869212140250861, "get_duckie_state": 1.429518891016113e-06, "in-drivable-lane": 16.300000000000036, "deviation-heading": 16.707376726340698, "agent_compute-ego0": 0.012763653468529848, "complete-iteration": 0.19496229745069213, "set_robot_commands": 0.002245242550013762, "deviation-center-line": 2.973339194265777, "driven_lanedir_consec": 4.4500551396840216, "sim_compute_sim_state": 0.0062303912331917, "sim_compute_performance-ego0": 0.0020418429156326434}}
set_robot_commands_max0.002496432900726547
set_robot_commands_mean0.002318506236874392
set_robot_commands_median0.002274119486717459
set_robot_commands_min0.0022293530733361036
sim_compute_performance-ego0_max0.0023317140504581346
sim_compute_performance-ego0_mean0.0021278681008643054
sim_compute_performance-ego0_median0.002068957718683222
sim_compute_performance-ego0_min0.0020418429156326434
sim_compute_sim_state_max0.01416438981754198
sim_compute_sim_state_mean0.011049115240921288
sim_compute_sim_state_median0.011900839956475734
sim_compute_sim_state_min0.0062303912331917
sim_render-ego0_max0.004148917233914162
sim_render-ego0_mean0.003925893278939837
sim_render-ego0_median0.0038584780434982465
sim_render-ego0_min0.0038376997948486938
simulation-passed1
step_physics_max0.17955330170560738
step_physics_mean0.15920139217654633
step_physics_median0.1622324351168592
step_physics_min0.13278739676685952
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5393811731Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-070:02:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible