Duckietown Challenges Home Challenges Submissions

Evaluator 4877

ID4877
evaluatornogpu-prod-02
ownerI don't have one 😀
machinenogpu-prod_81ffd63998c0
processnogpu-prod-02_81ffd63998c0
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success21 54020
# timeout1 57525
# failed3 54338
# error1 53985
# aborted3 57208
# host-error38 53905
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5752510902Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutyesnogpu-prod-02----No reset possible
5741410932Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:27:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4324230418640727
survival_time_median59.99999999999873
deviation-center-line_median1.3479850358049772
in-drivable-lane_median13.949999999999823


other stats
agent_compute-ego0_max0.02483666965506853
agent_compute-ego0_mean0.016111249205960486
agent_compute-ego0_median0.013450878645160811
agent_compute-ego0_min0.012706569878451797
complete-iteration_max0.22138683479952528
complete-iteration_mean0.18475249202638208
complete-iteration_median0.17601376280598002
complete-iteration_min0.16559560769404302
deviation-center-line_max3.1117020531121473
deviation-center-line_mean1.4916997735793092
deviation-center-line_min0.15912696959513437
deviation-heading_max9.89328577023344
deviation-heading_mean4.865167305343885
deviation-heading_median3.8351248593659815
deviation-heading_min1.8971337324101356
driven_any_max7.0812906029662495
driven_any_mean4.902028267609603
driven_any_median6.123686964352375
driven_any_min0.2794485387674132
driven_lanedir_consec_max6.111523147675281
driven_lanedir_consec_mean2.7721316617812333
driven_lanedir_consec_min0.11215741572150772
driven_lanedir_max6.111523147675281
driven_lanedir_mean3.0981111184630237
driven_lanedir_median3.0843819552276535
driven_lanedir_min0.11215741572150772
get_duckie_state_max1.3328460325677711e-06
get_duckie_state_mean1.308970809498275e-06
get_duckie_state_median1.3078281424821765e-06
get_duckie_state_min1.2873809204609765e-06
get_robot_state_max0.00391654726071322
get_robot_state_mean0.003803086147720882
get_robot_state_median0.003823496717695988
get_robot_state_min0.003648803894778332
get_state_dump_max0.004986279810795081
get_state_dump_mean0.004799442822088687
get_state_dump_median0.004791129340140845
get_state_dump_min0.004629232797277979
get_ui_image_max0.034905646220747245
get_ui_image_mean0.03128456924336262
get_ui_image_median0.03140014553943542
get_ui_image_min0.027432339673832393
in-drivable-lane_max44.09999999999864
in-drivable-lane_mean17.99999999999957
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.0812906029662495, "get_ui_image": 0.02955646141681147, "step_physics": 0.1004070626210412, "survival_time": 59.99999999999873, "driven_lanedir": 4.379906239882677, "get_state_dump": 0.004837883799201146, "get_robot_state": 0.003801148499576972, "sim_render-ego0": 0.004105501230511439, "get_duckie_state": 1.3119969935738772e-06, "in-drivable-lane": 26.249999999999652, "deviation-heading": 5.014148930999563, "agent_compute-ego0": 0.013125234400600715, "complete-iteration": 0.1707473940694461, "set_robot_commands": 0.0023066711664001312, "deviation-center-line": 1.808619327477057, "driven_lanedir_consec": 3.0759884131555157, "sim_compute_sim_state": 0.010441814632241076, "sim_compute_performance-ego0": 0.002073929768418591}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2794485387674132, "get_ui_image": 0.034905646220747245, "step_physics": 0.1473421648324254, "survival_time": 4.099999999999993, "driven_lanedir": 0.11215741572150772, "get_state_dump": 0.004629232797277979, "get_robot_state": 0.003648803894778332, "sim_render-ego0": 0.003791332244873047, "get_duckie_state": 1.3328460325677711e-06, "in-drivable-lane": 1.649999999999994, "deviation-heading": 1.8971337324101356, "agent_compute-ego0": 0.012706569878451797, "complete-iteration": 0.22138683479952528, "set_robot_commands": 0.002176816204944289, "deviation-center-line": 0.15912696959513437, "driven_lanedir_consec": 0.11215741572150772, "sim_compute_sim_state": 0.010155447994370058, "sim_compute_performance-ego0": 0.001943519316523908}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.029375803289204, "get_ui_image": 0.03324382966205937, "step_physics": 0.10511427239315596, "survival_time": 59.99999999999873, "driven_lanedir": 1.7888576705726291, "get_state_dump": 0.004744374881080544, "get_robot_state": 0.003845844935815003, "sim_render-ego0": 0.004166799619930372, "get_duckie_state": 1.2873809204609765e-06, "in-drivable-lane": 44.09999999999864, "deviation-heading": 2.656100787732399, "agent_compute-ego0": 0.013776522889720907, "complete-iteration": 0.1812801315425139, "set_robot_commands": 0.00230327136907649, "deviation-center-line": 0.8873507441328976, "driven_lanedir_consec": 1.7888576705726291, "sim_compute_sim_state": 0.011878363794331546, "sim_compute_performance-ego0": 0.0021162029110720314}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.217998125415547, "get_ui_image": 0.027432339673832393, "step_physics": 0.089665658468013, "survival_time": 59.99999999999873, "driven_lanedir": 6.111523147675281, "get_state_dump": 0.004986279810795081, "get_robot_state": 0.00391654726071322, "sim_render-ego0": 0.0039884573613277186, "get_duckie_state": 1.3036592913904751e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.89328577023344, "agent_compute-ego0": 0.02483666965506853, "complete-iteration": 0.16559560769404302, "set_robot_commands": 0.00234316250962282, "deviation-center-line": 3.1117020531121473, "driven_lanedir_consec": 6.111523147675281, "sim_compute_sim_state": 0.006317549005932455, "sim_compute_performance-ego0": 0.0020166217635612903}}
set_robot_commands_max0.00234316250962282
set_robot_commands_mean0.0022824803125109324
set_robot_commands_median0.0023049712677383105
set_robot_commands_min0.002176816204944289
sim_compute_performance-ego0_max0.0021162029110720314
sim_compute_performance-ego0_mean0.0020375684398939555
sim_compute_performance-ego0_median0.002045275765989941
sim_compute_performance-ego0_min0.001943519316523908
sim_compute_sim_state_max0.011878363794331546
sim_compute_sim_state_mean0.009698293856718785
sim_compute_sim_state_median0.010298631313305568
sim_compute_sim_state_min0.006317549005932455
sim_render-ego0_max0.004166799619930372
sim_render-ego0_mean0.004013022614160644
sim_render-ego0_median0.004046979295919579
sim_render-ego0_min0.003791332244873047
simulation-passed1
step_physics_max0.1473421648324254
step_physics_mean0.1106322895786589
step_physics_median0.10276066750709856
step_physics_min0.089665658468013
survival_time_max59.99999999999873
survival_time_mean46.02499999999905
survival_time_min4.099999999999993
No reset possible
5738110949Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:07:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.33742863942648904
survival_time_median12.025000000000036
deviation-center-line_median0.18383288541375015
in-drivable-lane_median9.125000000000025


other stats
agent_compute-ego0_max0.013341207130282534
agent_compute-ego0_mean0.012701317667422706
agent_compute-ego0_median0.012692706722520463
agent_compute-ego0_min0.012078650094367364
complete-iteration_max0.2617994099855423
complete-iteration_mean0.1939854136023708
complete-iteration_median0.1752491413006383
complete-iteration_min0.1636439618226644
deviation-center-line_max0.40312041763473955
deviation-center-line_mean0.2094949579770937
deviation-center-line_min0.06719364344613481
deviation-heading_max1.714079907685552
deviation-heading_mean0.9982495727206931
deviation-heading_median0.802787954518648
deviation-heading_min0.6733424741599247
driven_any_max4.0376785257889445
driven_any_mean2.229530798727436
driven_any_median2.3029005812048595
driven_any_min0.2746435067110824
driven_lanedir_consec_max0.5581786738839754
driven_lanedir_consec_mean0.3363436651685361
driven_lanedir_consec_min0.11233870793719092
driven_lanedir_max0.5581786738839754
driven_lanedir_mean0.3363436651685361
driven_lanedir_median0.33742863942648904
driven_lanedir_min0.11233870793719092
get_duckie_state_max1.6039068048650569e-06
get_duckie_state_mean1.5055361327370589e-06
get_duckie_state_median1.4999041370317048e-06
get_duckie_state_min1.4184294520197688e-06
get_robot_state_max0.0038710587164934944
get_robot_state_mean0.003784262318878945
get_robot_state_median0.003802419912696212
get_robot_state_min0.0036611507336298623
get_state_dump_max0.0048740319177216175
get_state_dump_mean0.004703400989769797
get_state_dump_median0.004704749914569168
get_state_dump_min0.004530072212219238
get_ui_image_max0.03407128651936849
get_ui_image_mean0.029849178289703224
get_ui_image_median0.02909705178304152
get_ui_image_min0.02713132307336137
in-drivable-lane_max18.300000000000153
in-drivable-lane_mean9.43750000000005
in-drivable-lane_min1.1999999999999993
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.8741882983542237, "get_ui_image": 0.02713132307336137, "step_physics": 0.09790557864549998, "survival_time": 14.750000000000076, "driven_lanedir": 0.5581786738839754, "get_state_dump": 0.004585444121747403, "get_robot_state": 0.003740044058980169, "sim_render-ego0": 0.003933478046107937, "get_duckie_state": 1.4184294520197688e-06, "in-drivable-lane": 11.200000000000047, "deviation-heading": 1.714079907685552, "agent_compute-ego0": 0.012078650094367364, "complete-iteration": 0.1636439618226644, "set_robot_commands": 0.0022749941091279725, "deviation-center-line": 0.40312041763473955, "driven_lanedir_consec": 0.5581786738839754, "sim_compute_sim_state": 0.009822862373816, "sim_compute_performance-ego0": 0.002081145305891295}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2746435067110824, "get_ui_image": 0.03407128651936849, "step_physics": 0.1895910998185476, "survival_time": 2.3499999999999996, "driven_lanedir": 0.11233870793719092, "get_state_dump": 0.004530072212219238, "get_robot_state": 0.0036611507336298623, "sim_render-ego0": 0.004025682806968689, "get_duckie_state": 1.5447537104288738e-06, "in-drivable-lane": 1.1999999999999993, "deviation-heading": 0.8371178712502493, "agent_compute-ego0": 0.01275623341401418, "complete-iteration": 0.2617994099855423, "set_robot_commands": 0.0023537675539652505, "deviation-center-line": 0.06719364344613481, "driven_lanedir_consec": 0.11233870793719092, "sim_compute_sim_state": 0.008653298020362854, "sim_compute_performance-ego0": 0.0020633687575658164}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.0376785257889445, "get_ui_image": 0.03105939311139724, "step_physics": 0.10560673942752911, "survival_time": 20.35000000000015, "driven_lanedir": 0.3116371097405359, "get_state_dump": 0.0048740319177216175, "get_robot_state": 0.0038710587164934944, "sim_render-ego0": 0.00406187655879002, "get_duckie_state": 1.4550545636345358e-06, "in-drivable-lane": 18.300000000000153, "deviation-heading": 0.6733424741599247, "agent_compute-ego0": 0.013341207130282534, "complete-iteration": 0.17761190206396812, "set_robot_commands": 0.002238828177545585, "deviation-center-line": 0.14905927833765265, "driven_lanedir_consec": 0.3116371097405359, "sim_compute_sim_state": 0.010330896751553404, "sim_compute_performance-ego0": 0.002131158230351467}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.731612864055495, "get_ui_image": 0.0271347104546858, "step_physics": 0.11030761953343682, "survival_time": 9.299999999999995, "driven_lanedir": 0.36322016911244215, "get_state_dump": 0.004824055707390933, "get_robot_state": 0.003864795766412256, "sim_render-ego0": 0.004039138396156026, "get_duckie_state": 1.6039068048650569e-06, "in-drivable-lane": 7.05, "deviation-heading": 0.7684580377870469, "agent_compute-ego0": 0.01262918003102675, "complete-iteration": 0.17288638053730848, "set_robot_commands": 0.0023570137227920287, "deviation-center-line": 0.2186064924898477, "driven_lanedir_consec": 0.36322016911244215, "sim_compute_sim_state": 0.0055391724734382836, "sim_compute_performance-ego0": 0.0020945900901753636}}
set_robot_commands_max0.0023570137227920287
set_robot_commands_mean0.002306150890857709
set_robot_commands_median0.0023143808315466115
set_robot_commands_min0.002238828177545585
sim_compute_performance-ego0_max0.002131158230351467
sim_compute_performance-ego0_mean0.0020925655959959854
sim_compute_performance-ego0_median0.0020878676980333293
sim_compute_performance-ego0_min0.0020633687575658164
sim_compute_sim_state_max0.010330896751553404
sim_compute_sim_state_mean0.008586557404792635
sim_compute_sim_state_median0.009238080197089427
sim_compute_sim_state_min0.0055391724734382836
sim_render-ego0_max0.00406187655879002
sim_render-ego0_mean0.004015043952005668
sim_render-ego0_median0.004032410601562357
sim_render-ego0_min0.003933478046107937
simulation-passed1
step_physics_max0.1895910998185476
step_physics_mean0.12585275935625337
step_physics_median0.10795717948048296
step_physics_min0.09790557864549998
survival_time_max20.35000000000015
survival_time_mean11.687500000000057
survival_time_min2.3499999999999996
No reset possible
5733510955Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:05:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5493372669636701
survival_time_median7.79999999999998
deviation-center-line_median0.10040227008310038
in-drivable-lane_median5.449999999999985


other stats
agent_compute-ego0_max0.04991197899768227
agent_compute-ego0_mean0.03947137213526226
agent_compute-ego0_median0.04660524247605123
agent_compute-ego0_min0.01476302459126427
complete-iteration_max0.22661699276221425
complete-iteration_mean0.21013397923280389
complete-iteration_median0.20964427237157468
complete-iteration_min0.19463037942585193
deviation-center-line_max0.3092108405478928
deviation-center-line_mean0.14378688099933892
deviation-center-line_min0.06513214328326222
deviation-heading_max0.8932912839432124
deviation-heading_mean0.5574056708871741
deviation-heading_median0.5378505270902705
deviation-heading_min0.26063034542494296
driven_any_max3.551344108647839
driven_any_mean2.9887893913316947
driven_any_median3.30673628360076
driven_any_min1.7903408894774202
driven_lanedir_consec_max1.2021956115435777
driven_lanedir_consec_mean0.6700232422588184
driven_lanedir_consec_min0.37922282356435577
driven_lanedir_max1.2021956115435777
driven_lanedir_mean0.6700232422588184
driven_lanedir_median0.5493372669636701
driven_lanedir_min0.37922282356435577
get_duckie_state_max2.2607190268380303e-06
get_duckie_state_mean2.059213361356801e-06
get_duckie_state_median2.126936946618549e-06
get_duckie_state_min1.7222605253520763e-06
get_robot_state_max0.004203182679635507
get_robot_state_mean0.0038861407626309256
get_robot_state_median0.0038921495428061426
get_robot_state_min0.003557081285275911
get_state_dump_max0.00605688350541251
get_state_dump_mean0.005545382692152595
get_state_dump_median0.005492698379427369
get_state_dump_min0.005139250504343133
get_ui_image_max0.03564320575623285
get_ui_image_mean0.03135560791115458
get_ui_image_median0.031903192613944364
get_ui_image_min0.02597284066049676
in-drivable-lane_max6.949999999999983
in-drivable-lane_mean5.349999999999985
in-drivable-lane_min3.549999999999991
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.429020446720764, "get_ui_image": 0.02952317543971686, "step_physics": 0.11561292336310867, "survival_time": 8.04999999999998, "driven_lanedir": 1.2021956115435777, "get_state_dump": 0.005778378910488552, "get_robot_state": 0.004203182679635507, "sim_render-ego0": 0.004456227208361214, "get_duckie_state": 2.1030873428156346e-06, "in-drivable-lane": 5.149999999999987, "deviation-heading": 0.7859505765632968, "agent_compute-ego0": 0.047851254910598565, "complete-iteration": 0.22284151006627967, "set_robot_commands": 0.0026524891088038315, "deviation-center-line": 0.3092108405478928, "driven_lanedir_consec": 1.2021956115435777, "sim_compute_sim_state": 0.010312390916141462, "sim_compute_performance-ego0": 0.0023551517062717015}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.1844521204807563, "get_ui_image": 0.03428320978817187, "step_physics": 0.11564959036676507, "survival_time": 7.549999999999981, "driven_lanedir": 0.6273471097380174, "get_state_dump": 0.005207017848366185, "get_robot_state": 0.003557081285275911, "sim_render-ego0": 0.00390672997424477, "get_duckie_state": 1.7222605253520763e-06, "in-drivable-lane": 5.749999999999983, "deviation-heading": 0.8932912839432124, "agent_compute-ego0": 0.04991197899768227, "complete-iteration": 0.22661699276221425, "set_robot_commands": 0.002274367370103535, "deviation-center-line": 0.13278560547386148, "driven_lanedir_consec": 0.6273471097380174, "sim_compute_sim_state": 0.00976956988635816, "sim_compute_performance-ego0": 0.001970225258877403}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.551344108647839, "get_ui_image": 0.03564320575623285, "step_physics": 0.11709425420988172, "survival_time": 8.349999999999984, "driven_lanedir": 0.4713274241893228, "get_state_dump": 0.00605688350541251, "get_robot_state": 0.004136369341895694, "sim_render-ego0": 0.004598769403639294, "get_duckie_state": 2.2607190268380303e-06, "in-drivable-lane": 6.949999999999983, "deviation-heading": 0.28975047761724404, "agent_compute-ego0": 0.01476302459126427, "complete-iteration": 0.19644703467686972, "set_robot_commands": 0.002648864473615374, "deviation-center-line": 0.06801893469233929, "driven_lanedir_consec": 0.4713274241893228, "sim_compute_sim_state": 0.00901147865113758, "sim_compute_performance-ego0": 0.0023973569983527774}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7903408894774202, "get_ui_image": 0.02597284066049676, "step_physics": 0.101312255859375, "survival_time": 4.699999999999991, "driven_lanedir": 0.37922282356435577, "get_state_dump": 0.005139250504343133, "get_robot_state": 0.003647929743716591, "sim_render-ego0": 0.0038238148940236945, "get_duckie_state": 2.1507865504214636e-06, "in-drivable-lane": 3.549999999999991, "deviation-heading": 0.26063034542494296, "agent_compute-ego0": 0.045359230041503905, "complete-iteration": 0.19463037942585193, "set_robot_commands": 0.002259558125546104, "deviation-center-line": 0.06513214328326222, "driven_lanedir_consec": 0.37922282356435577, "sim_compute_sim_state": 0.005037114494725278, "sim_compute_performance-ego0": 0.0019840315768593236}}
set_robot_commands_max0.0026524891088038315
set_robot_commands_mean0.002458819769517211
set_robot_commands_median0.0024616159218594546
set_robot_commands_min0.002259558125546104
sim_compute_performance-ego0_max0.0023973569983527774
sim_compute_performance-ego0_mean0.002176691385090302
sim_compute_performance-ego0_median0.0021695916415655127
sim_compute_performance-ego0_min0.001970225258877403
sim_compute_sim_state_max0.010312390916141462
sim_compute_sim_state_mean0.00853263848709062
sim_compute_sim_state_median0.00939052426874787
sim_compute_sim_state_min0.005037114494725278
sim_render-ego0_max0.004598769403639294
sim_render-ego0_mean0.004196385370067243
sim_render-ego0_median0.004181478591302992
sim_render-ego0_min0.0038238148940236945
simulation-passed1
step_physics_max0.11709425420988172
step_physics_mean0.11241725594978264
step_physics_median0.11563125686493687
step_physics_min0.101312255859375
survival_time_max8.349999999999984
survival_time_mean7.1624999999999845
survival_time_min4.699999999999991
No reset possible
5726310980Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:14:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9931038421309748
survival_time_median15.15000000000008
deviation-center-line_median0.7852982964213822
in-drivable-lane_median4.175000000000059


other stats
agent_compute-ego0_max0.038015138935035386
agent_compute-ego0_mean0.023254385803469765
agent_compute-ego0_median0.021569687681357214
agent_compute-ego0_min0.011863028916129233
complete-iteration_max0.2166475621761118
complete-iteration_mean0.18033782796179304
complete-iteration_median0.17453989537115933
complete-iteration_min0.15562395892874167
deviation-center-line_max3.0823136145401535
deviation-center-line_mean1.273618198065888
deviation-center-line_min0.441562584880635
deviation-heading_max6.623283902472054
deviation-heading_mean2.7584710128287
deviation-heading_median1.60996291760096
deviation-heading_min1.1906743136408249
driven_any_max10.59061250840474
driven_any_mean4.51285004919887
driven_any_median2.6784620710704985
driven_any_min2.103863546249742
driven_lanedir_consec_max8.309467262538892
driven_lanedir_consec_mean3.5110664980411856
driven_lanedir_consec_min1.7485910453639018
driven_lanedir_max8.309467262538892
driven_lanedir_mean3.5110664980411856
driven_lanedir_median1.9931038421309748
driven_lanedir_min1.7485910453639018
get_duckie_state_max1.4589647206749936e-06
get_duckie_state_mean1.360882171757347e-06
get_duckie_state_median1.3372605171772174e-06
get_duckie_state_min1.3100429319999588e-06
get_robot_state_max0.003600984934426139
get_robot_state_mean0.003533220864647182
get_robot_state_median0.0035180884920908307
get_robot_state_min0.0034957215399809287
get_state_dump_max0.004972869967236931
get_state_dump_mean0.004551446815624686
get_state_dump_median0.0044546285193209365
get_state_dump_min0.004323660256619939
get_ui_image_max0.03518543714358483
get_ui_image_mean0.02935893399810978
get_ui_image_median0.028698399713121825
get_ui_image_min0.02485349942261065
in-drivable-lane_max11.94999999999932
in-drivable-lane_mean5.649999999999868
in-drivable-lane_min2.3000000000000327
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.3993864044690025, "get_ui_image": 0.026920616191669106, "step_physics": 0.09159833062304196, "survival_time": 13.65000000000006, "driven_lanedir": 2.0576123477774804, "get_state_dump": 0.004470988781782832, "get_robot_state": 0.0035239458084106445, "sim_render-ego0": 0.003800948170849877, "get_duckie_state": 1.35393908424099e-06, "in-drivable-lane": 2.3500000000000334, "deviation-heading": 1.1906743136408249, "agent_compute-ego0": 0.011863028916129233, "complete-iteration": 0.15562395892874167, "set_robot_commands": 0.0021543502807617188, "deviation-center-line": 0.5672670285604465, "driven_lanedir_consec": 2.0576123477774804, "sim_compute_sim_state": 0.009295464432152518, "sim_compute_performance-ego0": 0.001916266705868018}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.103863546249742, "get_ui_image": 0.03518543714358483, "step_physics": 0.12269818733749076, "survival_time": 12.100000000000035, "driven_lanedir": 1.7485910453639018, "get_state_dump": 0.004972869967236931, "get_robot_state": 0.003600984934426139, "sim_render-ego0": 0.004164591738225992, "get_duckie_state": 1.4589647206749936e-06, "in-drivable-lane": 2.3000000000000327, "deviation-heading": 1.979415038598743, "agent_compute-ego0": 0.031021308506467216, "complete-iteration": 0.2166475621761118, "set_robot_commands": 0.0021752310387882184, "deviation-center-line": 1.003329564282318, "driven_lanedir_consec": 1.7485910453639018, "sim_compute_sim_state": 0.010780547381428534, "sim_compute_performance-ego0": 0.0019620956216819985}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.957537737671995, "get_ui_image": 0.03047618323457455, "step_physics": 0.1084706504901726, "survival_time": 16.6500000000001, "driven_lanedir": 1.9285953364844692, "get_state_dump": 0.004323660256619939, "get_robot_state": 0.0035122311757710164, "sim_render-ego0": 0.0038362884235953144, "get_duckie_state": 1.3205819501134449e-06, "in-drivable-lane": 6.000000000000085, "deviation-heading": 1.2405107966031772, "agent_compute-ego0": 0.012118066856247224, "complete-iteration": 0.17697092730128122, "set_robot_commands": 0.002090518346089802, "deviation-center-line": 0.441562584880635, "driven_lanedir_consec": 1.9285953364844692, "sim_compute_sim_state": 0.010197442448781636, "sim_compute_performance-ego0": 0.0018654883264781472}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.59061250840474, "get_ui_image": 0.02485349942261065, "step_physics": 0.08764104713016832, "survival_time": 56.74999999999891, "driven_lanedir": 8.309467262538892, "get_state_dump": 0.0044382682568590405, "get_robot_state": 0.0034957215399809287, "sim_render-ego0": 0.0036913381076194873, "get_duckie_state": 1.3100429319999588e-06, "in-drivable-lane": 11.94999999999932, "deviation-heading": 6.623283902472054, "agent_compute-ego0": 0.038015138935035386, "complete-iteration": 0.17210886344103746, "set_robot_commands": 0.002161407764528839, "deviation-center-line": 3.0823136145401535, "driven_lanedir_consec": 8.309467262538892, "sim_compute_sim_state": 0.005883670189011265, "sim_compute_performance-ego0": 0.001846804375379858}}
set_robot_commands_max0.0021752310387882184
set_robot_commands_mean0.002145376857542145
set_robot_commands_median0.0021578790226452786
set_robot_commands_min0.002090518346089802
sim_compute_performance-ego0_max0.0019620956216819985
sim_compute_performance-ego0_mean0.0018976637573520053
sim_compute_performance-ego0_median0.0018908775161730824
sim_compute_performance-ego0_min0.001846804375379858
sim_compute_sim_state_max0.010780547381428534
sim_compute_sim_state_mean0.00903928111284349
sim_compute_sim_state_median0.009746453440467078
sim_compute_sim_state_min0.005883670189011265
sim_render-ego0_max0.004164591738225992
sim_render-ego0_mean0.0038732916100726674
sim_render-ego0_median0.003818618297222596
sim_render-ego0_min0.0036913381076194873
simulation-passed1
step_physics_max0.12269818733749076
step_physics_mean0.10260205389521844
step_physics_median0.10003449055660728
step_physics_min0.08764104713016832
survival_time_max56.74999999999891
survival_time_mean24.787499999999778
survival_time_min12.100000000000035
No reset possible
5722510991Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:10:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3567770261344618
survival_time_median12.875000000000048
deviation-center-line_median0.2514098743697321
in-drivable-lane_median9.800000000000043


other stats
agent_compute-ego0_max0.05585305152400848
agent_compute-ego0_mean0.05032304038414724
agent_compute-ego0_median0.05110690865634887
agent_compute-ego0_min0.04322529269988278
complete-iteration_max0.31150972843170166
complete-iteration_mean0.2476207299016095
complete-iteration_median0.23075169627141587
complete-iteration_min0.21746979863190455
deviation-center-line_max0.4779799718444904
deviation-center-line_mean0.2683935015348062
deviation-center-line_min0.0927742855552701
deviation-heading_max3.3042546626322884
deviation-heading_mean2.098916775950603
deviation-heading_median2.33199822877556
deviation-heading_min0.4274159836190029
driven_any_max3.2742182796654618
driven_any_mean2.30683430656378
driven_any_median2.847567485283145
driven_any_min0.25798397602336937
driven_lanedir_consec_max0.7709111802219895
driven_lanedir_consec_mean0.38744675903934817
driven_lanedir_consec_min0.06532180366647955
driven_lanedir_max0.7709111802219895
driven_lanedir_mean0.38744675903934817
driven_lanedir_median0.3567770261344618
driven_lanedir_min0.06532180366647955
get_duckie_state_max2.5567141446200286e-06
get_duckie_state_mean2.420764552301831e-06
get_duckie_state_median2.40761101584172e-06
get_duckie_state_min2.311122032903856e-06
get_robot_state_max0.0043073431138069395
get_robot_state_mean0.004235920575333512
get_robot_state_median0.004239661051174636
get_robot_state_min0.0041570170851778394
get_state_dump_max0.0053810419574860605
get_state_dump_mean0.005264768918008271
get_state_dump_median0.005243104038207189
get_state_dump_min0.005191825638132647
get_ui_image_max0.036500427030747934
get_ui_image_mean0.03244401507350622
get_ui_image_median0.03254955245004426
get_ui_image_min0.028176528363188437
in-drivable-lane_max10.550000000000036
in-drivable-lane_mean7.825000000000029
in-drivable-lane_min1.149999999999996
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.9006253804509097, "get_ui_image": 0.03027229048989036, "step_physics": 0.1085472176291726, "survival_time": 13.70000000000006, "driven_lanedir": 0.4098814436193621, "get_state_dump": 0.005263300808993253, "get_robot_state": 0.004264608729969372, "sim_render-ego0": 0.0044559938257390805, "get_duckie_state": 2.5567141446200286e-06, "in-drivable-lane": 9.350000000000035, "deviation-heading": 3.3042546626322884, "agent_compute-ego0": 0.05137887781316584, "complete-iteration": 0.22057216384194112, "set_robot_commands": 0.0026259066841819068, "deviation-center-line": 0.39465948416381585, "driven_lanedir_consec": 0.4098814436193621, "sim_compute_sim_state": 0.01122368032282049, "sim_compute_performance-ego0": 0.002429946552623402}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.25798397602336937, "get_ui_image": 0.036500427030747934, "step_physics": 0.18814171129657375, "survival_time": 3.049999999999997, "driven_lanedir": 0.06532180366647955, "get_state_dump": 0.0053810419574860605, "get_robot_state": 0.0043073431138069395, "sim_render-ego0": 0.004744591251496346, "get_duckie_state": 2.311122032903856e-06, "in-drivable-lane": 1.149999999999996, "deviation-heading": 1.7897101113121408, "agent_compute-ego0": 0.05585305152400848, "complete-iteration": 0.31150972843170166, "set_robot_commands": 0.0027168335453156504, "deviation-center-line": 0.1081602645756484, "driven_lanedir_consec": 0.06532180366647955, "sim_compute_sim_state": 0.011272622692969535, "sim_compute_performance-ego0": 0.002484594621965962}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.2742182796654618, "get_ui_image": 0.034826814410198165, "step_physics": 0.1324605913047331, "survival_time": 16.5500000000001, "driven_lanedir": 0.7709111802219895, "get_state_dump": 0.005222907267421125, "get_robot_state": 0.0042147133723799005, "sim_render-ego0": 0.004471478692020278, "get_duckie_state": 2.3482793785003296e-06, "in-drivable-lane": 10.250000000000052, "deviation-heading": 2.8742863462389794, "agent_compute-ego0": 0.04322529269988278, "complete-iteration": 0.2409312287008906, "set_robot_commands": 0.0024955387575080596, "deviation-center-line": 0.4779799718444904, "driven_lanedir_consec": 0.7709111802219895, "sim_compute_sim_state": 0.01156074024108519, "sim_compute_performance-ego0": 0.002346423735101539}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.79450959011538, "get_ui_image": 0.028176528363188437, "step_physics": 0.1132007640255384, "survival_time": 12.050000000000036, "driven_lanedir": 0.3036726086495616, "get_state_dump": 0.005191825638132647, "get_robot_state": 0.0041570170851778394, "sim_render-ego0": 0.004444148914873107, "get_duckie_state": 2.4669426531831095e-06, "in-drivable-lane": 10.550000000000036, "deviation-heading": 0.4274159836190029, "agent_compute-ego0": 0.0508349394995319, "complete-iteration": 0.21746979863190455, "set_robot_commands": 0.002526490156315575, "deviation-center-line": 0.0927742855552701, "driven_lanedir_consec": 0.3036726086495616, "sim_compute_sim_state": 0.006478000278315269, "sim_compute_performance-ego0": 0.0023528248810571087}}
set_robot_commands_max0.0027168335453156504
set_robot_commands_mean0.0025911922858302978
set_robot_commands_median0.002576198420248741
set_robot_commands_min0.0024955387575080596
sim_compute_performance-ego0_max0.002484594621965962
sim_compute_performance-ego0_mean0.002403447447687003
sim_compute_performance-ego0_median0.0023913857168402553
sim_compute_performance-ego0_min0.002346423735101539
sim_compute_sim_state_max0.01156074024108519
sim_compute_sim_state_mean0.010133760883797622
sim_compute_sim_state_median0.011248151507895014
sim_compute_sim_state_min0.006478000278315269
sim_render-ego0_max0.004744591251496346
sim_render-ego0_mean0.004529053171032203
sim_render-ego0_median0.004463736258879679
sim_render-ego0_min0.004444148914873107
simulation-passed1
step_physics_max0.18814171129657375
step_physics_mean0.13558757106400446
step_physics_median0.12283067766513577
step_physics_min0.1085472176291726
survival_time_max16.5500000000001
survival_time_mean11.337500000000048
survival_time_min3.049999999999997
No reset possible
5722211010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-020:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5721911010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-020:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5720811012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-020:03:31
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5708011027Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:26:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.7501445513028457
survival_time_median36.500000000000064
deviation-center-line_median1.4653203798914325
in-drivable-lane_median9.99999999999993


other stats
agent_compute-ego0_max0.021849232251995507
agent_compute-ego0_mean0.015018626539459203
agent_compute-ego0_median0.013014910034465432
agent_compute-ego0_min0.012195453836910447
complete-iteration_max0.2138088188520292
complete-iteration_mean0.1807323739734746
complete-iteration_median0.1776907944789937
complete-iteration_min0.1537390880838818
deviation-center-line_max2.223735617240879
deviation-center-line_mean1.5036831923970242
deviation-center-line_min0.8603563925643528
deviation-heading_max12.35350860085299
deviation-heading_mean7.814138773146677
deviation-heading_median7.535962120470743
deviation-heading_min3.831122250792234
driven_any_max9.420619371240576
driven_any_mean6.046119870970125
driven_any_median5.527582353695336
driven_any_min3.708695405249258
driven_lanedir_consec_max4.071210758342638
driven_lanedir_consec_mean3.445565228781769
driven_lanedir_consec_min2.2107610541787457
driven_lanedir_max7.069388151507211
driven_lanedir_mean4.3176960173600945
driven_lanedir_median3.9953174318772096
driven_lanedir_min2.2107610541787457
get_duckie_state_max1.411200312439155e-06
get_duckie_state_mean1.3190189964301785e-06
get_duckie_state_median1.3294433037340383e-06
get_duckie_state_min1.2059890658134822e-06
get_robot_state_max0.00367744027114496
get_robot_state_mean0.003607923061698255
get_robot_state_median0.003618324338570001
get_robot_state_min0.0035176032985080588
get_state_dump_max0.004664770539304549
get_state_dump_mean0.004540124640335054
get_state_dump_median0.004579231047899229
get_state_dump_min0.004337265926237209
get_ui_image_max0.03496333331596561
get_ui_image_mean0.029603629889096157
get_ui_image_median0.02967294018312004
get_ui_image_min0.02410530587417895
in-drivable-lane_max13.199999999999772
in-drivable-lane_mean10.124999999999932
in-drivable-lane_min7.3000000000001
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.0357622338358246, "get_ui_image": 0.027372301181900167, "step_physics": 0.0990010202859421, "survival_time": 32.05000000000032, "driven_lanedir": 3.9275028038180304, "get_state_dump": 0.004664770539304549, "get_robot_state": 0.0035886615978965876, "sim_render-ego0": 0.0038335884100180176, "get_duckie_state": 1.411200312439155e-06, "in-drivable-lane": 7.3000000000001, "deviation-heading": 3.831122250792234, "agent_compute-ego0": 0.012195453836910447, "complete-iteration": 0.16534732621035472, "set_robot_commands": 0.002108095962310506, "deviation-center-line": 1.0003324049076805, "driven_lanedir_consec": 3.9275028038180304, "sim_compute_sim_state": 0.010526144987326172, "sim_compute_performance-ego0": 0.001970063860171309}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.019402473554847, "get_ui_image": 0.03496333331596561, "step_physics": 0.13850990097697188, "survival_time": 40.94999999999981, "driven_lanedir": 4.063132059936389, "get_state_dump": 0.004552159076783715, "get_robot_state": 0.00367744027114496, "sim_render-ego0": 0.003935637997417915, "get_duckie_state": 1.32496764020222e-06, "in-drivable-lane": 10.249999999999734, "deviation-heading": 12.35350860085299, "agent_compute-ego0": 0.012568488935144936, "complete-iteration": 0.2138088188520292, "set_robot_commands": 0.002238111670424298, "deviation-center-line": 1.930308354875184, "driven_lanedir_consec": 3.57278629878766, "sim_compute_sim_state": 0.0112295546182772, "sim_compute_performance-ego0": 0.0020460937081313714}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.708695405249258, "get_ui_image": 0.03197357918433992, "step_physics": 0.11739364772917252, "survival_time": 25.250000000000224, "driven_lanedir": 2.2107610541787457, "get_state_dump": 0.004606303019014743, "get_robot_state": 0.003647987079243415, "sim_render-ego0": 0.0039728413457455845, "get_duckie_state": 1.3339189672658569e-06, "in-drivable-lane": 9.750000000000128, "deviation-heading": 3.880723117614693, "agent_compute-ego0": 0.013461331133785929, "complete-iteration": 0.19003426274763263, "set_robot_commands": 0.0022816884187841606, "deviation-center-line": 0.8603563925643528, "driven_lanedir_consec": 2.2107610541787457, "sim_compute_sim_state": 0.010619324186573858, "sim_compute_performance-ego0": 0.001985603641615555}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.420619371240576, "get_ui_image": 0.02410530587417895, "step_physics": 0.08613819980700745, "survival_time": 59.99999999999873, "driven_lanedir": 7.069388151507211, "get_state_dump": 0.004337265926237209, "get_robot_state": 0.0035176032985080588, "sim_render-ego0": 0.003717559263370714, "get_duckie_state": 1.2059890658134822e-06, "in-drivable-lane": 13.199999999999772, "deviation-heading": 11.191201123326794, "agent_compute-ego0": 0.021849232251995507, "complete-iteration": 0.1537390880838818, "set_robot_commands": 0.0021745783403255264, "deviation-center-line": 2.223735617240879, "driven_lanedir_consec": 4.071210758342638, "sim_compute_sim_state": 0.005938920450647308, "sim_compute_performance-ego0": 0.0018817479167750832}}
set_robot_commands_max0.0022816884187841606
set_robot_commands_mean0.002200618597961123
set_robot_commands_median0.0022063450053749125
set_robot_commands_min0.002108095962310506
sim_compute_performance-ego0_max0.0020460937081313714
sim_compute_performance-ego0_mean0.0019708772816733294
sim_compute_performance-ego0_median0.0019778337508934317
sim_compute_performance-ego0_min0.0018817479167750832
sim_compute_sim_state_max0.0112295546182772
sim_compute_sim_state_mean0.009578486060706135
sim_compute_sim_state_median0.010572734586950017
sim_compute_sim_state_min0.005938920450647308
sim_render-ego0_max0.0039728413457455845
sim_render-ego0_mean0.003864906754138058
sim_render-ego0_median0.0038846132037179664
sim_render-ego0_min0.003717559263370714
simulation-passed1
step_physics_max0.13850990097697188
step_physics_mean0.1102606921997735
step_physics_median0.10819733400755732
step_physics_min0.08613819980700745
survival_time_max59.99999999999873
survival_time_mean39.562499999999766
survival_time_min25.250000000000224
No reset possible
5704911032Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:04:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5703711313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-020:02:25
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5700011312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-020:02:28
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5682511080Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:36:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.991005218153541
survival_time_median59.99999999999873
deviation-center-line_median3.0938258468329725
in-drivable-lane_median9.9249999999998


other stats
agent_compute-ego0_max0.03554844300415395
agent_compute-ego0_mean0.02423357452381461
agent_compute-ego0_median0.024801596515283898
agent_compute-ego0_min0.01178266206053671
complete-iteration_max0.23211371114510085
complete-iteration_mean0.1859780056192714
complete-iteration_median0.17882701836458154
complete-iteration_min0.1541442746028217
deviation-center-line_max3.4009170443706394
deviation-center-line_mean3.0666856192420457
deviation-center-line_min2.6781737389315983
deviation-heading_max19.30997198270497
deviation-heading_mean15.292406526220924
deviation-heading_median15.136184969322578
deviation-heading_min11.587284183533578
driven_any_max9.6687639204586
driven_any_mean9.334333358764985
driven_any_median9.320929362481513
driven_any_min9.026710789638312
driven_lanedir_consec_max8.63935556617444
driven_lanedir_consec_mean6.263253913323066
driven_lanedir_consec_min4.431649650810741
driven_lanedir_max8.63935556617444
driven_lanedir_mean7.292986090627949
driven_lanedir_median7.322108201888423
driven_lanedir_min5.888372392560509
get_duckie_state_max2.1668099840912195e-06
get_duckie_state_mean1.9289373259659513e-06
get_duckie_state_median1.9527097030245793e-06
get_duckie_state_min1.643519913723427e-06
get_robot_state_max0.003657733868004182
get_robot_state_mean0.003497746564466491
get_robot_state_median0.0035258825375178177
get_robot_state_min0.0032814873148261457
get_state_dump_max0.004644909865850215
get_state_dump_mean0.004394388665366828
get_state_dump_median0.004413376144326597
get_state_dump_min0.004105892506963903
get_ui_image_max0.03538676007006389
get_ui_image_mean0.02899328318364813
get_ui_image_median0.027363549660484956
get_ui_image_min0.02585927334355871
in-drivable-lane_max15.299999999999564
in-drivable-lane_mean9.674999999999796
in-drivable-lane_min3.5500000000000167
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.6687639204586, "get_ui_image": 0.02585927334355871, "step_physics": 0.08974301606590404, "survival_time": 59.99999999999873, "driven_lanedir": 8.63935556617444, "get_state_dump": 0.004260956893654092, "get_robot_state": 0.003432340566363561, "sim_render-ego0": 0.003653760158846916, "get_duckie_state": 1.8072962066116777e-06, "in-drivable-lane": 4.69999999999985, "deviation-heading": 11.587284183533578, "agent_compute-ego0": 0.014757132550064072, "complete-iteration": 0.1541442746028217, "set_robot_commands": 0.002057221410276491, "deviation-center-line": 2.6781737389315983, "driven_lanedir_consec": 8.63935556617444, "sim_compute_sim_state": 0.008434456254322265, "sim_compute_performance-ego0": 0.0018729933294825112}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.156956227846743, "get_ui_image": 0.03538676007006389, "step_physics": 0.1335066176771026, "survival_time": 59.99999999999873, "driven_lanedir": 5.888372392560509, "get_state_dump": 0.004565795394999101, "get_robot_state": 0.003657733868004182, "sim_render-ego0": 0.003948925933075586, "get_duckie_state": 2.1668099840912195e-06, "in-drivable-lane": 15.299999999999564, "deviation-heading": 19.30997198270497, "agent_compute-ego0": 0.03554844300415395, "complete-iteration": 0.23211371114510085, "set_robot_commands": 0.0023095901562311966, "deviation-center-line": 2.9701959003866047, "driven_lanedir_consec": 4.431649650810741, "sim_compute_sim_state": 0.01107021017336627, "sim_compute_performance-ego0": 0.0020337162367211692}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.026710789638312, "get_ui_image": 0.0286853772019665, "step_physics": 0.11547254086731872, "survival_time": 59.99999999999873, "driven_lanedir": 6.019738226244154, "get_state_dump": 0.004105892506963903, "get_robot_state": 0.0032814873148261457, "sim_render-ego0": 0.0035134181690454286, "get_duckie_state": 1.643519913723427e-06, "in-drivable-lane": 15.14999999999975, "deviation-heading": 18.25154393459369, "agent_compute-ego0": 0.01178266206053671, "complete-iteration": 0.1813210150681368, "set_robot_commands": 0.0019139113970144304, "deviation-center-line": 3.4009170443706394, "driven_lanedir_consec": 5.5564976827775645, "sim_compute_sim_state": 0.010771805797389504, "sim_compute_performance-ego0": 0.0017224592928286892}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.484902497116275, "get_ui_image": 0.02604172211900341, "step_physics": 0.09309331801015074, "survival_time": 59.99999999999873, "driven_lanedir": 8.624478177532692, "get_state_dump": 0.004644909865850215, "get_robot_state": 0.003619424508672074, "sim_render-ego0": 0.0038240350950369726, "get_duckie_state": 2.0981231994374805e-06, "in-drivable-lane": 3.5500000000000167, "deviation-heading": 12.020826004051465, "agent_compute-ego0": 0.03484606048050371, "complete-iteration": 0.1763330216610263, "set_robot_commands": 0.0021894148843274526, "deviation-center-line": 3.2174557932793397, "driven_lanedir_consec": 6.425512753529518, "sim_compute_sim_state": 0.0060929666450875285, "sim_compute_performance-ego0": 0.001897464882424233}}
set_robot_commands_max0.0023095901562311966
set_robot_commands_mean0.0021175344619623927
set_robot_commands_median0.0021233181473019717
set_robot_commands_min0.0019139113970144304
sim_compute_performance-ego0_max0.0020337162367211692
sim_compute_performance-ego0_mean0.0018816584353641508
sim_compute_performance-ego0_median0.001885229105953372
sim_compute_performance-ego0_min0.0017224592928286892
sim_compute_sim_state_max0.01107021017336627
sim_compute_sim_state_mean0.009092359717541392
sim_compute_sim_state_median0.009603131025855884
sim_compute_sim_state_min0.0060929666450875285
sim_render-ego0_max0.003948925933075586
sim_render-ego0_mean0.003735034839001226
sim_render-ego0_median0.003738897626941944
sim_render-ego0_min0.0035134181690454286
simulation-passed1
step_physics_max0.1335066176771026
step_physics_mean0.10795387315511902
step_physics_median0.10428292943873473
step_physics_min0.08974301606590404
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5676011284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:03:06
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5672711090Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:04:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6712174117854189
survival_time_median6.124999999999986
deviation-center-line_median0.12212002611983686
in-drivable-lane_median3.374999999999988


other stats
agent_compute-ego0_max0.013831438841643158
agent_compute-ego0_mean0.013514098338145094
agent_compute-ego0_median0.013624808192253111
agent_compute-ego0_min0.012975338126430992
complete-iteration_max0.2002149643721404
complete-iteration_mean0.1842675637437504
complete-iteration_median0.19255584713071583
complete-iteration_min0.15174359634142964
deviation-center-line_max0.3451232387068854
deviation-center-line_mean0.16329501569524643
deviation-center-line_min0.06381677183442669
deviation-heading_max1.19186081621583
deviation-heading_mean0.7602207734156148
deviation-heading_median0.7244497410749604
deviation-heading_min0.40012279529670824
driven_any_max2.449321265185727
driven_any_mean1.8378641790616053
driven_any_median1.776717200400169
driven_any_min1.3487010502603565
driven_lanedir_consec_max0.9061542454446772
driven_lanedir_consec_mean0.7051491440022599
driven_lanedir_consec_min0.5720075069935251
driven_lanedir_max0.9061542454446772
driven_lanedir_mean0.7051491440022599
driven_lanedir_median0.6712174117854189
driven_lanedir_min0.5720075069935251
get_duckie_state_max1.482021661452305e-06
get_duckie_state_mean1.328848084002588e-06
get_duckie_state_median1.2908365671374215e-06
get_duckie_state_min1.2516975402832031e-06
get_robot_state_max0.003769979476928711
get_robot_state_mean0.003703471017888005
get_robot_state_median0.003741039641569426
get_robot_state_min0.003561825311484457
get_state_dump_max0.004796056747436523
get_state_dump_mean0.0046913449655217685
get_state_dump_median0.004738412935424734
get_state_dump_min0.004492497243801085
get_ui_image_max0.036970163569038296
get_ui_image_mean0.03173908255141163
get_ui_image_median0.03179013859480619
get_ui_image_min0.02640588944699584
in-drivable-lane_max5.799999999999984
in-drivable-lane_mean3.774999999999987
in-drivable-lane_min2.549999999999991
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.855326718389943, "get_ui_image": 0.030458619818091393, "step_physics": 0.119657501578331, "survival_time": 6.349999999999985, "driven_lanedir": 0.9061542454446772, "get_state_dump": 0.004782743752002716, "get_robot_state": 0.003754066303372383, "sim_render-ego0": 0.0040198396891355515, "get_duckie_state": 1.3094395399093628e-06, "in-drivable-lane": 3.2499999999999885, "deviation-heading": 0.988572166590817, "agent_compute-ego0": 0.013495475053787231, "complete-iteration": 0.18939189426600933, "set_robot_commands": 0.002340070903301239, "deviation-center-line": 0.3451232387068854, "driven_lanedir_consec": 0.9061542454446772, "sim_compute_sim_state": 0.008758554235100746, "sim_compute_performance-ego0": 0.002038685604929924}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.449321265185727, "get_ui_image": 0.036970163569038296, "step_physics": 0.12305304886382304, "survival_time": 8.04999999999998, "driven_lanedir": 0.5720075069935251, "get_state_dump": 0.004694082118846752, "get_robot_state": 0.003728012979766469, "sim_render-ego0": 0.003955112563239204, "get_duckie_state": 1.482021661452305e-06, "in-drivable-lane": 5.799999999999984, "deviation-heading": 1.19186081621583, "agent_compute-ego0": 0.013831438841643158, "complete-iteration": 0.2002149643721404, "set_robot_commands": 0.002165377875904978, "deviation-center-line": 0.1771000009511695, "driven_lanedir_consec": 0.5720075069935251, "sim_compute_sim_state": 0.009781382702015064, "sim_compute_performance-ego0": 0.001949957859368972}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.3487010502603565, "get_ui_image": 0.03312165737152099, "step_physics": 0.12320332050323486, "survival_time": 4.94999999999999, "driven_lanedir": 0.664371852734368, "get_state_dump": 0.004796056747436523, "get_robot_state": 0.003769979476928711, "sim_render-ego0": 0.004173460006713867, "get_duckie_state": 1.2516975402832031e-06, "in-drivable-lane": 2.549999999999991, "deviation-heading": 0.40012279529670824, "agent_compute-ego0": 0.013754141330718997, "complete-iteration": 0.19571979999542236, "set_robot_commands": 0.0023017120361328125, "deviation-center-line": 0.06381677183442669, "driven_lanedir_consec": 0.664371852734368, "sim_compute_sim_state": 0.008445346355438232, "sim_compute_performance-ego0": 0.0020677542686462404}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.698107682410395, "get_ui_image": 0.02640588944699584, "step_physics": 0.0913954963203238, "survival_time": 5.899999999999987, "driven_lanedir": 0.6780629708364698, "get_state_dump": 0.004492497243801085, "get_robot_state": 0.003561825311484457, "sim_render-ego0": 0.0037192917671524175, "get_duckie_state": 1.2722335943654805e-06, "in-drivable-lane": 3.4999999999999876, "deviation-heading": 0.4603273155591037, "agent_compute-ego0": 0.012975338126430992, "complete-iteration": 0.15174359634142964, "set_robot_commands": 0.0021519039859290885, "deviation-center-line": 0.06714005128850419, "driven_lanedir_consec": 0.6780629708364698, "sim_compute_sim_state": 0.005076027717910895, "sim_compute_performance-ego0": 0.0018809703217834983}}
set_robot_commands_max0.002340070903301239
set_robot_commands_mean0.0022397662003170297
set_robot_commands_median0.002233544956018895
set_robot_commands_min0.0021519039859290885
sim_compute_performance-ego0_max0.0020677542686462404
sim_compute_performance-ego0_mean0.0019843420136821588
sim_compute_performance-ego0_median0.001994321732149448
sim_compute_performance-ego0_min0.0018809703217834983
sim_compute_sim_state_max0.009781382702015064
sim_compute_sim_state_mean0.008015327752616234
sim_compute_sim_state_median0.00860195029526949
sim_compute_sim_state_min0.005076027717910895
sim_render-ego0_max0.004173460006713867
sim_render-ego0_mean0.00396692600656026
sim_render-ego0_median0.003987476126187378
sim_render-ego0_min0.0037192917671524175
simulation-passed1
step_physics_max0.12320332050323486
step_physics_mean0.11432734181642816
step_physics_median0.121355275221077
step_physics_min0.0913954963203238
survival_time_max8.04999999999998
survival_time_mean6.312499999999986
survival_time_min4.94999999999999
No reset possible
5668011282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:06:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5665911278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5663111311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:04:07
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5661211311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:55
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5657011281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:03:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5653211285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:53
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5648411425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-020:02:24
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5646011289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5639811287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:11
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5638311299Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5635011296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:49
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5632811296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5631311427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-020:00:54
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5625711429Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-020:00:46
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5620911430Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV-sim-validationLFVv-simhost-erroryesnogpu-prod-020:02:34
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5618111301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||